CN116248965A - Voice help seeking method based on intelligent television and related equipment - Google Patents
Voice help seeking method based on intelligent television and related equipment Download PDFInfo
- Publication number
- CN116248965A CN116248965A CN202310238749.9A CN202310238749A CN116248965A CN 116248965 A CN116248965 A CN 116248965A CN 202310238749 A CN202310238749 A CN 202310238749A CN 116248965 A CN116248965 A CN 116248965A
- Authority
- CN
- China
- Prior art keywords
- help
- seeking
- television
- intention
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000009429 distress Effects 0.000 claims abstract description 68
- 230000007246 mechanism Effects 0.000 claims abstract description 24
- 238000005516 engineering process Methods 0.000 claims description 19
- 230000011218 segmentation Effects 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 13
- 238000005520 cutting process Methods 0.000 claims description 11
- 230000001960 triggered effect Effects 0.000 abstract description 4
- 238000003058 natural language processing Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 7
- 230000006855 networking Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000005065 mining Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 208000028399 Critical Illness Diseases 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000003776 cleavage reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000003912 environmental pollution Methods 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000005180 public health Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000007017 scission Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G10L15/1822—Parsing for meaning understanding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a voice help seeking method based on an intelligent television and related equipment, wherein the method comprises the following steps: receiving the sound record of the MIC or the sound record of the MIC on a remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller; carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user; and sending distress information to a mechanism corresponding to the distress intention according to the distress intention. According to the invention, the help seeking intention of the user is analyzed through NLP semantic processing based on the intelligent television, and according to different intentions of the user, the intelligent television, the camera, the micro-letter applet and the IOT system are linked, so that the help seeking is triggered in a far-field voice wake-free mode, and particularly when a person in a solitary life has an emergency and cannot touch the help seeking equipment, the intelligent television can acquire the help seeking intention of the user and timely send the help seeking information to a corresponding rescue center.
Description
Technical Field
The invention relates to the technical field of voice help seeking, in particular to a voice help seeking method and system based on an intelligent television, the intelligent television and a computer readable storage medium.
Background
110. 119, 120 are special distress numbers, 110, which are commonly known: the alarm telephone number can be dialed 110 when robbing, cradling, stealing and other events endangering social stability are met, and meanwhile, when personal safety is threatened, the user needs to dial 110 in time to ask for help; 119: the fire alarm telephone can be used for dialing the fire alarm telephone 119 when encountering natural disasters such as fire, dangerous chemical leakage, road traffic accidents, earthquakes, building collapse, major safety production accidents, air spaces, explosions, terrorist events, masses distress events, water droughts, weather, geological disasters, forests, grassland fires and the like, mine and water accidents, major environmental pollution, nuclear and radiation accidents and sudden public health events; 120: the hospital emergency call is called 120, the emergency center is served for 24 hours, and if the emergency critical illness happens outside the hospital, the hospital emergency call can be called 120 at any time to find an ambulance for the emergency center.
In order to accelerate the help seeking speed and reduce the loss of personnel and property, a one-key alarming device is arranged in many places, when a major or emergency situation occurs, a user only needs to press a button through one-key alarming without speaking, and the police bureau 110 command center can quickly acquire the position of the user according to the alarming number of one-key alarming, so that nearby polices are mobilized or personnel at a dispatch place quickly arrive at the site for disposal.
However, when the existing one-key alarm is not analyzed on the specific intention of the alarm person, time is consumed in acquiring the specific intention of the alarm person, so that rescue is not timely enough, the existing one-key alarm needs manual triggering of a user, particularly a solitary person, when the user cannot touch the alarm device, the user cannot ask for help, and serious loss is brought to lives and properties of the user.
Accordingly, the prior art is still in need of improvement and development.
Disclosure of Invention
The invention mainly aims to provide a voice help seeking method and system based on an intelligent television, the intelligent television and a computer readable storage medium, and aims to solve the problem that in the prior art, when a sudden emergency occurs in a home, the specific intention of a person seeking help cannot be analyzed when a one-key alarm is carried out, so that rescue is not timely enough.
In order to achieve the above purpose, the invention provides a voice help seeking method based on an intelligent television, which comprises the following steps:
receiving the sound record of the MIC or the sound record of the MIC on a remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller;
carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user;
and sending distress information to a mechanism corresponding to the distress intention according to the distress intention.
Optionally, the voice help seeking method based on the smart television, wherein the step of controlling the smart television to acquire a help seeking instruction sent by a user through MIC recording or remote controller MIC recording, further comprises the following steps:
receiving a binding request of a user for binding the smart television through a television WeChat applet in a mobile terminal, and completing binding with the mobile terminal after receiving the binding request;
the television WeChat applet is preset with a help address, a contact name and a telephone;
and the intelligent television and a home main power switch are under an IOT system.
Optionally, in the voice help seeking method based on the smart television, the help seeking instruction sent by the user is semantically processed through NLP, and the help seeking intention of the user is resolved, which specifically includes:
a word stock is predefined according to a barking word segmentation technology, and a word stock is predefined, wherein the word stock stores distress intents corresponding to different word technologies;
after receiving a help-seeking instruction sent by a user, cutting the help-seeking instruction through the speaking dictionary according to the barking word segmentation technology, and matching the user speaking obtained by cutting with the word stock to obtain the help-seeking intention of the user; wherein, the help seeking intent includes: 110 intent, 120 intent, and 119 intent.
Optionally, the voice help seeking method based on the smart television, wherein the sending, according to the help seeking intention, help seeking information to a mechanism corresponding to the help seeking intention specifically includes:
when the help seeking intention is 110 intention, judging whether the intelligent television has a camera, if the intelligent television does not have the camera, sending help seeking information to the television WeChat applet, and controlling the television WeChat applet to automatically dial 110 for alarming.
If the intelligent television has a camera, the camera is opened, distress information and field image information acquired by the camera are sent to the television WeChat applet, the television WeChat applet is controlled to automatically dial 110 for alarming, and the television WeChat applet is controlled to send the field image information to a public security bureau.
Optionally, the voice help seeking method based on the smart television, wherein the sending, according to the help seeking intention, help seeking information to a mechanism corresponding to the help seeking intention specifically includes:
when the help seeking intention is 120 intention, judging whether the intelligent television has a camera, if the intelligent television does not have the camera, sending help seeking information to the television WeChat applet, controlling the television WeChat applet to automatically dial 120 first aid, and simultaneously playing help seeking audio in a loud sound;
if the television has a camera, the camera is opened, help seeking information and on-site image information acquired by the camera are sent to the television micro-letter applet, the television micro-letter applet is controlled to automatically dial 120 first aid, the television micro-letter applet is controlled to send the on-site image information to a hospital, and meanwhile help seeking audio is played in a loud sound.
Optionally, in the voice help seeking method based on the smart television, when the help seeking intention is 119 intention, the voice help seeking method specifically includes:
and sending help seeking information to the television WeChat applet, controlling the television WeChat applet to automatically dial 119 to fight the fire, and simultaneously cutting off the total power supply through the IOT system.
Optionally, the voice help seeking method based on the smart television, wherein the sending, according to the help seeking intention, help seeking information to a mechanism corresponding to the help seeking intention, further includes:
and controlling the television WeChat applet to send the help-seeking address, the name of the contact person and the telephone to a corresponding mechanism.
In addition, in order to achieve the above purpose, the invention further provides a voice help-seeking system based on the smart television, wherein the voice help-seeking system based on the smart television comprises:
the distress instruction receiving module is used for receiving the sound record of the MIC or the sound record of the MIC on the remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller;
the help-seeking instruction processing module is used for carrying out NLP semantic processing on the help-seeking instruction sent by the user and analyzing to obtain the help-seeking intention of the user;
the help seeking information sending module is used for sending help seeking information to a mechanism corresponding to the help seeking intention according to the help seeking intention.
In addition, in order to achieve the above object, the present invention further provides an intelligent television, where the terminal includes: the voice help-seeking program based on the intelligent television comprises a memory, a processor and a voice help-seeking program based on the intelligent television, wherein the voice help-seeking program based on the intelligent television is stored in the memory and can run on the processor, and the voice help-seeking method based on the intelligent television comprises the steps when the voice help-seeking program based on the intelligent television is executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a computer readable storage medium, where the computer readable storage medium stores a voice help-seeking program based on a smart television, and the voice help-seeking program based on the smart television implements the steps of the voice help-seeking method based on the smart television as described above when being executed by a processor.
In the invention, a sound recording of an MIC or a sound recording of the MIC on a remote controller is received, and a distress instruction sent by a user is obtained according to the sound recording of the MIC or the sound recording of the MIC on the remote controller; carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user; and sending distress information to a mechanism corresponding to the distress intention according to the distress intention. According to different intentions of a user, the intelligent television, the camera, the WeChat applet and the IOT system are linked, so that the help seeking is triggered in a far-field voice wake-free mode, and when the user, particularly the current solitary person has an emergency and cannot touch help seeking equipment, the intelligent television can acquire the help seeking intentions of the user and timely send help seeking information to a corresponding rescue center.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of the voice help method based on the smart television of the present invention;
FIG. 2 is a flow chart of voice help seeking in a preferred embodiment of the voice help seeking method based on the smart television of the present invention;
FIG. 3 is a flowchart of user intent analysis in a preferred embodiment of the smart television-based voice help method of the present invention;
FIG. 4 is a schematic diagram of a voice help system based on a smart television according to a preferred embodiment of the present invention;
FIG. 5 is a schematic diagram of the operating environment of a preferred embodiment of the terminal of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clear and clear, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The voice help-seeking method based on the intelligent television in the preferred embodiment of the invention, as shown in fig. 1 and 2, comprises the following steps:
and S10, receiving the MIC record or the MIC record on the remote controller, and acquiring a distress instruction sent by a user according to the MIC record or the MIC record on the remote controller.
Specifically, the existing smart television or a remote controller of the smart television is generally provided with a voice function, and can receive voice instruction information sent by a user.
The step S10 further includes: and receiving a binding request of a binding intelligent television sent by a user through a television WeChat applet in the mobile terminal, and completing binding with the mobile terminal after receiving the binding request.
Specifically, in order to send help seeking information in time, the user is required to bind with the intelligent television in the home in advance through the television WeChat applet on the mobile terminal, and the binding process is as follows: firstly, a television WeChat applet focused by a mobile terminal is opened, wiFi (WiFi is a wireless network, the wireless network refers to 'wireless compatibility authentication' in the category of a wireless local area network, and is a commercial authentication, meanwhile, the wireless network technology is also adopted, computers are connected through network cables in the past, wi-Fi is connected through radio waves in a networking mode) and connected, so that the mobile terminal and the smart television are positioned in the same WiFi network, then the smart television equipment in the home is found according to equipment numbers in smart television equipment currently identified by the applet, the smart television in the home is selected to be bound, and (the binding can be carried out by directly inputting the IP address of the home television in the television WeChat applet), at the moment, the information requesting to be bound and the equipment number of the mobile terminal requesting to be bound can be popped up in the screen of the smart television, and finally, after the user selects to confirm, the binding is completed with the smart television.
The step S10 further includes: the television WeChat applet is preset with a help address, a contact name and a telephone.
Specifically, after the mobile terminal and the smart television complete the binding, the user needs to preset basic rescue information on the television WeChat applet, where the basic rescue information includes: distress address, contact name, and phone number.
The help seeking address is a necessary filling item, a user needs to accurately fill in a house number to realize accurate rescue, further, the contact person comprises an emergency contact person when danger occurs and the emergency contact person and the contact person are necessary filling items, and the emergency contact person needs to be filled with at least one telephone and number of the emergency contact person, and can also select to be filled with multiple emergency contacts; optionally, the invention is mainly aimed at solitary personnel, but when more family members exist, one intelligent television can be bound with a plurality of mobile terminals, and likewise, one mobile terminal can be bound with a plurality of intelligent televisions, so that the capability of processing risks is improved to a greater extent.
It should be noted that, in the television WeChat applet, in order to avoid abnormal triggering of help seeking (only words such as 110 and 120 are spoken, but not call help seeking is intended, or a child calls skin purposely), waste of rescue resources is generated, on a mobile terminal bound with the smart television, a user may set an action executed by the television WeChat applet when help seeking information is received by himself, for example, the action may be: after receiving the distress signal, the applet automatically dials the distress number in time and sounds an alarm (can be vibration sound or vibration ringing sound, and the user can set according to different rescue institutions, for example, after receiving 110 the intention of the user, the mobile phone sounds vibration sound which is safer in some cases); or after receiving the distress signal, the television micro-message applet sends out alarm sound, and automatically dials the distress number after preset time (for example, 20 seconds and 30 seconds), if the distress is abnormally triggered, the user has sufficient time to open the mobile terminal to close the distress process after hearing the alarm sound; or after receiving the distress signal, the television WeChat applet sounds an alarm, but does not dial itself, and the user manually dials itself after receiving the information (this is typically used on the mobile terminal of the family of the solitary).
Furthermore, the intelligent television and the home main power switch are positioned under the same IOT system.
The internet of things (Internet of Things, ioT for short) refers to collecting any object or process needing to be monitored, connected and interacted in real time through various devices and technologies such as various information sensors, radio frequency identification technologies, global positioning systems, infrared sensors and laser scanners, collecting various needed information such as sound, light, heat, electricity, mechanics, chemistry, biology and positions, and realizing ubiquitous connection of objects and people through various possible network access, and realizing intelligent sensing, identification and management of objects and processes. The internet of things is an information carrier based on the internet, a traditional telecommunication network and the like, and enables all common physical objects which can be independently addressed to form an interconnection network, and the key technology of the internet of things, namely RFID, is a simple wireless system and consists of an interrogator (or reader) and a plurality of transponders (or tags). The tag consists of a coupling element and a chip, each tag is provided with a unique electronic code of an extended term, the tag is attached to an object to identify a target object, the tag transmits radio frequency information to a reader through an antenna, the reader is equipment for reading the information, and the RFID technology enables the object to be "talking out" through an opening.
Specifically, can be through wireless connection such as WIFI, bluetooth, need not to arrange the net twine, will intelligent TV and the total power supply switch in home join under same thing networking, also can be in the mobile terminal download management home smart machine's APP (like wisdom house etc.) will intelligent TV and the total power supply switch in home join under same thing networking to this interconnection between the realization equipment, when the accident, can be through the intelligent TV comes control total power supply switch to ensure the safety of power, prevent the dangerous situation that brings because of power failure.
And step S20, carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user.
NLP (natural language processing) is a subject of language problems of interaction between researchers and computers, and the system can be divided into three types of simple matching type, fuzzy matching type and paragraph cleavage type according to different technical implementation difficulties.
Specifically, as shown in fig. 3, performing semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user includes:
a word dictionary is defined in advance according to the barking and word segmentation technology, a word stock is defined in advance, and the word stock stores distress intents corresponding to different word technologies.
The Chinese word segmentation device with better current effect supports Chinese simplified and traditional word segmentation and also supports a custom word stock. The crust word segmentation supports three word segmentation modes: exact mode, full mode, and search engine mode. The exact mode is intended to cut the sentence most precisely, and is suitable for text analysis; the principle of the full mode is that all words which can form words in sentences are scanned out, the word segmentation speed is high, and the defect that ambiguous words and sentences cannot be identified is that; the search engine mode is further processed on the basis of the accurate mode, longer words are segmented, recall rate is improved, and the method is suitable for word segmentation of the search engine. The crust segmentation word is provided with a dictionary which contains 20000 words, and the occurrence times and the part of speech of the vocabulary entries. The algorithm used for the resultant word segmentation has word graph traversal based on the Trie tree, a DAG graph is generated, the graph is determined by all possible combinations of all Chinese characters in a sentence, a path with the maximum probability is searched by adopting Dynamic Programming (DP), so that the maximum segmentation combination based on word frequency is found, and for the unrecorded words in the resultant word dictionary, an HMM model based on the word forming capability of the Chinese characters and the Viterbi algorithm are used.
Specifically, in the invention, a developer can pre-designate a self-defined dictionary by using a barking word segmentation technology so as to contain words which are not in the barking dictionary, and although the barking dictionary has new word recognition capability, the self-addition of the new words can ensure higher accuracy, wherein the jieba.load_user is used for loading the new words into the dictionary, and the # file_name is a file object or a path of the self-defined dictionary. For example, the key words in the user speaking operation which need to be extracted in the invention such as 110, 120, 119 can be added into the custom dictionary.
Furthermore, a word stock is preset, and the word stock stores the distress intents corresponding to different vocabularies, for example, the distress intents corresponding to the vocabularies 110 are called 110 intents, the distress intents corresponding to the vocabularies 120 are called 120 intents, and the distress intents corresponding to the vocabularies 119 are called 119 intents.
After receiving a help-seeking instruction sent by a user, cutting the help-seeking instruction through the speaking dictionary according to the barking word segmentation technology, and matching the user speaking obtained by cutting with the word stock to obtain the help-seeking intention of the user.
TF-IDF (term frequency-reverse document frequency) is a common weighting technique used for information retrieval (information retrieval) and text mining (text mining). TF-IDF is a statistical method used to evaluate the importance of a word to one of a set of documents or a corpus. The importance of a word increases proportionally with the number of times it appears in the file, but at the same time decreases inversely with the frequency with which it appears in the corpus. The main ideas of TF-IDF are: if a word appears in one article with a high frequency TF and in other articles with few occurrences, the word or phrase is considered to have good category discrimination and is suitable for classification.
Specifically, after the smart television receives a help-seeking instruction sent by a user, the help-seeking instruction is segmented in the pre-defined dictionary based on a TF-IDF algorithm according to a barking word segmentation technology, a key user speaking operation is extracted, the key user speaking operation is used for matching a well-defined word stock, for example, when a user catches fire in home, the user calls help for help to dial 119 aloud, the smart television can segment the help-seeking instruction after receiving the help-seeking instruction of the user, and the help-seeking instruction is segmented into three key user speaking operations: help me/dial/119, then take these three key users to call and match the word stock defined before, because the word stock is defined with 119 and 119 correspondent asking intention, analyze the help instruction of the user into the dialing 119 intention.
S30, sending help seeking information to a mechanism corresponding to the help seeking intention according to the help seeking intention.
The intelligent television sends the acquired help seeking intention of the user to a television WeChat applet on the mobile terminal which is bound before, and the television WeChat applet on the mobile terminal sends help seeking information to a corresponding rescue agency.
Specifically, the television WeChat applet can judge the help seeking intention of the user sent by the intelligent television.
Scenario 1: as shown in fig. 2, if the help-seeking intention is "110 intention", it is determined whether the smart television has a camera (the camera can provide image information of the help-seeking site to a rescue center to help rescue workers to know the specific situation of the site), if the smart television does not have a camera, the smart television directly sends the help-seeking information to the television WeChat applet, controls the television WeChat applet to automatically dial 110 for alarming, and controls the television WeChat applet to send the help-seeking address, the name of the contact and the telephone to a public security organization.
If the intelligent television has a camera, the camera is opened, the intelligent television sends help seeking information and field image information acquired by the camera to the television WeChat applet, the television WeChat applet is controlled to automatically dial 110 to alarm, the television WeChat applet is controlled to send the field image information to a public security mechanism, and the television WeChat applet is controlled to send the help seeking address, the name of a contact person and a telephone to the public security mechanism.
Scenario 2: as shown in fig. 2, if the help seeking intention is "120 intention", judging whether the smart television has a camera, if the smart television does not have a camera, the smart television directly sends help seeking information to the television WeChat applet, controls the television WeChat applet to automatically dial 120 first aid, and controls the television WeChat applet to send the help seeking address, the name of a contact person and a telephone to a hospital.
If the intelligent television has a camera, the camera is opened, the intelligent television sends help seeking information and field image information acquired by the camera to the television WeChat applet, the television WeChat applet is controlled to automatically dial 120 first aid, the television WeChat applet is controlled to send the field image information to a hospital, and the television WeChat applet is controlled to send help seeking address, contact name and telephone to the hospital.
Scenario 3: as shown in fig. 2, if the help request is "119 intention", the help request information is sent to the television WeChat applet, the television WeChat applet is controlled to automatically dial 119 fire fighting, the television WeChat applet is controlled to send the help request address, the name of the contact person and the telephone number to the fire station, and meanwhile the intelligent television is controlled to cut off the total power supply through the IOT system, so as to prevent larger dangerous situations.
If the analyzed intention is not one of the 110 intention, the 120 intention and the 119 intention, the television WeChat applet finishes running and does not dial the help number to ask for help.
Further, as shown in fig. 4, the invention further provides a voice help seeking system based on the smart television based on the voice help seeking method based on the smart television, wherein the voice help seeking system based on the smart television comprises:
the distress instruction receiving module 51 is used for receiving the sound record of the MIC or the sound record of the MIC on the remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller;
the help-seeking instruction processing module 52 performs semantic processing on the help-seeking instruction sent by the user through NLP, and analyzes the help-seeking intention of the user;
the help-seeking information sending module 53 sends help-seeking information to a mechanism corresponding to the help-seeking intention according to the help-seeking intention.
Further, as shown in fig. 5, the invention further provides a smart television based on the voice help-seeking method and system based on the smart television, and the smart television comprises a processor 10, a memory 20 and a display 30. Fig. 5 shows only some of the components of the intelligent television, but it should be understood that not all of the illustrated components are required to be implemented, and more or fewer components may alternatively be implemented.
The memory 20 may be an internal storage unit of the smart tv, such as a hard disk or a memory of the smart tv, in some embodiments. The memory 20 may also be an external storage device of the Smart tv in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like. Further, the memory 20 may also include both an internal storage unit and an external storage device of the smart tv. The memory 20 is used for storing application software and various data installed on the smart tv, for example, program codes for installing the smart tv. The memory 20 may also be used to temporarily store data that has been output or is to be output. In an embodiment, the memory 20 stores a voice help-seeking program 40 based on the smart television, and the voice help-seeking program 40 based on the smart television can be executed by the processor 10, so as to implement the voice help-seeking method based on the smart television in the present application.
The processor 10 may in some embodiments be a central processing unit (Central Processing Unit, CPU), microprocessor or other data processing chip for running program code or processing data stored in the memory 20, for example for performing the smart tv-based voice help method, etc.
The display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like in some embodiments. The display 30 is used for displaying information on the smart television and for displaying a visual user interface. The components 10-30 of the smart television communicate with each other via a system bus.
In one embodiment, the following steps are implemented when the processor 10 executes the smart tv-based voice help program 40 in the memory 20:
receiving the sound record of the MIC or the sound record of the MIC on a remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller;
carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user;
and sending distress information to a mechanism corresponding to the distress intention according to the distress intention.
Optionally, the voice help seeking method based on the smart television, wherein the step of controlling the smart television to acquire a help seeking instruction sent by a user through MIC recording or remote controller MIC recording, further comprises the following steps:
receiving a binding request of a user for binding the smart television through a television WeChat applet in a mobile terminal, and completing binding with the mobile terminal after receiving the binding request;
the television WeChat applet is preset with a help address, a contact name and a telephone;
and the intelligent television and a home main power switch are under an IOT system.
Optionally, in the voice help seeking method based on the smart television, the help seeking instruction sent by the user is semantically processed through NLP, and the help seeking intention of the user is resolved, which specifically includes:
a word stock is predefined according to a barking word segmentation technology, and a word stock is predefined, wherein the word stock stores distress intents corresponding to different word technologies;
after receiving a help-seeking instruction sent by a user, cutting the help-seeking instruction through the speaking dictionary according to the barking word segmentation technology, and matching the user speaking obtained by cutting with the word stock to obtain the help-seeking intention of the user; wherein, the help seeking intent includes: 110 intent, 120 intent, and 119 intent.
Optionally, the voice help seeking method based on the smart television, wherein the sending, according to the help seeking intention, help seeking information to a mechanism corresponding to the help seeking intention specifically includes:
when the help seeking intention is 110 intention, judging whether the intelligent television has a camera, if the intelligent television does not have the camera, sending help seeking information to the television WeChat applet, and controlling the television WeChat applet to automatically dial 110 for alarming.
If the intelligent television has a camera, the camera is opened, distress information and field image information acquired by the camera are sent to the television WeChat applet, the television WeChat applet is controlled to automatically dial 110 for alarming, and the television WeChat applet is controlled to send the field image information to a public security bureau.
Optionally, the voice help seeking method based on the smart television, wherein the sending, according to the help seeking intention, help seeking information to a mechanism corresponding to the help seeking intention specifically includes:
when the help seeking intention is 120 intention, judging whether the intelligent television has a camera, if the intelligent television does not have the camera, sending help seeking information to the television WeChat applet, controlling the television WeChat applet to automatically dial 120 first aid, and simultaneously playing help seeking audio in a loud sound;
if the television has a camera, the camera is opened, help seeking information and on-site image information acquired by the camera are sent to the television micro-letter applet, the television micro-letter applet is controlled to automatically dial 120 first aid, the television micro-letter applet is controlled to send the on-site image information to a hospital, and meanwhile help seeking audio is played in a loud sound.
Optionally, in the voice help seeking method based on the smart television, when the help seeking intention is 119 intention, the voice help seeking method specifically includes:
and sending help seeking information to the television WeChat applet, controlling the television WeChat applet to automatically dial 119 to fight the fire, and simultaneously cutting off the total power supply through the IOT system.
Optionally, the voice help seeking method based on the smart television, wherein the sending, according to the help seeking intention, help seeking information to a mechanism corresponding to the help seeking intention, further includes:
and controlling the television WeChat applet to send the help-seeking address, the name of the contact person and the telephone to a corresponding mechanism.
The present invention also provides a computer-readable storage medium storing a parameter adjustment program based on brain wave signals, which when executed by a processor, implements the steps of the parameter adjustment method based on brain wave signals as described above.
In summary, the invention provides a voice help seeking method and related equipment based on an intelligent television, wherein the method comprises the following steps: receiving the sound record of the MIC or the sound record of the MIC on a remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller; carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user; and sending distress information to a mechanism corresponding to the distress intention according to the distress intention. According to the invention, based on the intelligent television, the help seeking intention of the user is analyzed through NLP semantic processing, and according to different intentions of the user, the intelligent television, the camera, the WeChat applet and the IOT system are linked, so that the help seeking is triggered in a far-field voice wake-free mode, and when the user, particularly the current solitary person has an emergency and cannot touch help seeking equipment, the intelligent television can acquire the help seeking intention of the user and timely send help seeking information to a corresponding rescue center.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal comprising the element.
Of course, those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by a computer program for instructing relevant hardware (e.g., processor, controller, etc.), the program may be stored on a computer readable storage medium, and the program may include the above described methods when executed. The computer readable storage medium may be a memory, a magnetic disk, an optical disk, etc.
It is to be understood that the invention is not limited in its application to the examples described above, but is capable of modification and variation in light of the above teachings by those skilled in the art, and that all such modifications and variations are intended to be included within the scope of the appended claims.
Claims (10)
1. The voice help seeking method based on the intelligent television is characterized by comprising the following steps of:
receiving the sound record of the MIC or the sound record of the MIC on a remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller;
carrying out semantic processing on the distress instruction sent by the user through NLP, and analyzing to obtain the distress intention of the user;
and sending distress information to a mechanism corresponding to the distress intention according to the distress intention.
2. The voice help-seeking method based on the smart television according to claim 1, wherein the step of controlling the smart television to acquire a help-seeking instruction sent by a user through MIC recording or remote controller MIC recording, further comprises the steps of:
receiving a binding request of a user for binding the smart television through a television WeChat applet in a mobile terminal, and completing binding with the mobile terminal after receiving the binding request;
the television WeChat applet is preset with a help address, a contact name and a telephone;
and the intelligent television and a home main power switch are under an IOT system.
3. The voice help-seeking method based on the smart television according to claim 2, wherein the help-seeking instruction sent by the user is semantically processed through the NLP, and the help-seeking intention of the user is resolved, specifically comprising:
a word stock is predefined according to a barking word segmentation technology, and a word stock is predefined, wherein the word stock stores distress intents corresponding to different word technologies;
after receiving a help-seeking instruction sent by a user, cutting the help-seeking instruction through the speaking dictionary according to the barking word segmentation technology, and matching the user speaking obtained by cutting with the word stock to obtain the help-seeking intention of the user; wherein, the help seeking intent includes: 110 intent, 120 intent, and 119 intent.
4. The voice help-seeking method based on the smart television according to claim 3, wherein the sending help-seeking information to the mechanism corresponding to the help-seeking intention according to the help-seeking intention specifically comprises:
when the help seeking intention is 110 intention, judging whether the intelligent television has a camera, if the intelligent television does not have the camera, sending help seeking information to the television WeChat applet, and controlling the television WeChat applet to automatically dial 110 for alarming.
If the intelligent television has a camera, the camera is opened, distress information and field image information acquired by the camera are sent to the television WeChat applet, the television WeChat applet is controlled to automatically dial 110 for alarming, and the television WeChat applet is controlled to send the field image information to a public security bureau.
5. The voice help-seeking method based on the smart television according to claim 3, wherein the sending help-seeking information to the mechanism corresponding to the help-seeking intention according to the help-seeking intention specifically comprises:
when the help seeking intention is 120 intention, judging whether the intelligent television has a camera, if the intelligent television does not have the camera, sending help seeking information to the television WeChat applet, controlling the television WeChat applet to automatically dial 120 first aid, and simultaneously playing help seeking audio in a loud sound;
if the television has a camera, the camera is opened, help seeking information and on-site image information acquired by the camera are sent to the television micro-letter applet, the television micro-letter applet is controlled to automatically dial 120 first aid, the television micro-letter applet is controlled to send the on-site image information to a hospital, and meanwhile help seeking audio is played in a loud sound.
6. The voice help-seeking method based on the smart television according to claim 3, wherein when the help-seeking intention is 119 intention, the voice help-seeking method specifically comprises:
and sending help seeking information to the television WeChat applet, controlling the television WeChat applet to automatically dial 119 to fight the fire, and simultaneously cutting off the total power supply through the IOT system.
7. The voice help-seeking method based on the smart television according to any one of claims 4 to 6, wherein the sending help-seeking information to a mechanism corresponding to the help-seeking intention according to the help-seeking intention further comprises:
and controlling the television WeChat applet to send the help-seeking address, the name of the contact person and the telephone to a corresponding mechanism.
8. The voice help seeking system based on the intelligent television is characterized by comprising:
the distress instruction receiving module is used for receiving the sound record of the MIC or the sound record of the MIC on the remote controller, and acquiring a distress instruction sent by a user according to the sound record of the MIC or the sound record of the MIC on the remote controller;
the help-seeking instruction processing module is used for carrying out semantic processing on the help-seeking instruction sent by the user through NLP, and analyzing to obtain the help-seeking intention of the user;
the help seeking information sending module is used for sending help seeking information to a mechanism corresponding to the help seeking intention according to the help seeking intention.
9. The intelligent television is characterized in that the terminal comprises: the voice help-seeking program based on the intelligent television comprises a memory, a processor and a voice help-seeking program based on the intelligent television, wherein the voice help-seeking program based on the intelligent television is stored in the memory and can run on the processor, and the voice help-seeking program based on the intelligent television is executed by the processor to realize the steps of the voice help-seeking method based on the intelligent television according to any one of claims 1-7.
10. A computer readable storage medium, wherein the computer readable storage medium stores a voice help-seeking program based on a smart television, and the voice help-seeking program based on the smart television realizes the steps of the voice help-seeking method based on the smart television according to any one of claims 1 to 7 when being executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310238749.9A CN116248965A (en) | 2023-03-03 | 2023-03-03 | Voice help seeking method based on intelligent television and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310238749.9A CN116248965A (en) | 2023-03-03 | 2023-03-03 | Voice help seeking method based on intelligent television and related equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116248965A true CN116248965A (en) | 2023-06-09 |
Family
ID=86634906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310238749.9A Pending CN116248965A (en) | 2023-03-03 | 2023-03-03 | Voice help seeking method based on intelligent television and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116248965A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117409976A (en) * | 2023-12-15 | 2024-01-16 | 深圳市微克科技有限公司 | User health monitoring method, system and medium based on intelligent wearable equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120282884A1 (en) * | 2011-05-05 | 2012-11-08 | Nicholas Sun | System and method for the emergency voice and image e-mail transmitter device |
| CN204614152U (en) * | 2015-01-23 | 2015-09-02 | 成都大学 | Based on the intelligent family endowment system of technology of Internet of things |
| KR20190030450A (en) * | 2017-09-14 | 2019-03-22 | 주식회사 네모엘텍 | Iot camera with movable installation |
| CN112333507A (en) * | 2020-10-28 | 2021-02-05 | 深圳创维－Rgb电子有限公司 | SOS method, television and computer readable storage medium |
| CN112581961A (en) * | 2019-09-27 | 2021-03-30 | 百度在线网络技术（北京）有限公司 | Voice information processing method and device |
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN114283557A (en) * | 2021-12-27 | 2022-04-05 | 深圳市雷鸟网络传媒有限公司 | Intelligent television distress method and device, intelligent television and storage medium |
-
2023
- 2023-03-03 CN CN202310238749.9A patent/CN116248965A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120282884A1 (en) * | 2011-05-05 | 2012-11-08 | Nicholas Sun | System and method for the emergency voice and image e-mail transmitter device |
| CN204614152U (en) * | 2015-01-23 | 2015-09-02 | 成都大学 | Based on the intelligent family endowment system of technology of Internet of things |
| KR20190030450A (en) * | 2017-09-14 | 2019-03-22 | 주식회사 네모엘텍 | Iot camera with movable installation |
| CN112581961A (en) * | 2019-09-27 | 2021-03-30 | 百度在线网络技术（北京）有限公司 | Voice information processing method and device |
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN112333507A (en) * | 2020-10-28 | 2021-02-05 | 深圳创维－Rgb电子有限公司 | SOS method, television and computer readable storage medium |
| CN114283557A (en) * | 2021-12-27 | 2022-04-05 | 深圳市雷鸟网络传媒有限公司 | Intelligent television distress method and device, intelligent television and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117409976A (en) * | 2023-12-15 | 2024-01-16 | 深圳市微克科技有限公司 | User health monitoring method, system and medium based on intelligent wearable equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101848373B (en) | Wireless video monitoring system and video monitoring method thereof | |
| KR102489914B1 (en) | Electronic Device and method for controlling the electronic device | |
| EP2871624B1 (en) | Digital security network system and method | |
| US11024293B1 (en) | Systems and methods for personifying communications | |
| US10061273B2 (en) | Intelligent security hub for providing smart alerts | |
| US10714079B2 (en) | Methods and system for analyzing conversational statements and providing feedback in real-time | |
| CN108701127A (en) | Electronic equipment and its operating method | |
| CN109427331B (en) | Speech recognition method and device | |
| US20210263965A1 (en) | Device, system and method for providing indications of a discrepancy between a video and a textual description of an incident | |
| CN102768790A (en) | NFC (Near Field Communication) alarm system and method | |
| CN116343447A (en) | Dynamic alarm receiving and quick alarm outputting method, device, equipment and storage medium | |
| CN116248965A (en) | Voice help seeking method based on intelligent television and related equipment | |
| CN111445664A (en) | Distress alarm method and device based on keyword 'lifesaving o' and application | |
| CN106327813A (en) | Intelligent voice recognition and alarm method and system thereof | |
| CN104954429A (en) | Method of automatic help seeking system in danger | |
| KR20180099423A (en) | Operating method of electronic device for function execution based on speech command in Locked state and electronic device supporting the same | |
| CN106791010B (en) | Information processing method and device and mobile terminal | |
| CN106327792A (en) | Alarm method and alarm system | |
| KR102573461B1 (en) | Smart artificial intelligence multi-fungtion emergency bell system and its control method | |
| CN112863495A (en) | Information processing method and device and electronic equipment | |
| CN113345210B (en) | Method and device for intelligently judging distress call based on audio and video | |
| KR101715600B1 (en) | Terminal, method and computer-readable recording medium for informing emergency situation | |
| CN113628429A (en) | Emergency help-seeking method and system based on 5G communication | |
| CN113314125A (en) | Voiceprint identification method, system and memory for monitoring room interphone | |
| CN113489939A (en) | Intelligent monitoring method and system for power transmission line construction site |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |