KR102244054B1 - Input-output device supporting AI-based services - Google Patents

Abstract

According to one embodiment of the present invention, provided is an input/output electronic device for supporting an artificial intelligence-based service, which includes: an input/output unit which receives output information of a target product and user's voice information, and outputs feedback information corresponding to the output information and voice information as artificial intelligence service information; a communication unit which performs short-distance communication with the target product, a user terminal, and an intermediate terminal, and communicates with an external server through the intermediate terminal; a service setting unit which sets a type of artificial intelligence service to be applied to the target product from the user terminal; and an MCU which provides a subscriber identification number of the input/output electronic device to the AI cloud server, checks the service authentication information from the AI cloud server, and controls the operation of components executing the artificial intelligence service set in the service setting unit.

Description

Input-output device supporting AI-based services}

The present invention relates to an input/output electronic device supporting an artificial intelligence-based service.

Research to technically implement the human brain mechanism that makes decisions by understanding and analyzing a given situation or an ongoing situation is being carried out steadily. In particular, as interest in artificial intelligence technology increases, artificial intelligence (AI) technology is rapidly developing through deep learning based on artificial neural networks.

In addition, in software engineering, there is an increasing demand for self-adaptation technology to understand the situation of users and devices and provide customized user services for a better user experience, and are applied to various fields.

However, there are few studies related to deep learning-based learning technology or self-adaptive learning that combines artificial neural networks and self-adaptation techniques of software engineering.

In particular, the existing artificial neural network technology or self-adaptation technology has limitations in processing unstructured data because it cannot effectively implement the human brain mechanism, and it is difficult and efficient to apply to various situations as it is developed specialized in individual fields. There is a limit that cannot be done.

Registered Patent No. 10-1400636

An object to be solved by the present invention is to provide an input/output electronic device supporting an artificial intelligence-based service capable of solving a conventional problem.

An input/output electronic device supporting an artificial intelligence-based service according to an embodiment of the present invention for solving the above problem receives output information of a target product and voice information of a user, and a feedback corresponding to the output information and the voice information An input/output unit for outputting information as artificial intelligence service information; A communication unit for performing short-range communication with the target product, a user terminal, and an intermediary terminal, and communicating with an external server through the intermediary terminal; A service setting unit for setting a type of artificial intelligence service to be applied to the target product from the user terminal; And an MCU that provides a subscriber identification number of the input/output electronic device to the AI cloud server, checks service authentication information from the AI cloud server, and controls the operation of the components executing the artificial intelligence service set in the service setting unit. , The AI cloud server provides voice service information that can be combined according to the condition prediction of the target product, the user's use pattern of the target product, and the type of the target product based on the output information of the target product, and the user's query information Feedback information, which is a response service for, is provided to the input/output unit.

Therefore, by using the input/output device that supports artificial intelligence-based services according to an embodiment of the present invention, existing digital products can be converted into AI products, thereby providing the advantage that products of small and medium-sized enterprises lacking in technology can be easily artificially intelligentized. do.

Through the above-described advantages, it is possible to create product/service competitiveness suitable for a new era, and also provides an advantage of improving business capabilities and constitution from a manufacturing/distribution-oriented business to a data-based business.

Furthermore, it provides the advantage of re-creating the business group through future commercialization of existing products due to the lack of AI technology capabilities.

1 is a network configuration diagram of an input/output device supporting an artificial intelligence-based service according to an embodiment of the present invention.
2 is a block diagram showing a detailed configuration of the input/output device shown in FIG. 1.
3 and 4 are diagrams illustrating an example in which the input/output device shown in FIG. 2 is combined with an existing target product.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" with another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

The terms "about", "substantially", and the like, as used throughout the specification, are used in or close to the numerical value when manufacturing and material tolerances specific to the stated meaning are presented, and are used to provide an understanding of the present invention. To assist, accurate or absolute numerical values are used to prevent unreasonable use of the stated disclosure by unscrupulous infringers. As used throughout the specification of the present invention, the term "step (to)" or "step of" does not mean "step for".

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized by using two or more hardware, or two or more units may be realized by one piece of hardware.

In the present specification, some of the operations or functions described as being performed by a terminal, device, or device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal, device, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the unique number of the terminal or the identification information of the individual, which is the identification information of the terminal. Can be interpreted as.

Hereinafter, an input/output device supporting an artificial intelligence-based service according to an embodiment of the present invention will be described in more detail based on the accompanying drawings.

1 is a network configuration diagram of an input/output device supporting an artificial intelligence-based service according to an embodiment of the present invention, and FIG. 2 is a block diagram showing a detailed configuration of the input/output device shown in FIG. 4 is a diagram showing an example in which the input/output device shown in FIG. 2 is combined with an existing target product.

1 to 4, an input/output device 100 supporting an artificial intelligence-based service according to an embodiment of the present invention is applied to a target product (electronic product, power product, non-powered product, non-powered product, etc.). It may be a device that supports adding an artificial intelligence service provided by an external AI cloud server.

For example, it is attached to a stuffed toy to support speech function, or attached to an electric curtain to support remote control function through a terminal by the user, or attached to a digital skin tester to provide the user's skin tester count, usage pattern, and motion information. It may be a device for providing a service such as supporting a monitoring service for the back. Furthermore, it can be used for building a home network system for integrated control of a plurality of electronic devices in a home.

More specifically, the input/output device 100 supporting an artificial intelligence-based service according to an embodiment of the present invention includes an input/output unit 110, a communication unit 120, an authentication unit 130, and an output unit 140. , MCU 150 and a power supply unit 160.

The input/output unit 110 may be configured to receive output information including collection information, operation information, status information, etc. of a target product. In addition, the input/output unit 110 may be configured to receive and receive setting information of a target product (information of an application product and information on an AI service to be provided) set by a user terminal on which the AI platform is installed.

The input/output unit 110 includes a camera or video input unit for inputting an image signal, a microphone or an audio input unit for inputting an audio signal, and a user input unit for receiving information from a user (for example, a touch key ( touch key), push key (mechanical key, etc.). The voice data or image data collected by the input/output unit 110 may be analyzed and processed as a user's control command.

Here, the target product includes home appliances, such as electronic devices, dolls, sensor modules, etc., which are limited in communication with the outside, and non-powered products.

In addition, the input/output unit 110 may be a component that outputs an AI service provided by an AI cloud server to be described later. Here, the AI service may include voice, video, and control commands for remotely controlling the target product, as well as analysis information on the usage pattern of the target product used by the user, and response information to the user's query language.

For reference, the input/output unit 110 may include a means for inputting recognition information after recognizing a user's voice and gesture, and for example, a microphone is provided to receive a user's voice signal. The microphone (Mic) can directly or indirectly receive a voice signal.

The input/output unit 110 converts an analog signal corresponding to a received user's voice command into a digital signal, transfers the converted digital signal to the MCU 170 to be described later, and performs a voice recognition operation through a voice recognition program. It functions to perform so that it is processed.

In addition, the input/output unit 110 may include a motion sensor for recognizing a user's motion, that is, a gesture. The motion detection signal sensed by the motion sensor is transmitted to the MCU 170 to be described later, and performs a motion recognition operation to be processed through a motion recognition program.

Meanwhile, the input/output unit 110 is configured to provide various information to a user. For example, the input/output unit 110 may include any one of a speaker outputting audio and a display outputting an image.

In this embodiment, the input/output unit 110 is described as being either a speaker or a display, but this is only an example for explanation. It may be configured to provide information to a user by being connected through an input/output unit.

In addition, the input/output unit 110 includes a connector, and may connect an external audio output device such as an earphone, a headset, an external speaker, or an external image output device such as a TV monitor to the electronic device.

Next, the communication unit 120 may be implemented in various ways according to the type of the input/output device 100. For example, the communication unit 120 includes a connection unit for wired communication, and the connection unit transmits signals/data according to standards such as HDMI (High Definition Multimedia Interface), HDMI-CEC (Consumer Electronics Control), USB, and component. It can transmit/receive, and includes at least one connector or terminal corresponding to each of these standards.

In addition, the communication unit 120 may include an RF circuit that transmits/receives a radio frequency (RF) signal to perform wireless communication with an external device, and includes Wi-Fi, Bluetooth, and Zigbee. ), UWB (Ultra-Wide Band), wireless USB (Wireless USB), NFC (Near Field Communication), it may be configured to perform using one or more communication methods of infrared. The communication unit 120 may receive a voice signal from the input/output device 100 and a mobile device that communicates using at least one of the communication methods. In this case, the mobile device may be provided with a smartphone, for example, by installing a remote control app and executing a remote control app to receive a voice signal through voice input for controlling the operation of the input/output device 100. It can be transmitted to the input/output device 100.

Next, the authentication unit 130 may be configured to provide subscriber identification information of the input/output device 100 to an AI cloud server to be described later, and to receive authentication confirmation information from the AI cloud server.

Next, the information collection unit 140 may be a component that collects surrounding situation information of the target product. The information collection unit 140 may include a plurality of sensors and memories, and the plurality of sensors may be sensors capable of detecting smoke, flame, water, temperature, dust, and the like. In addition, the information collection unit 140 may further include a micro camera module to collect surrounding image information.

For example, the information collection unit 140 includes a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor. ), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint recognition sensor, ultrasonic sensor, optical sensor sensor), microphone, battery gauge, environmental sensor (e.g., barometer, hygrometer, thermometer, radiation sensor, heat sensor, gas sensor, etc.), chemical sensor (e.g., electronic It may include at least one of a nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

Next, the service setting unit 150 is a configuration for setting the type of target product to be applied and the type of service to be applied, and may be a configuration for setting the artificial intelligence service with setting information input from the artificial intelligence service platform of the user terminal. .

The setting information set by the service setting unit 150 is provided to an AI cloud server to be described later, and the AI cloud server provides an AI service corresponding to the setting information.

Next, the power supply unit 160 is a configuration for supplying power in each of the above-described configurations, and may be a configuration for supplying power corresponding to the power level of each configuration provided by the MCU 170 to be described later.

In addition, the power supply unit 160 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the body of the input/output device for charging or the like.

In addition, the power supply unit 160 may include a connection port, and the connection port may be configured as an example of an interface to which an external charger supplying power for charging a battery is electrically connected.

As another example, the power supply unit 160 may be configured to charge the battery in a wireless manner without using a connection port. In this case, power may be transmitted from an external wireless power transmitter using at least one of an inductive coupling method based on a magnetic induction phenomenon or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon. .

Next, the MCU 170 may be a component that controls the operation of each component, and can be a component that provides a power level required by each component to a power supply unit.

Further, the MCU 170 may be a component that controls the operation of the input/output unit outputting the artificial intelligence service set by the service setting unit 150.

In addition, the MCU 170 may change the setting of the network IP address of the communication unit based on the setting information provided from the user terminal.

In addition, the MCU 170 may provide monitoring information for monitoring the operation state of each unit to a user terminal and/or an AI cloud server, and the AI cloud server receives monitoring information of the input/output device, The prediction information that predicts is provided, and when the prediction information exceeds a preset value, a replacement signal is provided to the user terminal.

Meanwhile, the input/output device 100 according to an embodiment of the present invention may further include an interface unit and a memory.

The interface unit serves as a passage for all external devices connected to the input/output device 100. The interface unit 180 receives data from an external device, receives power and transmits it to each component inside the input/output device 100, or transmits data inside the input/output device 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module. (port), an audio input/output (I/O) port, a video input/output (I/O) port, an earphone port, and the like may be included.

The memory may store a program for the operation of the MCU 170 and may temporarily store input/output data.

The memory is a flash memory type, a hard disk type, a solid state disk type, an SDD type, a multimedia card micro type. ), card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

Next, the AI cloud server mentioned in the present invention is a server that processes information based on artificial intelligence technology, and performs at least one of information learning, information inference, information perception, and natural language processing. It consists of one or more modules.

AI cloud server uses machine learning technology to learn a vast amount of information (big data) such as information stored in artificial intelligence devices, environmental information around artificial intelligence devices, and information stored in external storage that can communicate. , Reasoning, and processing can be performed. In addition, by using the information learned using the machine learning technology, the operation of at least one executable artificial intelligence device is predicted (or inferred), and the most feasible operation among the at least one predicted operation is executed. AI devices can be controlled as much as possible.

Machine learning technology is a technology that collects and learns large-scale information based on at least one algorithm, and determines and predicts information based on the learned information. The learning of information is an operation of grasping the characteristics of information, rules, criteria, etc., quantifying the relationship between information and information, and predicting new data using the quantified pattern. Algorithms used by these machine learning techniques can be algorithms based on statistics, for example, a decision tree that uses a tree structure as a predictive model, and mimics the structure and function of a neural network of organisms. Is an artificial neural network, genetic programming based on the evolutionary algorithm of living things, clustering that distributes observed examples into subsets called clusters, and calculates function values as probability through randomly extracted random numbers. It may be a Monte Carlo method, or the like.

As a field of machine learning technology, deep learning technology is a technology that performs at least one of learning, judgment, and processing of information using an artificial neural network algorithm. The artificial neural network may have a structure that connects layers and layers and transfers data between layers. Such deep learning technology can learn a vast amount of information through an artificial neural network using a graphic processing unit (GPU) optimized for parallel computation.

In addition, in order to collect a vast amount of information for applying machine learning technology, signals, data, and information input or output from components of an artificial intelligence device are collected (detection, monitoring, extraction, detection, and reception). )can do. In addition, it is possible to collect (detect, monitor, extract, detect, receive) data and information stored in external storage (eg, cloud server, cloud server) connected through communication. More specifically, information collection may be understood as a term including an operation of sensing information through a sensor, extracting information stored in a memory, or receiving information from an external storage through communication.

In addition, the AI cloud server can monitor information in the artificial intelligence device, surrounding environment information surrounding the artificial intelligence device, and user information. In addition, it is possible to receive broadcast signals and/or broadcast-related information, wireless signals, wireless data, and the like. In addition, image information (or signal), audio information (or signal), data, or information input from a user may be provided from the input/output device 100.

In addition, it is possible to collect a vast amount of information in real time in the background, learn it, and store information processed in an appropriate form (eg, knowledge graph, command policy, personalization database, conversation engine, etc.) in the database.

And, based on the information learned using machine learning technology, when the motion of the artificial intelligence device is predicted, in order to execute the predicted operation, control the components of the artificial intelligence device, or to execute the predicted operation. A control command may be transmitted to the input/output device 100.

Accordingly, the input/output device 100 may be controlled like an artificial intelligence device and may execute a predicted operation based on a control command provided from the AI cloud server.

Meanwhile, when a specific operation is performed, the AI cloud server may analyze history information indicating the execution of the specific operation through machine learning technology, and update existing learned information based on this analysis information. Accordingly, it is possible to improve the accuracy of information prediction.

Therefore, by using the input/output device that supports artificial intelligence-based services according to an embodiment of the present invention, it is possible to convert not only existing digital products but also non-powered products into AI products, so that products of small and medium-sized enterprises lacking technology can be easily artificially intelligentized. It offers the advantage of being able to.

Through the above-described advantages, it is possible to create product/service competitiveness suitable for a new era, and also provides an advantage of improving business capabilities and constitution from a manufacturing/distribution-oriented business to a data-based business.

Furthermore, it provides the advantage of re-creating the business group through future commercialization of existing products due to the lack of AI technology capabilities.

Meanwhile, the “~ unit” referred to in the present invention is a computer-readable medium implemented in the form of a program command that can be executed through various computer means, and the computer-readable medium includes a program command, a data file, a data structure, etc. It may be included as or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes magneto-optical media, and hardware devices specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In the above, the present invention has been described in detail with reference to examples, but those of ordinary skill in the art to which the present invention pertains will be able to make various substitutions, additions, and modifications within the scope not departing from the technical idea described above. It is natural, and it should be understood that such modified embodiments also belong to the scope of protection of the present invention defined by the appended claims.

100: I/O device supporting artificial intelligence-based service
110: input/output unit
120: communication department
130: information collection unit
140: service setting unit
150: MCU
160: power supply

Claims (5)

An input/output unit that receives output information of a target product and voice information of a user, and outputs the output information and feedback information corresponding to the voice information as artificial intelligence service information;
A communication unit that performs short-range communication with the target product, user terminal, and intermediary terminal, and communicates with an external server through the intermediary terminal;
A service setting unit for setting a type of artificial intelligence service to be applied to the target product from the user terminal; And
Including an MCU that provides the subscriber identification number of the input/output electronic device to the AI cloud server, checks service authentication information from the AI cloud server, and controls the operation of the components executing the artificial intelligence service set in the service setting unit,
The AI cloud server
Provides voice service information that can be combined according to a condition prediction of the target product, a user's use pattern of the target product, and a type of the target product based on the output information of the target product,
An input/output electronic device supporting an artificial intelligence-based service, characterized in that providing feedback information, which is a response service to the user's query information, to the input/output unit.
The method of claim 1,
Further comprising an information collection unit for collecting operation information and status information of the target product, or surrounding situation information of the target product,
The input/output electronic device supporting an artificial intelligence-based service including a plurality of sensors for sensing at least one of temperature, humidity, carbon dioxide, illuminance, moisture, gas, wind speed, and object in the information collection unit.
The method of claim 1,
The communication unit is an input/output electronic device supporting an artificial intelligence-based service that communicates with the user terminal and the intermediary terminal in any one of Bluetooth communication and WiFi communication.
The method of claim 1,
The input/output electronic device supporting an artificial intelligence-based service, characterized in that the target product is any one of an electronic device, a non-electronic device, a power device, and a non-power device.
delete

Images