KR20230013379A - artificial intelligence assistant system and method using objet - Google Patents

Abstract

An AI assistant system using an installation art work comprises: a system server including an AI assistant for outputting a control signal for motion production to each smart object according to programmed processes and providing an assistant service to a user; a local hub installed in a local area, and connected to the system server through a network to transmit a motion command to a corresponding smart object according to a control instruction from the system server; and the smart object having therein a motion production module operating according to the control signal transmitted from the local hub and a controller for controlling the motion production module, and for producing a motion according to the motion command received from the local hub. The producing of the motion by the smart object means that the one or more smart objects are controlled so that the smart objects interact each other to produce a motion. Therefore, the AI assistant system can provide the user with required information by using installation art works interacting with each other.

Description

AI assistant system and method using art installation {artificial intelligence assistant system and method using object}

The present invention relates to an AI assistant system and method using an art installation.

An object refers to a work of art that presents everyday items or natural objects as independent works of art and gives symbolic and fantastic meanings different from everyday ones. Demand is increasing as the number of products incorporating IoT is increasing, but there is no research on commercial art objects incorporating IoT technology.

The expansion of the home furnishing market has created a home-based economic unit, and as the offline space is transformed into a space for branding of companies and brands, the desire to improve user experience through space is increasing. In addition, as the number of single-person households increases and the untact era arrives, the number of people who feel emotional emptiness is increasing. If these objects are combined with IoT technology to rethink the relationship between objects and people, new effects will be created.

The Internet of Things (IoT) refers to a technology or environment in which sensors are attached to objects and data is exchanged over the Internet in real time. When the Internet of Things (IoT) era opens, devices connected to the Internet will be able to exchange information and communicate with each other on their own without human help. Bluetooth, near field communication (NFC), radio communication (RF), sensor data, and networks are technologies that help them communicate autonomously.

This IoT technology can be combined with a smartphone to show another performance.

Google, which first unveiled the AI assistant 'Google Assistant' in 2016, unveiled 'Google Lens', a camera vision technology built into smartphones, at 'Google I/O 2017'. If you take a picture with a lens, it is a technology that recognizes objects and helps translation and search.

The following year, in 2018, Google unveiled “Google Duplex” with the theme of “AI for everyone.” It is a technology that allows Google Assistant to make a reservation by directly calling a local beauty salon and talking to a person by telling them what they want to make a reservation for.

In addition, Google introduced 'LaMDA', an AI conversation model that understands and responds to language and context.

Since lambda does not learn a set answer, natural 'interactive search' is possible. For example, if you ask Pluto with Lambda applied, "What can you see if you visit me?", "If you come to me, you can see huge canyons, frozen icebergs, geysers, and craters." I wish I knew” and so on.

In addition, as a patented technology for this, Korean Patent Publication No. 10-2021-0026962 discloses a memory for storing instructions; and a processor executing the one or more instructions; Including, wherein the processor acquires the user's voice by executing the instructions, inputs the user's voice to a model to obtain voice analysis information for the user's voice, and based on the obtained voice analysis information, A technique related to a method of performing a response operation to the user's voice according to a predetermined criterion and learning for this has been disclosed.

Recently, research on personal assistant services that combine artificial intelligence (AI) and the Internet of Things (IoT) has been actively conducted.

The technology for personal assistant service includes the content that an AI assistant receives and executes a user's command in a house equipped with an IoT chip. For example, if the user requests "It's raining, set the mood", the AI assistant will lower the lights in the house, play music that suits the mood, and brew hot coffee.

Regarding this, Korean Patent Registration No. 10-1914604 introduces a technology for controlling the operation of each object using a cloud platform.

Republic of Korea Patent Publication No. 10-2021-0026962 (apparatus and method for providing voice assistant service) Republic of Korea Patent Registration No. 10-1914604 (IOT device control method and control system using cloud platform) Korean Patent Publication 2021-0006486 (Adaptive brain wave analysis method and device using reinforcement learning) Republic of Korea Patent Publication No. 2018-0009219 (Emotion expression system using brain waves and robot display method using the same)

An object of the present invention is to provide an AI assistant system and method using an installation art work that can provide necessary information to a user, have a conversation, and be provided with an effect production using the installation art work having interrelated actions.

According to one aspect of the present invention, an AI assistant system using an art installation includes a smart object operating processor outputting a control signal for the operation of each smart object and an AI assistant providing an assistant service to a user. System server including; a local hub installed in a local area, connected to the system server through a network, and transmitting an operation command to a corresponding smart object according to a control signal of the system server; and at least one smart object having a built-in motion directing module operating according to a control signal transmitted from the local hub and a controller controlling the motion directing module, and performing motion directing according to the motion command received from the local hub; It is characterized in that it includes.

In addition, the system server may further include means for communicating with or receiving information from the smart object or AI assistant or means for controlling the operation of the smart object when a user is connected through a mobile device.

In addition, the AI assistant may include: obtaining means for obtaining any one or more of the user's voice and text, speech interpretation information for brain waves, text interpretation information, and brain wave interpretation information; means for conducting a conversation with the user based on the information obtained through the acquiring process; and means for classifying and storing the information obtained through the execution process and then learning a response method according to the situation. It is characterized in that it includes.

In addition, the smart object is characterized in that it is directed by any one of a single directing method of individually directing motions, a sequential directing method of sequentially directing motions according to learned situations, and a dialogue directing method of directing motions in a dialogue format. .

In addition, the local hub sets a setting space for the smart object, and a detection sensor is mounted on one side to detect a body located in the setting space, and the system server determines the value of the detection signal transmitted from the detection sensor. It is characterized in that the production of the motion of the smart object located in the setting space is stopped or controlled in a standby mode according to the setting space.

In addition, the AI assistant maintains a set state through a monitoring means for monitoring the operation production between the smart objects in real time, a feedback means for feeding back the user's reaction, or a learning means for learning about the feedback means, or the smart object. It is characterized by including and controlling any one or more of changing the direction of motion between objects.

According to another aspect of the present invention, a method for performing a control operation by an AI assistant system using an art installation includes: a) preparing the AI assistant system; b) setting, by the system server, output processing for motion presentation scenarios of each smart object; c) receiving, by the system server, a detection signal through the local hub and determining a value of the detection signal; and d) performing, by the system server, an effect output process of directing an effect of the smart object according to the value of the detection signal or a standby mode in which the directing of an effect operation of the smart object is stopped and standby; It is characterized in that it includes.

Further, in the step c), the detection sensor of the local hub is characterized in that it separates and senses the proximity zone and the external zone based on the setting zone and the setting zone of the smart object.

In step d), the system server transmits a motion directing signal to the smart object when the value of the detection signal is lower than the set value.

In addition, the method includes the steps of a user accessing the system server using a mobile device; receiving, by the system server, at least one of a user's information request, a user's conversation request, and a request for effect control of the smart object through the mobile device; and outputting, by the system server, a response to the user's information request, a response to the user's conversation request, or an output for effect control of the smart object according to the receiving step. It is characterized in that it further comprises.

In addition, the method reminds us that the system server matches the smart objects selected by the user in the order of users accessed through the mobile device to provide the authority to control the production of effect motions, and does not match smart objects that do not match with the user. Guidance is provided through the mobile device, and when it is detected that the user has selected a smart object that does not match, the right to control the operation of the smart object is provided to the selected user, and the smart object that does not match with the user is controlled to remain in standby mode. It is characterized in that it further includes.

In addition, in the method, the system server provides information on a control method for directing an effect motion of a smart object of a first user to the mobile device of the standby user, and the system server determines that the first user has finished using the directing effect motion. If it is determined that the standby user's mobile device is connected to the smart object and the right to control the directing of the effect motion is provided, the user who has been provided with the right to control the directing of the effect motion can perform the effect of the first user's smart object through the mobile device. It is characterized in that a request for an effect motion directing control method identical to or different from the motion directing control method is transmitted to the system server.

According to an embodiment of the present invention, furniture combining art and tech that provides emotional leisure and information to users by filling the empty space in the mind of people by communicating with objects and objects and furthermore, objects and people Art can be provided.

1 is a block diagram for explaining the configuration of an AI assistant system using an art installation according to an embodiment of the present invention.
2 illustrates an example of a method of performing a control operation in a system server of an AI assistant system using an art installation according to an embodiment of the present invention.
3 illustrates an example of a smart object according to an embodiment of the present invention.
4 is a diagram for explaining a method of performing a step-by-step control operation in a local hub area according to an embodiment of the present invention.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, when a certain component is said to "include", it means that it may further include other components without excluding other components unless otherwise stated.

In addition, terms such as "...unit", "...unit", "module", and "device" described in the specification mean a unit that processes at least one function or operation, which is hardware or software, or a combination of hardware and software. can be implemented as

Also, terms such as first and second may be used in describing components of an embodiment of the present invention. These terms are only used to distinguish the component from other components, and the nature, order, or order of the corresponding component is not limited by the term. When an element is described as being 'connected', 'coupled' or 'connected' to another element, the element may be directly connected, coupled or connected to the other element, but not between the element and the other element. It should be understood that another component may be 'connected', 'coupled' or 'connected' between elements.

Hereinafter, an AI assistant system using an art installation according to an implementation of the present invention will be described in detail.

In the specification of the present invention, an installation art object (objet) means an installation art work that presents everyday items or natural objects as independent works of art and gives symbolic and fantastic meanings different from everyday meanings.

In addition, a smart object means that each motion direction is correlated with each other and motion direction is performed or motion direction is performed individually.

Motion presentation according to an embodiment of the present invention may be directed by any one or a combination of audio sound directing, lighting directing, vibration directing, motion directing, and the like.

Audio sound presentation according to an embodiment of the present invention may include any one or more of song, rhythm, performance, sound effect, and volume.

Lighting production according to an embodiment of the present invention may include any one or more of laser lighting production, color production, light irradiation angle or intensity, light brightness, light effect, light pattern, and the like.

The sound effect production according to an embodiment of the present invention is any one of natural sound effects such as wind, waves, and wind, sound effects expressing emotions, sound effects expressing places, sound effects expressing phenomena, and sound effects expressing objects. may contain one or more.

Motion presentation according to an embodiment of the present invention may include any one or more of rotation direction, rotation speed, vibration, and rotation type presentation.

An embodiment of the present invention is characterized in providing an atmosphere that adds fun and vitality to viewers or users through interaction art by producing effects with light, motion, and sound so that a plurality of smart objects are associated with each other.

In addition, the singular or plural smart objects can communicate with nearby spectators or users, respond to spectators or users, communicate with them, or provide information. It is characterized in that the motion direction can be controlled.

For example, a mirror smart object, bedside table smart object, and frame smart object installed on the wall are placed on the wall so that the movement lines match in three dimensions. In the smart object, an audio sound representing a rhythm such as the sound of wind and motion of a picture part can be produced, and in a mirror smart object, light related to music and audio sound can be produced.

The effect of such a smart object is a process of the system server 100 in which a program is set to perform an operation in which the effect of one smart object is followed by the response effect of another smart object so that the smart objects feel like having a conversation with each other. can be controlled by

For example, when the bedside table smart object produces music formed by the rhythm of tapping a tree and then stops, an audio sound representing a rhythm such as the sound of wind is then produced in a frame on the wall, and some parts of the picture rotate according to the rhythm of the music, A wall-mounted mirror can be programmed to project light onto a corresponding smart object in sync with the rhythm of the music.

1 is a block diagram for explaining the configuration of an AI assistant system using an art installation according to an embodiment of the present invention.

Referring to FIG. 1, an AI assistant system using an art installation according to an embodiment of the present invention includes a processor for operating a smart object that outputs a control signal for directing the motion of each smart object, and an AI that provides an assistant service to the user. A system server 100 including an assistant, a local hub 200 installed in a local area, connected to the system server through a network, and transmitting an operation command to a corresponding smart object according to a control signal of the system server 100, and A motion directing module that operates according to a control signal transmitted from the local hub 200 and a controller for controlling the motion directing module are built-in, and a smart motion direction is performed according to an operation command transmitted from the local hub 200. objects (J1, J2, J3..); includes

The AI assistant system is characterized in that the user connects to the system server 100 through the mobile device 50 and then communicates with or receives information from the smart object or AI assistant, or controls the operation of the smart object. .

In addition, the AI assistant system according to an embodiment of the present invention is characterized in that when at least one smart object is used, motion direction is performed individually or motion direction is performed in association with each other.

The mobile device 50 according to an embodiment of the present invention is characterized by including any one or more information input functions among an audio input function, a text input function, a QR code input function, an image input function, and an brain wave input function.

The brain wave input function according to an embodiment of the present invention is characterized in that a user's brain wave characteristics are input by connecting a headset having an EEG (Electroncephalogram) chip embedded therein to the mobile device 50 .

In addition, the system server 100 includes a smart object operation processor that outputs a control signal for the motion direction of the smart object, and the AI assistant responds to the user's voice, text, and brain waves input through the mobile device 50. means for obtaining input information of one or more of speech interpretation information, text interpretation information, and brain wave analysis information for the object; means for performing a response operation to the user's conversation and information request based on the obtained input information; It includes a means for performing an output for control of motion production and a means for classifying and storing the information obtained through the execution process, and then learning a response method according to the situation.

The AI assistant according to an embodiment of the present invention is characterized in that it analyzes the characteristics of the input brain wave, extracts an emotional state corresponding thereto, and provides an effect corresponding to the emotional state as a motion presentation.

For example, as a result of analyzing the characteristics of the brain waves, when the emotions and anxiety are expressed, the movement can be controlled so that music that can invigorate vitality, such as Antonio Vivaldi's 'Four Seasons', a classic baroque music, is played. .

In addition, as a result of analyzing the characteristics of brain waves, when emotions such as joy, pleasure, and joy are characterized, motions are directed so that music that can express emotions of joy, such as 'Somewhere Over the Rainbow', is played. can control.

According to an embodiment of the present invention, the user may be either a manager or a spectator of a local area.

2 illustrates an example of a method of performing a control operation in the system server 100 of the AI assistant system using an art installation according to an embodiment of the present invention.

Referring to FIG. 2, first, the system server 100 sets output processing for the motion directing module of each smart object (J1, J2, J3...) according to an operating scenario. Step 510 is performed.

According to an embodiment of the present invention, in the step of setting the output processing (step 510), each smart object is individually directed, or the first smart object (J1) and the second and third smart objects (J2, J3) ) may include being programmed in a sequential directing method in which motions are directed sequentially according to the learned situation or a dialog directing method in which motions are directed so as to interlock as if mutual conversation between smart objects is performed.

Alternatively, prior to the step of setting the processing (step 510), a preparation step of artistically arranging smart objects by matching them with a space may be further included.

Next, the system server 100 sends a control signal to each smart object (J1, J2, J3, ...) through the local hub 200 according to the set output processing to produce an effect, An output step (step 520) is performed.

3 illustrates an example of a smart object according to an embodiment of the present invention.

Referring to FIG. 3, a mirror smart object that generates light is installed on the upper part, a bedside table smart object is artistically and harmoniously installed on the lower part, natural sounds related to trees are produced on the bedside table smart object, and a mirror smart object on the upper part In response to the music rhythm of the bedside table smart object, the light intensity, color, and light effect of the mirror smart object may be changed and directed.

In FIG. 3, the left side shows an operating state for motion directing, and the right side shows a stopped state for motion directing.

According to an embodiment of the present invention, the effect of each smart object reflects the physical properties of the object (smart object), and the operation characteristics (operation means for directing the effect operation) having unique characteristics for each object are reflected in the system server 100. By assigning and storing each smart object in the processor, each smart object can be directed to give a feeling of conversation between objects while exhibiting unique physical characteristics by the control signal of the system server 100.

For example, the effect of a smart object is programmed to operate as a motion directing module such as a motion module (motor, etc.), a lighting module (LED, etc.), and a music module (MP3, etc.) corresponding to motion/light/sound. An operating process according to specific conditions is programmed and stored in the system server 100 so that directing is possible. After that, the method of directing the effect operation of the smart object may be changed by the user.

In addition, the system server 100 analyzes the input data accumulated by the user (conversation content and changes in the method of motion production by the user) to classify the matching motion, and then learns to improve the response and operation quality of the system. and the process of upgrading the process.

In addition, the system server 100 may further include a process of controlling the effect of the object by analyzing the effect of the user's directing control (customizing) of the effect operation of the smart object and collecting similar values and patterning them.

The specific condition can be selectively programmed with music, color, movement, or other motion direction that can indicate the specific condition according to a joyful atmosphere, a pious atmosphere, a sad atmosphere, a happy atmosphere, a fearful atmosphere, a warm atmosphere, a cool atmosphere, and the like. Motion direction according to the atmosphere by the can be learned and set.

In addition, the system manager may set the type of motion presentation to be expressed through the smart object and the smart object usage scenario in consideration of the appearance and characteristics of the smart object, and include them in the program.

An action directing module according to an embodiment of the present invention may include one or more of a motion module including a motor, a lighting module including LEDs and lasers, a music module including MP3, and a display module.

In addition, the control device of the smart object may be embedded in the form of a PCB including IC, MICOM, and the like.

According to an embodiment of the present invention, the motion directing module of the smart object can output motion and light together according to a programmed scenario, output only light, or simultaneously output motion-light-sound. Accordingly, a plurality of required effect operation directing modules may be combined and mounted on a smart object.

For example, a mirror smart object that shines light creates an interaction effect by combining light and audio by utilizing the physical property of reflecting and reflecting light, and a bedside table smart object made of wood uses natural sounds related to wood to create an interaction effect. After setting to produce the effect, mount the control device PCB including the necessary motion directing module inside each smart object.

According to an embodiment of the present invention, the control device PCB may be manufactured in a modular manner, and the control device PCB includes a smart object motion directing module suitable for a smart object operation scenario set according to the characteristics of the smart object and the smart object usage environment. An interface with set input and output values is included.

According to an embodiment of the present invention, in the system server 100, a presentation method of at least one smart object used in combination may be set as a program and stored. The directing method of the smart object includes a single directing method in which each smart object individually and randomly performs an effect motion directing operation, a sequential directing method in which a plurality of smart objects are sequentially directed according to learned situations, and a mutually interactive directing method between smart objects. A program for directing at least one of dialogue directing methods for motion directing to be interlocked may be included.

For example, in the tabletop smart object, a sound file related to a tree is received from the system server 100 and played according to a learned process, and the mirror smart object has various light color patterns and effect patterns (blinking/color changing/dimming effect). etc.) may be programmed to be reproduced according to a learned process by receiving a control signal for one or more) from the system server 100.

In addition, a program may be set so that the effect of a smart object according to an embodiment of the present invention exchanges a mutually related effect with an effect of another smart object connected to the local hub 200 .

For example, a program can change the motion speed, motion type, brightness, RGB value, dimming speed, etc. of another smart object by reflecting the sound range, rhythm, and loudness of the sound effect output from one smart object. It can be. In addition, on the contrary, it can be programmed to change the type of sound (range of sound, music reflecting rhythm) or motion speed of other smart objects according to the RGB value, brightness, and effect pattern of the light effect.

In addition, when the volume of the sound effect of the output first smart object increases, the output light of the second smart object related to it may be directed so that the output light becomes stronger. Alternatively, the motion direction may be performed so that the color of the output light of the second smart object changes from blue to red according to the strength or weakness of the wind noise of the first smart object.

In addition, according to an embodiment of the present invention, motions are sequentially directed for each of a plurality of smart objects connected to the local hub 200, a plurality of combined smart objects simultaneously directs motions, or a small number of smart objects among a plurality of smart objects A program may be programmed so that an object simultaneously directs a motion, and another smart object stops while directing a motion of the plurality of smart objects, and then directs another effect as soon as the directing is finished.

In addition, according to an embodiment of the present invention, when a user accesses the system server 100 using the mobile device 50, the user searches for a list of effect motions programmed in the smart object to operate the smart object. It is possible to direct (customize) by changing the directing to another type (Entertaining Process).

Alternatively, when the user connects to the system server 100 using the mobile device 50 and inputs requirements, the AI assistant included in the system server 100 performs the effect in an optimal state according to the user's requirements. You can control it to change.

In one embodiment of the present invention, the AI assistant included in the system server 100 further includes a means for monitoring the motion production between the smart objects in real time, feeding back the user's reaction, and learning about the feedback.

In addition, the AI assistant sends an optimal sound source file suitable for interaction between smart objects from the learned results and controls to perform motion production in correspondence between smart objects, or the smart objects according to the learned results and user requirements. Any one or more other than motion effects, sound effects, and light effects can be changed to an optimal state and can be controlled to be output to a smart object.

In one embodiment of the present invention, the user's feedback may be input through the mobile device 50 . Alternatively, the AI assistant may evaluate the duration and duration of the motion production effect by the user and the duration of the change.

The change of the smart object by the AI assistant to the optimal state includes the AI assistant controlling the smart object to produce motions in order of high scores among scores that meet the requirements from pre-learned data according to the user's requirements. can do.

In addition, the AI assistant system using an art installation according to an embodiment of the present invention is characterized in that the operation is controlled by distinguishing between when the user is present and when there is no user within the set area of the local hub 200.

Within the setting area, the user is given control authority for motion direction that can control the motion direction of the smart object through the mobile device 50, and outside the setting area, the user can control the motion direction of the smart object. Although there is no, the user can access the system server 100 using the mobile device 50 and receive the AI assistant service.

The setting area according to an embodiment of the present invention is characterized in that a range can be flexibly set and determined according to a space where a smart object is installed.

4 is a diagram for explaining a method of performing a step-by-step control operation in a local hub 200 area according to an embodiment of the present invention.

4A shows that when there is no person in the set area, a plurality of smart objects interact (interaction) to have a feeling of having a conversation with each other according to the learned process, and perform motion direction as installation art.

While executing the effect output step (step 520), the system server 100 determines whether a human detection signal is input from the local hub 200 within the set area of the local hub 200 (step 530) is performed

According to an embodiment of the present invention, the local hub 200 includes a Bluetooth signal detection device, a camera, an infrared sensor, an ultrasonic sensor, a microwave sensor, a GPS, a radar, and a lidar installed in the area of the local hub 200 ( Lidar), receive a detection signal value from one or more of the human body sensors when the user is in or not within the set area of the local hub 200, or by dividing the proximity area and the outside area based on the set area outside the set area and transmitting to the system server 100.

Alternatively, a detection signal when the user is approaching the setting area of the local hub 200 may be additionally sensed.

For example, by setting an area where the user can control the effect operation of the smart object as a setting area, and setting a viewing area at a certain distance from the setting area as a proximity area, the local hub 200 sets the area in the proximity area. As a result, when the detection signal is sensed, it can be recognized as when it is approaching close.

Alternatively, the system server 100 may receive the detection signal from the local hub 200 and detect the number of users in a set area of the local hub 200 and the number of people in a proximity area outside the set area.

In another embodiment of the present invention, the system server 100 detects the number of people detected in the set area and the proximity area outside the set area, and when it is determined that the detected number of people exceeds the appropriate number, the local hub 200 It can be programmed to output an announcement or effect requesting the dispersion of personnel through the audio of the smart object connected to .

Returning to FIG. 2 again, the effect output step (step 520) is continuously performed as shown in FIG. 4A until the human body detection signal is detected within the set area in the human body detection step (step 530).

FIG. 4B is a diagram for explaining when a user approaches from outside the set area of the local hub 200. Referring to FIG.

As shown in FIG. 4B , when a user accesses from outside the set area of the local hub 200 , the system server 100 can control the effect operation output step (step 520 ) to be continuously performed.

Alternatively, when the system server 100 detects a human body detection signal for the first time in a proximity area that is a certain distance away from the set area from the local hub 200 in the human body detection step (step 530), it determines that the user is approaching and operates. It is possible to perform a control operation including directing to notify the user of approach by changing the operation directing of an effect, such as gradually increasing or decreasing the state, changing sound and sound, or changing light directing.

Referring back to FIG. 2, the system server 100 stops the effect output and performs a standby mode (step 540) when a human body detection signal is detected within the set area in the human body detection step (step 530). do.

In step 540, when the human body detection signal is not sensed, it is determined that the user is out of the set area, and the effect output step (step 520) is continued.

FIG. 4C is a diagram for explaining a case where a person is detected within a set area of the local hub 200 in step 540. Referring to FIG.

According to an embodiment of the present invention, when the system server 100 receives a human body detection signal within the setting area from the local hub 200 in step 540, the system server 100 stops directing the motion of the smart object connected to the local hub 200. The control signal is transmitted to the smart object through the local hub 200. And when it detects that the user has gone out of the set area again (determined including the case where the value of the detection signal is lower than the set value), the smart object transmits a control signal to proceed with the motion directing operation again so that the user can move the smart object Controls so that you can observe the production of effect motions.

In this case, the user can control the interactive viewing of the smart object while going inside and outside the set area.

In an embodiment of the present invention, if even one user is detected within the range, the smart object may be programmed to stop directing the motion. After that, any one user is connected to the system server 100 through the smart lens, QR code, or mobile device 50 and inputs a request for motion production of the smart object by language (voice) or text (text). In this case, the production of an interaction operation between smart objects can be continued by the control signal of the system server 100 .

Referring back to FIG. 2, after step 540, in the standby mode, the user uses the mobile device 50 to connect to the system server 100 through a smart lens using a smart object and a QR code (step 552). is performed

In addition, step 552 further includes access by a plurality of users for each smart object.

Further, in another embodiment of the present invention, a process of displaying an effect indicating that the user is connected to the system server 100 through the mobile device 50 in step 552 may be further included in the smart object.

4D is a diagram for explaining how a user connects to the system server 100 through a smart lens and a QR code using a mobile device 50 within a setting area of the local hub 200.

In one embodiment of the present invention, by performing step 552 of connecting to the system server 100 through a smart lens, a QR code, etc. by a user taking a picture of a smart object using a mobile device 50, Receive an information request from an AI assistant system using installation art according to the following request step (step 561) to receive assistant service (Conversation Process), or request an effect control request to control the effect operation production (Entertaining Process) of a smart object. Step 571 may be performed.

4E shows an effect that the user and the system server 100 are connected to the smart object while receiving the AI assistant service by accessing the system server 100 with the mobile device 50 within the setting area of the local hub 200. It is a diagram for explaining the output process.

The AI assistant service provided by the AI assistant system using the art installation according to an embodiment of the present invention receives information and situation information about the space where the local hub 200 is located or smart objects, or directs the effect operation of smart objects. It includes things that can be changed and controlled or exchanged with other necessary information through dialogue.

For example, the user can exchange information in the form of a conversation with the AI assistant on the mobile device 50, check the process of directing the effect motion of the smart object, or temporarily change the directing of the effect motion of the smart object. there is. In this case, the system server 100 determines whether to include the changed effect motion directing process in a fixed motion directing scenario through feedback and learning on the effect motion directing process of the smart object changed by the user, and controls whether or not to save it. can

Referring to FIG. 2, when the system server 100 receives the information request (Conversation Process) request in step 561, the AI assistant included in the system server 100 provides the requested information (step 562). ) is performed.

In addition, the AI assistant of the system server 100 according to an embodiment of the present invention analyzes the input user's voice language, text language, and brain wave information in a state in which the user is connected and connected through the mobile device 50, It is possible to output a response appropriately matching the situation. In addition, the AI assistant extracts keywords by analyzing the input user's language, and if there is an effect for directing motion that matches the keyword, it selects one effect that matches with the highest frequency or randomly among various effects given to the keyword. A process of performing motion directing may be further included.

For example, when a user inputs the words "I'm bored, tell me about interesting facilities around me!" as text or asks a question using voice or brain waves, the AI assistant included in the system server 100 sends the text, voice, or brain wave contents. It is possible to perform a control operation to provide information suitable for a user's question in a form other than text, image, link, or voice by analyzing the In addition, by analyzing the user's language keywords, a control signal may be output so that the corresponding smart object produces motion directing effects matching language keywords such as 'simsim' and 'facility'.

In addition, if there is no matching response content after analyzing the user's language, the system server 100 may learn the AI assistant with response content matching the user's conversation through a separate input from the user.

In addition, the user may further include a process of learning the AI assistant by newly customizing the production of an effect operation for a specific language keyword.

In addition, the system server 100 is controlled to periodically analyze the accumulated input data and delete inappropriate contents (swear words, political remarks, obscene conversations). In addition, the system server 100 analyzes and classifies the accumulated input data and the motion directing effect matching operation of the smart object, or analyzes the customizing motion directing effect for the user language keyword, patterns it with a similar value, and Match smart object effects and accumulate and store classified matching data.

In addition, when the system server 100 receives a request for effect control (customizing request) for controlling the Entertaining Process of the smart object from the user in step 571, the AI assistant included in the system server 100 An effect output step 572 is performed to control the effect according to the requested request described above.

According to an embodiment of the present invention, when there are a plurality of users in the setting area of the local hub 200, the right to control the directing of the effect operation of the smart object in the order of first access to the system server 100 through the mobile device 50 Han (customizing authority) is granted. At this time, the service can be provided by matching the smart object with the user who can individually control it through the unique identification number of the smart object in the order of users connected to the system server 100 . In addition, if there is a smart object that does not match the user, the program can be programmed so that the user having the next control right is given the right to control the production of an effect operation for the corresponding smart object.

In addition, even when more users than the number of smart objects access the system server 100, information is provided through the AI assistant or conversation service (Conversation Process), except for the Entertaining Process of the smart object. ) can be provided.

Subsequently, when a user who has not been granted the right to control the entering process of the smart object makes a request for controlling the directing of the effect motion of the smart object, the system server 100 completes the customization of the requested smart object by the previous user. After waiting until it is completed, the control operation is performed so that the motion directing control authority is provided after the previous user's motion directing control is completed.

Thereafter, the user who has been provided with the right to control the directing of the effect motion transmits to the system server 100 a request for an effect motion directing control method that is identical to or different from the directing and controlling method of the effect motion of the smart object of the previous user, to the desired effect motion. Directing can be provided. In addition, while connected to the system server 100, the waiting user can share in real time the process of directing and controlling the effect of a specific language keyword by another person, and watch the motion presentation of the smart object together with the previous user. Here, the shared information is controlled so that the contents of conversations of others are not shared, but the method of customizing the operation of keywords and keyword effects is shared.

The process of customizing the directing of the effect motion of the language keyword may include a method of newly setting the keyword controlling the smart object and the directing of the effect motion of the keyword, or modifying an existing motion directing method.

According to an embodiment of the present invention, when providing a conversation service (Conversation Process) through an AI assistant, the AI assistant analyzes any one or more input information of text, voice, and brain wave information written by a user to derive a keyword, , If an effect matching the language keyword customized by the previous user does not exist in the system server 100, a control operation can be performed so that the basic effect operation directing process stored in the system server 100 is reflected in the corresponding smart object and operated. can

At this time, as the set basic effect, one of the effects stored in the database of the system server 100 may be randomly selected and output.

In addition, when there is a user-customized keyword effect, one of the effect operation directing methods stored in the system server 100 performs a control operation so that a plurality of smart objects are directed in a customized manner.

According to an embodiment of the present invention, when a user accesses the system server 100 with a mobile device 50 and directs an effect of a single language keyword to one smart object, the system server 100 later When there is only one user connected to the smart object, a control operation is performed so that the motion directing effect customized for the single keyword is equally expressed in each smart object.

For example, when a user customizes a smart object effect for the keyword 'love', a user can use multiple smart objects to express the keyword 'love', but only one smart object In some cases, language keywords are expressed. In this case, the user selects a smart object to be customized with a unique identification number assigned to the smart object on the mobile device 50, and then creates an effect operation that can be modified by the user in the system server 100. A control operation may be performed by a program that searches a control list and changes a method of directing an effect operation in one smart object.

Alternatively, one smart object controls the sound/light effect, another smart object controls the motion/light effect, and another smart object uses only the sound effect to control the motion direction of the effect for a single language keyword. can

In another embodiment, when another user is connected to the AI assistant of the system server 100 and has a conversation, and the system server 100 has one smart object connected to the user, a method for directing the motion of the language keyword effect Effects are directed based on customized effects for one smart object, and when there are multiple objects connected to the user, control operations can be performed so that the keyword 'love' is output based on customized effects with multiple smart objects.

According to one embodiment of the present invention, the user accesses the system server 100 with the mobile device 50 and the user has a simple conversation with the AI assistant included in the system server 100, or receives information ( Conversation Process) or while customizing the effect of language keywords on installed smart objects (installation art) (Entertaining Process), it is possible to perform sympathetic operation with smart objects.

An AI assistant system using installation art and a method using the same according to an embodiment of the present invention can provide people with an atmosphere that adds fun and vitality through interaction art.

In addition, the AI assistant system using installation art and a method using the same according to an embodiment of the present invention can effectively fill the blanks of space and emotion by producing various effects other than light/motion/sound.

In addition, an AI assistant system using installation art and a method using the same according to an embodiment of the present invention fills the space of the mind of a person living alone by interacting with objects and objects and furthermore, objects and people, and provides information It can be applied to furniture and artworks that combine art and tech.

50: Mobile
100: system server
200: local hub
J1, J2, J3: Smart Object

Claims (12)

In the AI assistant system using installation art,
A system server including a processor for operating a smart object that outputs a control signal for directing the motion of each smart object and an AI assistant that provides an assistant service to a user;
a local hub installed in a local area, connected to the system server through a network, and transmitting an operation command to a corresponding smart object according to a control signal of the system server; and at least one smart object having a built-in motion directing module operating according to a control signal transmitted from the local hub and a controller controlling the motion directing module, and performing motion directing according to an motion command transmitted from the local hub; A system comprising a. The method of claim 1,
The system server further comprises means for communicating with or receiving information from the smart object or AI assistant or means for controlling the operation of the smart object when a user is connected through a mobile device. The method of claim 1,
The AI assistant,
Acquisition means for obtaining any one or more of the user's voice and text, voice interpretation information for brain waves, text interpretation information, and brain wave interpretation information;
means for conducting a conversation with the user based on the information obtained through the acquiring process; and
means for classifying and storing the information obtained through the execution process and then learning a response method according to the situation; A system comprising a. The method of claim 1,
The system, characterized in that the smart object is directed by any one of a single directing method of individually directing motions, a sequential directing method of sequentially directing motions according to learned situations, and a dialog directing method of directing motions in a dialogue format. System. The method of claim 1,
The local hub sets a setting space for the smart object, and a detection sensor is mounted on one side to detect a body located in the setting space,
The system server is characterized in that the system server stops the production of the operation of the smart object located in the setting space or controls the standby mode according to the value of the detection signal transmitted from the detection sensor. The method of claim 1,
The AI assistant,
Maintaining a set state or changing the motion direction between the smart objects through a monitoring means for monitoring the motion direction between the smart objects in real time, a feedback means for feeding back the user's reaction, or a learning means for learning about the feedback means A system characterized in that for control including any one or more of them. In the method in which the AI assistant system using the installation art of any one of claims 1 to 6 performs a control operation,
a) preparing the AI assistant system;
b) setting, by the system server, output processing for motion presentation scenarios of each smart object;
c) receiving, by the system server, a detection signal through the local hub, and determining a value of the detection signal; and
d) performing, by the system server, an effect output process of directing an effect of the smart object according to the value of the detection signal or a standby mode in which the directing of an effect operation of the smart object is stopped and standby; How to include. The method of claim 7,
In step c),
The method of claim 1 , wherein the detection sensor of the local hub separates and detects a proximity area and an external area based on the setting area and the setting area of the smart object. The method of claim 7,
In the step d), the system server transmits a motion directing signal to the smart object when the value of the detection signal is lower than the set value. The method of claim 7,
Accessing the system server by a user using a mobile device;
receiving, by the system server, at least one of a user's information request, a user's conversation request, and a request for effect control of the smart object through the mobile device; and
outputting a response to the user's information request, a response to the user's conversation request, or an output for effect control of the smart object according to the receiving step; A method characterized in that it further comprises. The method of claim 10,
The system server matches the smart objects selected by the user in the order of users accessed through the mobile device, provides authority to control the production of effect motions, and informs the smart objects that do not match with the user that they are not matched through the mobile device. and, if it is detected that the user has selected a smart object that does not match, providing the selected user with the right to control the operation of the smart object, and controlling the smart object that does not match with the user to maintain a standby mode state. Way. The method of claim 11
The system server provides information on a method for directing an effect operation of a smart object of a first user to the mobile device of the standby user,
When the system server determines that the first user has finished using the effect motion production, the system server provides access to the smart object and authority to control effect motion production to the mobile device of the standby user;
The user who has been provided with the effect motion directing control authority transmits a request for an effect motion directing control method identical to or different from the first user's effect motion directing control method of the smart object to the system server through the mobile device. How to.

Images