WO2021095992A1 - Smart character toy having artificial intelligence function, and method and apparatus for creating virtual showroom - Google Patents

Abstract

A method and an apparatus for creating a virtual showroom are provided. A virtual showroom creating method according to an embodiment of the present invention comprises the steps of: creating a user character on the basis of first user information; obtaining first user activity information, and creating a user item on the basis of the first user activity information; displaying a virtual showroom area in which the user item is displayed; and displaying, in the showroom area, a virtual item created on the basis of second content information. In addition, a smart character toy having an artificial intelligence function according to an embodiment of the present invention may comprise: a memory; a sensor unit for recognizing an object, and collecting data sensed through at least one sensor related to the recognized object; and an artificial intelligence module.

Description

Smart character toy with built-in artificial intelligence function and virtual showroom creation method and device

Embodiments of the present invention relate to a method and apparatus for creating a virtual showroom. In addition, the present invention relates to a smart character toy, and more particularly, to a smart character toy implemented to transform into various shapes under certain conditions by embedding an artificial intelligence (AI) function in the character toy.

Virtual spaces implemented on the Internet are widely used through AR and VR, and this has been particularly recognized for its potential as a learning or play space.

In this virtual space, users can create various characters and use them for games or shopping.

Characters in such a virtual space are generally created by a user, and the operator generally seeks profit by selling various virtual goods related to the character to the user.

However, the character created in the virtual space allows the user to simply select a combination of predetermined character characteristics. Due to the limitation of character types, it is difficult to expand the distinguished characteristics for each individual, and connection with offline play is difficult. There is a difficult limit. In addition, there is a limitation in that it is difficult to form a mutual relationship with other users' characters.

In addition, since the virtual space in which the user can use the virtual character online is decorated by the online object purchased by the user, it is difficult to induce continuous interest in the user who uses the virtual space.

On the other hand, conventionally, it was a plush type or an assembleable toy in a form like Lego. Toys that can be assembled like the latter also have a predetermined shape after assembly.

Regardless of gender, most childhood children grow up by spending a lot of time playing with toys, and in the process, they play a positive function that helps children develop their intelligence. Not only children in childhood, but also in a society where single-person households are increasing, and adults are feeling loneliness or psychological anxiety due to difficulties in human or social relations, and toys are helpful in resolving this. have.

Recently, some enthusiasts who collect expensive figures as a hobby have attracted attention, but this is only for the purpose of inspiring personal satisfaction and financial means, and is usually kept in showcases.

As described above, conventional toys can perform a role that gives a brief analogue sensibility in a digitized society, but cannot perform a function or role beyond that.

The technical problem to be solved by the present invention relates to a method and apparatus for providing a virtual showroom in which the user's personalized characteristics are sufficiently reflected by using the user's activity information.

An object of the present invention is to enable (data) communication with a person or other entity (data) beyond the limitations of conventional toys through a smart toy with an artificial intelligence (AI) function embedded therein.

Another object of the present invention is to further increase the provision of emotional and psychological stability, which is a unique function of the toy, by using the sensing information collected therefrom by embedding a sensor unit including various sensors in a smart toy and an artificial intelligence (AI) function based thereon. It is intended to be able to perform various roles in various situations in daily life.

Another object of the present invention is to provide a smart toy that can be transformed into a variety of shapes.

The technical problems to be achieved in the present invention are not limited to the above technical problems, and other technical problems that are not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

In order to solve the above technical problem, a method for creating a virtual showroom performed by a computing device that provides first content according to an embodiment of the present invention includes generating a user character based on first user information, a first user Acquiring activity information, generating a user item based on the first user activity information, displaying a virtual showroom area in which the user item is displayed, and displaying a virtual item generated based on the second content information in the showroom It may include displaying on the area.

In an embodiment, the generating of the user item may include transmitting a notification of a user's activity request to a first user terminal when the first user activity information is not obtained.

In one embodiment, the first user activity information includes content use information of a first user, and generating the user item includes generating a user item corresponding to an object included in the content. I can.

In one embodiment, the first user activity information includes shopping mall use information of a first user, and generating the user item corresponds to a product determined based on the shopping mall use information of the first user among shopping mall products. It may include the step of creating a user item to be used.

In an embodiment, displaying the virtual showroom area may include displaying product information of a shopping mall corresponding to the user item in the showroom area in response to a user input for the user item.

In an embodiment, the virtual item may be generated based on product information of a shopping mall corresponding to an object included in the second content.

In one embodiment, the second content is a virtual showroom area content of a second user, and displaying the virtual item in the showroom area includes obtaining second user information using the first user information. And displaying the virtual item based on the second user activity information.

According to another embodiment of the present invention, a virtual showroom generating apparatus includes a content receiving unit receiving first and second contents, a user character generating unit generating a user character based on first user information, and acquiring first user activity information. And a user item generation unit that generates a user item based on the first user activity information, a display unit that displays a virtual showroom area in which the user item is displayed, and a virtual item generated based on second content information in the showroom. It may include a virtual item generating unit to be displayed on the area.

In addition, a character toy having an artificial intelligence function according to another embodiment of the present invention for solving the above-described problem includes a memory; A sensor unit that recognizes an object and collects data sensed through at least one sensor related to the recognized object; A data processing unit comprising an artificial intelligence unit and generating output data of the character toy based on the collected sensor data through the artificial intelligence module; A control unit for controlling the overall operation of the character toy; And an output unit for outputting output data of the generated character toy.

According to an embodiment of the present invention, the character toy is divided into at least two parts in a detachable structure, the first part has at least a part of the sensor part and the output part built-in, and the second part is at least the artificial intelligence. It characterized in that it comprises a data processing unit including a module and a control unit.

According to an embodiment of the present invention, at least a part of the sensor unit built in the first part includes a sensor related to sight and hearing, and senses at least one of audio data, image data, and video data. It is done.

According to an embodiment of the present invention, at least a part of the output unit built in the first part includes at least one of a speaker and a microphone, and outputs the generated output data in an audio format through the speaker and/or And receiving audio data input from an object through the microphone.

According to an embodiment of the present invention, the artificial intelligence module embedded in the second part, including a big data module, processes input data including the sensed data and audio data of the recognized object with big data, It is characterized in that output data including intelligent data on a service mode for communication with the object is generated from the data processed by big data.

According to an embodiment of the present invention, the generated intelligent data includes at least one of interactive data, notification data, and control data for a linked device according to the service mode.

According to an embodiment of the present invention, the service mode is at least one of a conversation service mode, a notification service mode, a device control service mode, and an object safety service mode.

According to an embodiment of the present invention, the controller detects whether the first part and the second part are separated, and when the first part and the second part are separated and then reconnected, the first part and the second part It is characterized in that it recognizes the configurations built into 2 parts, and controls the recognized configurations of each part to be interlocked.

According to an embodiment of the present invention, when the first part and the second part are separated and the separated time is greater than or equal to a predefined time, the control unit transmits notification data to a pre-registered device, and the notification When feedback is received from the pre-registered device according to data transmission, the sensor of the separated first part is randomly turned on and sensed data is transmitted to the pre-registered device.

According to an embodiment of the present invention, when the first part and the second part are separated, the control unit collects sensing data immediately before separation through a sensor built in the first part immediately before separation, and the notification After data transmission, the sensing data is transmitted to the pre-registered device along with the sensing data transmitted according to the feedback received from the pre-registered device.

According to the present invention as described above, the effects described below can be obtained. However, the effect obtained through the present invention is not limited thereto.

First, according to the present invention, there is an effect of enabling (data) communication with a person or other object beyond the limitations of conventional toys through a smart toy with an artificial intelligence (AI) function embedded therein.

Second, according to the present invention, by using a sensor unit including various sensors in a smart toy and using the sensing information collected therefrom and an artificial intelligence (AI) function based thereon, the provision of emotional and psychological stability, which is a unique function of the toy, is further increased. It has the effect of being able to perform various roles in various situations in daily life.

Third, according to the present invention, there is an effect that can be provided by implementing a smart toy that can be transformed into an appearance of various shapes.

1 is a flowchart of a method of creating a virtual showroom according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining some operations of FIG. 1 in detail.

3 and 4 are diagrams for explaining a user item according to an embodiment of the present invention.

5 is a diagram illustrating a customized user item according to an embodiment of the present invention.

6 is a diagram for describing object information of content linked to a virtual showroom according to an embodiment of the present invention.

7 and 8 are diagrams for explaining a virtual item created using content information according to an embodiment of the present invention.

9 is a diagram for explaining in detail some operations of FIG. 1.

10 and 11 are diagrams for explaining a virtual item generated based on second user information according to an embodiment of the present invention.

12 is a hardware block diagram of an apparatus for generating a virtual showroom according to an embodiment of the present invention.

13 is a diagram for describing a hardware configuration and operation of an apparatus for generating a virtual showroom according to an embodiment of the present invention.

14 is a schematic diagram of a service system including a smart character toy according to an embodiment of the present invention.

15 is a block diagram showing the configuration of the smart character toy according to an embodiment of the present invention.

16 is a flowchart illustrating a method of processing the smart character toy data in the service system according to an embodiment of the present invention.

17 is a diagram illustrating the appearance and configuration of the smart character toy according to an embodiment of the present invention.

18 to 20 are diagrams illustrating a smart character toy implemented according to an embodiment of the present invention and having a transformable structure.

21 is a diagram illustrating a service system according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The detailed description of the present invention described below refers to the accompanying drawings, which illustrate specific embodiments in which the present invention may be practiced. These embodiments are described in detail sufficient to enable a person skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different from each other, but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described in the present specification may be changed and implemented from one embodiment to another without departing from the spirit and scope of the present invention. In addition, it should be understood that the position or arrangement of individual elements in each embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description to be described below is not made in a limiting sense, and the scope of the present invention should be taken as encompassing the scope claimed by the claims of the claims and all scopes equivalent thereto. Like reference numerals in the drawings indicate the same or similar elements over several aspects.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those of ordinary skill in the art to easily implement the present invention.

1 shows a method of creating a virtual showroom according to an embodiment of the present invention.

In the method of creating a virtual showroom according to an embodiment, a user item may be generated based on the user's activity information.

According to an embodiment, the user's activity information may reflect an online activity index obtained by indexing various online activity information. For example, the user's purchase and/or interest in an online shopping mall may be reflected.

Optionally, the user's activity information may reflect an offline activity index obtained by indexing various offline activity information. For example, the user's purchase and/or interest in an offline shopping mall may be reflected. That is, the offline activity index is implemented based on information on various products that the user has purchased and/or shown interest in the offline shopping mall, and data on the user's activity information can be constructed using this.

Each step shown in FIG. 1 may be implemented by a computing device such as a server.

Referring to FIG. 1, in step S110, a user character may be generated based on first user information. The user information is static information of the user, and may include personal information of the user and user input information. Accordingly, according to an embodiment, a user character generated based on user information may be generated in a form directly designated by the user.

Thereafter, in step S120, a user item may be generated based on the first user activity information. User activity information is dynamic information of the user and includes content information used by the user, and more specifically, includes all information that can be obtained by processing raw data generated by the server by the user using the content. I can. The content may include all types of content provided to a user, such as video content, music content, advertisement content, and web content.

For example, when a first user uses video content, the first user activity information may include information on the video content itself, such as genre, field, historical background, place, and object included in the video content. 1 It may include interaction information between the user and the content, such as whether the user views the video content, the viewing time, the viewing period and the number of viewing.

In another example, the first user activity information may include information related to a product selected by the first user in a shopping mall, personal information of the first user, and information related to a shopping mall visit record of the first user.

In the present specification, the shopping mall may be linked to a virtual showroom according to an embodiment, but the present invention is not limited thereto, and may include other shopping malls that are not linked to the virtual showroom. However, in this case, the first user and/or other shopping mall may perform data conversion work on the information of the first user's activity in another shopping mall that is not connected with the virtual showroom, and based on the information that can be obtained from this data. User items can be created.

In some embodiments, the user item may be an item determined by the user to be displayed in the showroom area. While using the content, the user may designate an object to be displayed in the showroom area, and display a user item corresponding to the object in the virtual showroom area. In this case, the database of the content providing server and the database of the virtual showroom providing server may share information in advance or establish a network communication connection to exchange information when necessary.

For example, the user item may be an object corresponding to a product selected by the first user in a shopping mall. The user item may be an object corresponding to a product purchased by the first user in the shopping mall, and may be a product previously designated as a user item among products of the shopping mall. Specifically, when a product related to a spherical joint doll is sold in a shopping mall, the user item may be an object corresponding to a spherical joint doll designated by a user. It may be an object corresponding to the ornament of the spherical joint doll, or may be an object corresponding to the house or furniture of the spherical joint doll.

In step S130, a virtual showroom area in which the user item is displayed may be displayed. In addition, the virtual showroom area is a graphical user interface (GUI) area and may be an area in which a user's input is received.

In an embodiment, the virtual showroom area may be manipulated only by input from a designated user. However, the number of users who can manipulate the showroom area is not limited. For example, one showroom area may be operated by only one designated user, or may be operated by a plurality of designated users.

In one embodiment, by performing an operation on the showroom area, option information on the showroom area itself may be changed, and various attribute information on user characters, user items, and virtual items displayed in the showroom area may be changed. have.

For example, when a user character displayed in the showroom area corresponds to an object related to a spherical joint doll, the user can manipulate the user character to change the posture or change of the doll's clothing. In the case of objects related to the user, the user may manipulate the user item to rearrange the furniture or perform an interior design simulation to change the room structure.If the one or more user items are objects corresponding to a product related to a vehicle, the user An operation can be applied to change the paint color of the vehicle or to perform a tire change.

In step S140, a virtual item generated based on the second content information may be displayed in the showroom area.

The second content may be content different from the first content related to the user item. For example, an instance in which the first content is provided and an instance in which the second content is provided may be different. An instance is an object unit that provides one content, and each instance may display content provided by a different content provider. For example, when the first content is a shopping mall page, the second content may be an image, cartoon, or advertisement content used by a user separately from the shopping mall.

Optionally, the first content and the second content may be content provided from the same content provider. In this case, the content may be provided in different instances, but received from the same content providing server.

In an embodiment, a virtual item generated based on the second content information may correspond to an object included in the second content. For example, when a user views advertisement content, a virtual item corresponding to the advertised article may be created. Alternatively, a user item of a second user whose purchase details are similar to that of the first user may be displayed as a virtual item of the first user. A detailed description will be given later in FIG. 8.

In another embodiment, the background of the showroom area may be displayed based on the second content information. For example, when the second content is video content, the background of the showroom area may correspond to the background of the video content. In an optional embodiment, content to be displayed in the background of the showroom area may be determined based on a user's input. A detailed description will be given later in FIG. 7.

2 is a diagram for explaining in detail a user item generated based on user activity information.

Referring to FIG. 2, a user item according to an embodiment may be generated based on previously acquired user activity information.

Accordingly, it may be checked whether the activity information of the first user is acquired in step S210. If there is activity information of the user, a user item may be generated according to step S120 described above.

On the other hand, when there is no previously acquired user activity information, a notification requesting the user's activity may be delivered to the user terminal in step S220.

In one embodiment, a user item related to the corresponding content may be generated according to a specified condition among various contents provided to the user, but a user item may be necessarily generated for the content provided to the user immediately after an alarm requesting the user's activity is received. have. In addition, by transmitting the notification requesting the user's activity to the user terminal as described above, the user's use of the showroom area can be continuously maintained.

3 is an exemplary diagram for describing a user item and a user character according to an exemplary embodiment.

Referring to FIG. 3, at least one user character 210 and user items 201 and 211 may be displayed in the virtual showroom area 200. The user item is an item designated by the user to be displayed in the showroom area, and may be an item generated based on the user's activity information.

Hereinafter, in order to facilitate understanding of the present invention, it is assumed that the first content is a shopping mall page, and user activity information according to an embodiment of the present invention is user shopping mall use information.

However, it should be noted that the descriptions related to shopping malls and products to be described below are only examples for facilitating understanding of the present invention, and the method of creating a virtual showroom of the present invention is not necessarily limited to shopping mall contents.

The user character 210 according to an embodiment of the present invention may be generated based on user information. The user character 210 may be created by a user, and the shape or attribute of the generated user character 210 may be manipulated by the user. For example, when a user uses the shopping mall 110 related to a spherical joint doll, a user character 210 corresponding to the doll product 111 selected by the user may be generated.

Each of the one or more user items 201 and 211 according to an embodiment of the present invention may be generated based on user activity information for various contents. For example, a user item 211 corresponding to the doll clothes is created based on product information of the shopping mall 110 related to the spherical joint doll, and the female clothes are added based on the information of the clothing product 121 in the women's clothing shopping mall 120. Corresponding user items 201 may be created at the same time. In this case, the user item may be generated based on product information purchased by the user at the shopping mall, or may be generated based on product information designated by the user to be displayed in a showroom among products of the shopping mall.

4 is a diagram for describing a condition for generating a user item according to an exemplary embodiment. Referring to the diagram, according to an embodiment of the present invention, when an object of content satisfies a specified condition, a user item corresponding to the object may be generated. In addition, the user can diversify products created as user items by changing the user item creation conditions.

For example, if the user item 202 corresponding to the product is designated to be displayed in the showroom 200 only for products included in the shopping cart 141 of the shopping mall 140, the user corresponds to the user item to be displayed in the showroom. You can put the items in the shopping cart.

In addition, according to an embodiment, the user displays an area 205 in which a user item corresponding to an object that satisfies the first condition is displayed among objects included in the content, and a user item corresponding to an object that satisfies the second condition is displayed. Area 206 can be designated. That is, even if the user does not designate each user item displayed in the showroom area, an object that satisfies each condition and a user item corresponding to the object may also be changed as user activity information changes.

5 is a view for explaining a customized user item according to an embodiment of the present invention. In an embodiment, as at least one of the attributes of the user item is changed, object information of the content corresponding to the user item may be changed. For example, a user item generated based on product information of a shopping mall may be modified by a user, and option information of a product corresponding to the user item may be changed based on attribute information of the modified user item.

In an embodiment, the user may change at least one of the attributes of the user item in the instance 150 provided separately from the instance 200 provided with the showroom area. For example, attribute information of at least one of attributes of a user item such as a ratio, color, material, and composition of the user item may be changed.

In this case, the attribute information of the changed user item may be transmitted from the instance 150 in which the operation of changing the attribute information of the user item is performed to the instance 110 in which the first content is provided. For example, in the shopping mall instance 110, option information of a product corresponding to attribute information of the user item may be changed. That is, by changing the user item attribute information of the showroom, option information of the object corresponding to the user item may also be changed.

Referring to FIG. 6, in response to a user input 220 for a user item according to an embodiment of the present invention, object information 230 of the first content corresponding to the user item may be further displayed. Similarly, in response to a user input for the virtual item, object information of the second content corresponding to the virtual item may be further displayed.

The object information 230 of the content is displayed in response to a user input for the user item or virtual item displayed in the showroom areas 200a and 200b, so that the user can select among the content information corresponding to each item and object information included in the content. At least one can be obtained.

Hereinafter, a virtual item will be described in detail with reference to FIGS. 7 to 11.

In an embodiment, the virtual item and the user item may be generated based on different conditions, respectively. Specifically, when a user item is generated based on an object selected by the user from the content, the virtual item may be generated based on an object not selected from the content by the user.

For example, when a user item corresponding to a product purchased by a user in a shopping mall is generated, a virtual item corresponding to a product not purchased by the user in the shopping mall may be generated. In this case, in the virtual showroom area according to some embodiments of the present invention, information on a product for which a user may purchase in the future may be further displayed. In this case, the first content corresponding to the user item and the second content corresponding to the virtual item may be the same content.

In an optional embodiment, a virtual item may be generated based on an object included in the second content. Hereinafter, a virtual item generated based on second content different from the first content will be described in detail with reference to FIGS. 7 and 8.

In the showroom area according to an embodiment, a virtual item 203 corresponding to an object included in the second content 310 and a virtual item 204 corresponding to an object included in the third content 320 may be displayed. .

In an embodiment, each object corresponding to one or more virtual items may be an object included in a single content. In this case, the object corresponding to the first virtual item displayed in the showroom area and the object corresponding to the second virtual item may be objects included in the same content.

In another embodiment, each object corresponding to one or more virtual items may be objects included in different contents. In this case, the object corresponding to the first virtual item and the object corresponding to the second virtual item may be objects included in different contents.

For example, as shown in FIG. 7, the virtual item 203 displayed in the showroom area corresponds to the shelf object 311 of the image content 310 provided to the user, and the other virtual item 204 displayed in the showroom area corresponds to the user. It may correspond to the bag object 321 of the webtoon content 320 provided to the user.

Also, in another embodiment of the present invention, the background of the showroom area may be displayed based on external content. In this case, the apparatus for generating a virtual showroom according to an embodiment of the present invention may receive content background information from an external content providing server, and may generate a background of the showroom area based on the received content background information.

For example, when a user is provided with a plurality of external contents 310 and 320, the background of the showroom area according to an embodiment may correspond to the background information of one of the plurality of external contents. When the external content background information 310 includes the background information of the living room of the house, although not shown in FIG. 7, the landscape of the living room of the house may be displayed on the background of the showroom area 200. In addition, the background information of the showroom area according to an embodiment of the present invention may be generated by synthesizing information on a plurality of external contents, or may be generated based on background information of the showroom area of another user.

In the above-described embodiment, a case where background information of a showroom area is obtained without a separate user input based on the user's content use information has been described. However, the method of creating a virtual showroom according to some embodiments of the present invention is not limited thereto, and a background of the showroom area corresponding to the content background information directly designated by the user may be generated in response to a user input.

Referring to FIG. 8, a virtual item 240 related to an object 331 included in a specific content 330 may be generated. For example, when a virtual item 240 corresponding to a character 331 appearing in the movie 330, which is an image content, is displayed in the showroom area 200, the generated virtual item 240 is a character of the character It may be a doll object or a costume object worn by a character.

That is, the virtual showroom area according to the present embodiment may display a virtual item related to an object included in the second content by using the first content related to the user item and the second content information provided in a different instance.

Hereinafter, a virtual item generated based on second user activity information according to an embodiment of the present invention will be described in detail with reference to FIGS. 9 to 11.

In step S141, second user information may be obtained by using the first user information.

At least one of the second user information and the second user activity information may be the same as at least one of the first user information and the first user activity information. For example, when the first content is a shopping mall, at least one of the plurality of products selected by the second user in the shopping mall may be the same as the product selected by the first user in the shopping mall. Alternatively, the age range of the second user and the age range of the first user may be the same. In addition, the second user's shopping mall visit cycle or visit pattern may be similar to the first user's shopping mall visit cycle or visit pattern.

In step S142, a virtual item generated based on the second user activity information may be displayed in the virtual showroom area. In one embodiment, either the user item of the second user or the virtual item of the second user may be displayed in the showroom area of the first user, and the user character of the second user may be displayed in the showroom area of the first user. I can.

The user information of the first user and the user information of the second user have at least one thing in common. By displaying the user item of the second user in the showroom area of the first user, a new product that is highly likely to be purchased by the first user is displayed. You can provide more information about it.

Hereinafter, a method of acquiring second user information will be described in detail with reference to FIG. 10. In an embodiment, second user information may be obtained based on user information of the first user, and a virtual item may be generated based on the second user information.

For example, as illustrated in FIG. 10, when the showroom area 200 of user A is displayed, the generated virtual item 250 may be generated based on user B's information. In this case, at least one of the user information 420 of the user B and the information 410 of the user A may be related. Specifically, at least one of the products included in the purchase history list 421 of the user B or the recently viewed product list 422 may be the same as any one of the products included in the purchase history 411 of the user A.

Also, referring to FIG. 11, in response to a user input for the virtual item 250 generated based on the second user information, the showroom area 500 of the second user may be displayed. By displaying the showroom area 500 of the second user, the first user may further acquire information on the user item of the second user and the virtual item displayed in the showroom of the second user.

Thereafter, in response to a first user's input for a second user's user item included in the second user's showroom area 500 or a virtual item displayed in the second user's showroom, each of the user items or virtual items is corresponding. It goes without saying that the product information that is used may be further displayed.

12 is a hardware block diagram of an apparatus for generating a virtual showroom according to an embodiment of the present invention.

The apparatus 600 for generating a virtual showroom according to an embodiment may further include a user interface 610, a user information providing unit 630, a showroom providing unit 640 and a content providing unit 620.

The user interface 610 according to an embodiment may receive an input from a user and output output data. In one embodiment, a virtual showroom interface, a shopping mall interface, and contents may be output through the user interface 610, and the content providing unit 620, the user information providing unit 630, and the showroom system are provided through the user interface 610. User input may be transmitted to study 640.

The content providing unit 620 according to an embodiment may include a content DB 621 and an object DB 622 in which information on an object constituting the content is stored. The content DB 621 may store information related to content used for each user. The content providing unit 620 may transmit information on an object included in the content to the user information providing unit 630 and the showroom providing unit 640. In addition, content provided to the user may be delivered to the user interface 610. Also, although not shown, the content providing unit 620 according to an embodiment may further include a content background information DB. In this case, the showroom providing unit 640 may obtain background information of the showroom by using the content background information obtained from the content providing unit 620.

The user information providing unit 630 according to an embodiment includes an activity information DB 631 storing user's dynamic information including user's activity details and content information related to the user's activity details, and user's personal information including user's personal information. It may include a user DB 632 in which static information is stored. In an embodiment, the user information providing unit 630 may transmit user activity information and user information to the showroom providing unit 640 and may transmit content information related to user activity information to the user interface 610.

The showroom providing unit 640 according to an embodiment includes a showroom generating unit 641, a user character generating unit 646, a user item generating unit 642, a virtual item generating unit 643, a user item DB 644, and It may include a virtual item DB (645).

The showroom generation unit 641 according to an embodiment may generate a showroom by receiving user item and virtual item information generated from the user item generation unit 642 and the virtual item generation unit 643.

The user character generation unit 646 according to an embodiment receives user information from the user information DB 632 of the user information providing unit 630, generates a user character based on the user information, and generates user character information. May be transmitted to the showroom generation unit 631.

The user item generation unit 642 according to an embodiment receives user activity information from the activity information DB 631 of the user information providing unit 630, generates a user item based on the user activity information, and generates a user. Item information may be delivered to the showroom generation unit 641.

The virtual item creation unit 643 according to an embodiment generates a virtual item based on at least one of object information transmitted from the content providing unit 620 or user information or user activity information transmitted from the user information providing unit 630. Can be generated. In addition, the virtual item generation unit 643 may transmit the generated virtual item information to the showroom generation unit 641.

The user item DB 644 according to an embodiment may store information on user items displayed in a showroom, content corresponding to each user item, or information related to an object included in the content.

The virtual item DB 645 according to an embodiment may store information on virtual items displayed in a showroom, content corresponding to each virtual item, or information related to an object included in the content.

As shown in FIG. 13, the computing device 700 performing the virtual showroom creation method according to an embodiment of the present invention includes a processor 701, a memory 702, a network interface 703, a display 704, and Storage 705 and may further include a system bus in some embodiments.

One or more instructions 710, 711, 712, and 713 that are loaded and stored in the memory 702 are executed through the processor 701. Note that the computing device 700 performing the virtual showroom generation method according to the present exemplary embodiment can perform the virtual showroom generation method described with reference to FIGS. 1 to 11 even without a separate description.

The network interface 703 may transmit the generated virtual showroom information to the user terminal. Also, content information and shopping mall product information may be received from an external server. The received information may be stored in the storage 705.

The storage 705 may include an activity information DB 721 including user content usage information related to a user item or a virtual item, and a user DB 722 in which personal information of the user is stored.

The one or more instructions may include a user character creation instruction 710, a user item creation instruction 711, a showroom area display instruction 712, and a virtual item creation instruction 713.

In an embodiment, a user item may be generated based on the first user information by executing the user character creation instruction 710.

In an embodiment, a user item may be generated based on the first user activity information by executing the user item creation instruction 711.

In one embodiment, a virtual showroom area in which a user item is displayed may be displayed by executing the showroom area display instruction 712.

In an embodiment, a virtual item generated based on the second content information may be displayed in the showroom area by executing the virtual item display instruction 713.

Hereinafter, in the present specification, through a smart toy (or artificial intelligence toy) with an artificial intelligence (AI) function built-in according to the present invention, a person or other entity and (data) To enable communication, a sensor unit including various sensors is built-in or attached to a smart toy, and the sensing information collected through it and the artificial intelligence (AI) function based thereon are utilized to provide emotional and psychological stability, which is a unique function of the toy. It will further increase the skills and describe how to play various roles in various situations in daily life. In addition, the smart character toy according to the present invention is structured to have at least some components in a detachable/attachable structure, and a method of implementing a smart toy that can be transformed into various shapes through this is also described.

14 is a schematic diagram of a service system 1100 including a smart character toy according to an embodiment of the present invention.

Referring to FIG. 14, a service system 1100 including a smart character toy 1110 includes the smart character toy 1110 and a processor 1130. However, the configuration of the service system 1100 according to the present invention is not limited thereto. According to an embodiment, the service system 1100 may further include at least one of a terminal 1120 and a 3D (3D) printer 1140 as shown in FIG. 14.

Hereinafter, for convenience, the service system 1100 including the terminal 1120 and the 3D printer 1140 will be described as an example.

Meanwhile, data communication may be performed between each component of FIG. 14 through a communication network using at least one communication protocol. In other words, each component in the service system 1100 may or may not perform data communication with each other using one communication protocol. In the former case, the one communication protocol may be a dedicated protocol for the service system 1100 including the smart character toy 1110. However, the dedicated protocol need not be defined separately, and may be determined from an existing communication protocol.

The smart character toy 1110 may incorporate or attach at least one sensor and a module for performing an AI function. According to an embodiment, the smart character toy 1110 may perform data communication with at least one terminal 1120 and/or at least one processor 1130 through a communication network. The structure, function, etc. of the smart character toy 1110 will be described later in detail in a corresponding part of the present specification.

The terminal 1130 may communicate data with the smart character toy 1110 and/or the processor 1130.

According to an embodiment, when the terminal 1130 is equipped with a display, data received from the smart character toy 1110 may be output so that a person can see it.

According to an embodiment, the terminal 1130 may upload data received from the smart character toy 1110 to the processor 1130 instead of it, download the data, and transmit the data to the smart character toy 1110. .

According to an embodiment, when a specific signal is received from the smart character toy 1110, a specific function may be performed in response thereto. For example, in the above, when the terminal 1130 is owned by a parent and still image or video data is received from the smart character toy 1110, it is output through the screen, and when an emergency call signal is received, the parent Actions can be taken to quickly recognize the situation according to the call signal. The operation of the terminal 1120 may be defined in advance or according to a user's setting, and may be defined and included in the signal of the smart character toy 1110. At this time, it should be noted in advance that the scope of the present invention is not limited by the above-described embodiments or description.

The processor 1130 may perform various functions according to embodiments. For example, when the processor 1130 performs a function such as a server, it may receive and store data of the smart character toy 1110 or transmit a control signal in response thereto. Here, the server may include a cloud server, and may be a service server provided by a manufacturer providing the smart character toy 1110 or a vendor selling the toy.

According to another embodiment of the present invention, the processor 1130 may be an entity in charge of overall control in a home or a building, or may be a central processing unit (CPU) or a control device of a specific device such as a home appliance. .

The 3D printer 1140 is an entity that designs, manufactures, etc. the entire or part of the smart character toy 1110. In the present specification, although a 3D printer is described as an example, the scope of the present invention is not limited thereto. Accordingly, the 3D printer 1140 may be substituted for the entire or partial configuration of the smart character toy 1110 as long as it is an object capable of designing, manufacturing, or the like.

On the other hand, when the smart character toy 1110 cannot process the data collected by itself, at least one of the terminal 1120 and the processor 1130 may process it.

In addition, at least one of the terminal 1120 and the processor 1130 may download and install software such as an application or a program for data communication with the smart character toy 1110.

To the terminal 1130, a terminal device, a terminal, a mobile station (MS), a mobile subscriber station (MSS), a subscriber station (SS), an advanced mobile station (AMS), a wireless terminal (WT), a machine -Type Communication) device, a machine-to-machine (M2M) device, and at least one of a device-to-device (D2D) device may be used as an embodiment.

Of course, this is only an example, and the terminal in the present invention should be interpreted as a concept including all devices capable of transmitting data or signals that are currently developed and commercialized, or to be developed in the future, in addition to the above-described examples.

In addition, in FIG. 14, one terminal and one processor are illustrated for convenience of description, but the scope of the present invention is not limited thereto. Therefore, even if it is only described as'terminal' in this specification, it may mean a plurality of terminals or a plurality of processors depending on the context and embodiments.

Meanwhile, the processor 1140 includes a cloud server, an IP Multimedia Subsystem (IMS) server, a telephony application server, an instant messaging (IM) server, a media gateway control function (MGCF) server, and a messaging (MSG) server. Gateway) server, CSCF (Call Session Control Function) server, and the like.

Meanwhile, the terminal 1130 or/and the service server 1140 may be implemented as a device indicating an entity capable of data communication such as a personal computer (PC), a notebook computer, and a tablet personal computer (PC).

Meanwhile, the wired/wireless communication network refers to a data communication network that supports various data communication such as text, digital image, digital image, and digital audio information in addition to sensing data between components of the service system 1100. And, the kind is not particularly limited.

For example, the wired/wireless communication network may be an IP (Internet Protocol) network supporting large-capacity data communication through Internet Protocol (IP) or an All IP network integrating different IP networks. .

In addition, the wired/wireless communication network includes a wired network, a wireless broadband (Wibro) network, a mobile communication network including WCDMA, a high speed downlink packet access (HSDPA) network, and a mobile communication network including a long term evolution (LTE) network, and LTE advanced. It may be formed by one of a mobile communication network including (LTE-A), a satellite communication network, and a Wi-Fi network, or a combination of at least one or more of them.

15 is a block diagram showing the configuration of the smart character toy 1110 according to an embodiment of the present invention, and FIG. 16 is a data of the smart character toy 1110 in the service system 1100 according to an embodiment of the present invention. It is a flow chart shown to explain the processing method, Figure 17 is a view showing to explain the appearance and configuration of the smart character toy 1110 according to an embodiment of the present invention, Figures 18 to 20 are A diagram illustrating a smart character toy 1110 implemented according to an embodiment and having a transformable structure.

The configuration of the device for the smart character toy 1110 shown in FIG. 15 is all or part of any one of the smart character toy 1110, the terminal 1120, or the processor 1130 of FIG. 14, or separately Can exist. In the former case, as described above, the configuration of FIG. 15 may be built in or detachable from the device.

The device 1200 for the smart character toy 1110 of FIG. 15 includes a sensor unit 1201, an object recognition/extraction unit 1202, an object data processing unit 1203, an artificial intelligence data processing unit 1204, and a service control unit ( 1205), a memory 1206, an output unit 1207, a data communication unit 1208, and the like. Meanwhile, the memory 1206 may be embedded in the smart character toy 1110, for example, but may be replaced by using an external memory (not shown).

In the present specification, the term'object' is a concept including a person, that is, an object, and is not limited thereto, and includes not only living things such as humans, but also non-living or inanimate objects such as furniture, home appliances, and other devices.

Hereinafter, each configuration of the device 1200 for a smart character toy of FIG. 15 will be described together with a data processing method of the smart character toy 1110 of FIG. 16. Here, the data processing method of the smart character toy 1110 may be regarded as a business model and includes a service method through the smart character toy 1110.

15 and 16, the smart character toy 1110 data processing method is as follows.

First, the sensor unit 1201 collects sensing data using various sensors (S1301), and the object recognition/extraction unit 1202 receives and recognizes the object from the sensing data collected in this way. Data on the recognized object is extracted (S1302).

The service control unit 1205 determines the service mode of the smart character toy 1110 (S1303), controls the artificial intelligence data processing unit 1204 to process intelligent data according to the determined service mode, and outputs the output unit 1207. It is output through (S1305).

In the above, the sensor unit 1201 is expressed as a single component for convenience, but may be built into the smart character toy 1110 or implemented as one or more sensors for the same, or a combination thereof.

For example, the sensor unit 1201 senses at least one of information in the smart character toy 1110, information about the surrounding environment surrounding the smart character toy 1110 or the object (object), and generates a sensing signal corresponding thereto. Let it. The service control unit 1205 may control the driving or operation of the smart character toy 1110 or perform data processing, functions, or operations related to an application program installed in the smart character toy 1110 based on such a sensing signal. .

The sensor unit 1201 includes a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor, and a gyro. Scope sensor, motion sensor, RGB sensor, infrared sensor (IR), finger scan sensor, ultrasonic sensor, optical sensor, e.g. For example, including camera), microphone, battery gauge, environmental sensor (barometer, hygrometer, thermometer, radiation sensor, heat sensor, gas sensor, etc.), chemical sensor (electronic nose, healthcare Sensor, biometric sensor, etc.). Meanwhile, the smart character toy 1110 disclosed in the present specification may be utilized by combining information sensed by at least two or more of the above-described sensors.

The sensor unit 1201 may further include a location information module to acquire the location (or current location) of the smart character toy 1110 or the object, and may include a global positioning system (GPS) or a wireless-fidelity (Wi-Fi) module. ) Module can be used. For example, when the smart character toy 1110 utilizes a GPS module, the location of the smart character toy 1110 may be obtained using a signal transmitted from a GPS satellite. As another example, the smart character toy 1110 uses a Wi-Fi module, based on information of a wireless access point (AP) that transmits or receives a Wi-Fi module and a wireless signal, and the smart character toy 1110 You can get the location of. If necessary, the location information module may perform any function among other parts of the wireless communication unit in order to obtain data on the location of the smart character toy 1110 as a substitute or additionally. As one of the location information modules, an ultrasonic sensor may be used, which may obtain location information of an object by using ultrasonic waves.

Meanwhile, as one of the sensor units, the camera includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor. The camera and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photosensor may be stacked on the display device, and the photosensor is configured to scan the motion of a sensing object close to the touch screen. More specifically, the photo sensor scans the contents placed on the photo sensor by mounting a photo diode and a transistor (TR) in a row/column and using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photosensor calculates the coordinates of the object to be detected according to the amount of light change, and through this, position information of the object may be obtained. In addition, the camera sensor may acquire image data on the current state of the object, and may transmit the acquired image data to a device registered in advance through this.

The camera processes image frames of still images or moving pictures obtained by an image sensor in a photographing mode or a video call mode. The processed image frame may be displayed on the display unit and may be stored in the memory 1206.

Another camera may be further disposed on the other side of the smart character toy 1110. The other camera may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix format. Such a camera may be referred to as an “array camera”. When the camera is configured as an array camera, an image may be photographed in various ways using a plurality of lenses, and an image of better quality may be obtained.

When the object is a person, the smart character toy 1110 may be provided with a fingerprint recognition sensor that recognizes a fingerprint, and the service control unit 1205 may use fingerprint information detected through the fingerprint recognition sensor as an authentication means. The fingerprint recognition sensor may be embedded in a display unit or a user input unit.

The output unit 1207 may generate an output related to visual, auditory or tactile sense, and may include at least one of a display, an audio output unit, a hap tip unit, and a light output unit. The display unit can implement a touch screen together with a touch sensor, and this touch screen functions as a user input unit providing an input interface between the smart character toy 1110 and the object, and at the same time, between the smart character toy 1110 and the object. Can provide an output interface of.

The sound output unit may output audio data received from the wireless communication unit or stored in the memory 1206 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed by the smart character toy 1110. The sound output unit may include a receiver, a speaker, and a buzzer. Another sound output unit may be additionally disposed on the body of the smart character toy 1110. The other sound output unit may implement a stereo function together with the existing sound output unit.

The haptic module generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic unit may be vibration. The intensity and pattern of vibration generated by the haptic unit may be controlled by user selection or setting of the service control unit 1205. Two or more of these haptic units may be provided depending on the configuration aspect of the smart character toy 1110.

The light output unit outputs a signal for notifying the occurrence of an event using light from the light source of the smart character toy 1110. The signal output by the light output unit is implemented as the smart character toy 1110 emits light of a single color or multiple colors, and the signal output may be terminated by detecting an event confirmation of an object or a registered device user.

As one of the output units 1207, the display unit is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), It may include at least one of a flexible display, a 3D display, and an e-ink display.

The microphone is configured to receive the user's voice and other sounds. The microphone may be provided in a plurality of locations and configured to receive stereo sound.

The interface unit (not shown) serves as a passage for various types of external devices connected to the smart character toy 1110. These interface units include a wired/wireless headset port, an external charger port, a wired/wireless data port, an external memory card port, a port for connecting a device equipped with an identification unit, an audio input/output (I/O) port, and a video I/O. It may include at least one of a port and an earphone port. In the smart character toy 1110, in response to the external device being connected to the interface unit, appropriate control related to the connected external device may be performed.

The interface unit serves as a passage for all external devices connected to the smart character toy 1110. The interface unit receives data from an external device, receives power, and transmits it to each component inside the smart character toy 1110, or transmits data inside the smart character toy 1110 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port to connect a device equipped with an identification module, an audio input/output (I/O) port, a video An I/O port, an earphone port, and the like may be included in the interface unit.

The power supply unit (not shown) receives external power and internal power under the control of the service control unit 1205 to supply power to each of the components included in the smart character toy 1110. The power supply unit includes a battery, and the battery may be a built-in battery or a replaceable battery. In addition, the power supply unit may include a connection port, and the connection port may be configured as an example of an interface to which an external charger supplying power for charging the battery is electrically connected. As another example, the power supply unit may be configured to charge the battery in a wireless manner without using the connection port.

The user input unit (not shown) is for receiving information from the user, and when information is input through the user input unit, the service control unit 1205 may control the operation of the smart character toy 1110 to correspond to the input information. .

The memory 1206 is a flash memory type, a hard disk type, a solid state disk type, an SDD type, a multimedia card micro type. ), card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The smart character toy 1110 may be operated in connection with a web storage that performs a storage function of the memory 1206 on the Internet.

The smart character toy 1110 may be configured to provide an internal space accommodating various electronic components, as shown in FIG. 17.

The interface unit becomes a path through which the smart character toy 1110 can be connected to an external device. For example, the interface unit is a connection terminal for connection with other devices (eg, earphones, external speakers), a port for short-range communication (eg, an infrared port (IrDA Port), a Bluetooth port), a wireless device. LAN port, etc.], or at least one of a power supply terminal for supplying power to the artificial intelligence character toy 1110.

The object recognition and extraction unit 1202 recognizes an object from data sensed through the above-described sensor unit 1201 and extracts data sensed through at least one sensor related to the recognized object.

The object data processing unit 1203 processes the object data extracted by the object recognition and extraction unit 1202.

The artificial intelligence data processing unit 1204 includes an artificial intelligence module, and generates output data of the smart character toy 1110 based on the collected sensor data through the artificial intelligence module. The artificial intelligence module, including a big data module, processes input data including the sensed data and audio data of the recognized object with big data, and a service mode for communication with the object from the big data processed data It can generate output data including intelligent data about. In the above, the generated intelligent data may include at least one of interactive data, notification data, and control data for a linked device according to the service mode. The service mode may be at least one of a conversation service mode, a notification service mode, a device control service mode, and an object safety service mode.

The service control unit 1205 controls overall operations of the smart character toy 1110.

On the other hand, the smart character toy 1110 is divided into at least two or more parts in a detachable structure (for example, a spherical joint form), as shown in FIG. 17, and the first part includes at least a part of the sensor unit and the output unit. It is built-in, and the second part may include at least a data processing unit including the artificial intelligence module and a control unit. Here, at least a part of the sensor unit embedded in the first part includes sensors related to sight and hearing, and senses at least one of audio data, image data, and video data. At least a portion of the output unit embedded in the first part includes at least one of a speaker and a microphone, and outputs the generated output data in an audio format through the speaker and/or audio input from an object through the microphone. You can receive data.

In addition, the service control unit 1205 detects whether the first part and the second part are separated, and when the first part and the second part are separated and then reconnected, the first part and the second part are connected to the first part and the second part. The built-in configuration can be recognized, and the recognized components of each part can be controlled so that they are interlocked with each other. When the first part and the second part are separated and the separated time is greater than or equal to a predefined time, the service control unit 1205 transmits notification data to a pre-registered device, and transmits the notification data according to the transmission of the notification data. When feedback is received from a pre-registered device, the sensor of the separated first part may be randomly turned on and sensed data may be transmitted to the pre-registered device. When the first part and the second part are separated, the service control unit 1205 collects sensing data immediately before separation through a sensor built in the first part immediately before separation, and after transmitting the notification data, the service control unit 1205 The sensing data transmitted according to the feedback received from the pre-registered device may be transmitted to the pre-registered device.

In addition, the service control unit 1205 may support and provide a foreign language interpretation, a smart sensor function for analyzing and processing various data in connection with a platform, and a smart character toy 1110 and a service.

On the other hand, the artificial intelligence data processing unit 1204 may be implemented in the form of an artificial intelligence speaker, through which it is possible to communicate with a recognized object, and control or communicate peripheral devices, audiobooks, music, shopping, alarms, and schedules. It can provide various artificial intelligence service functions such as. As one of the above artificial intelligence services, a camera sensor, an iris recognition sensor, a fingerprint recognition sensor, a motion (motion recognition) sensor, a lighting sensor, etc., built in the smart character toy 1110 are combined, and according to the surrounding situation or state of the object, in advance. It is possible to intelligently perform a set operation or the like, and provide various information to the object or to a device registered in advance in relation to the object.

21 is a diagram illustrating a service system according to an embodiment of the present invention.

Referring to FIG. 21, a smart character toy 1110 is provided on the right side, and a platform or services for an artificial intelligence speaker embedded in the smart character toy 1110 is shown on the left. In addition, an example of implementing a smart home through an artificial intelligence speaker of the smart character toy 1110 is also shown.

Such an artificial intelligence speaker, as shown in FIG. 21, can be applied to an open open platform (open platform). In addition, the artificial intelligence speaker can apply a location service technology through a beacon, and through this, the location of the character toy 1110 itself can be known, thereby enabling a loss prevention service. In addition, since the location of other devices around the smart character toy 1110 can be checked in real time through the beacon, various artificial intelligence speaker technologies can be applied through data communication with other devices as well as the loss prevention service.

The artificial intelligence speaker built into the smart character toy 1110 according to the present invention may function as a main device or a sub device for realizing a smart home or IoT service, as shown in FIG. 21. have.

And, as shown in FIG. 21, the artificial intelligence speaker built into the smart character toy 1110 is indirectly connected to the IoT environment by interlocking with the artificial intelligence (AI) device 810, that is, at least one other speech recognition speaker. You can also get involved. For example, when the other speech recognition speaker is located in a living room and the other speech recognition speaker has substantially control over various devices in the home, the user living in the room goes near the other speech recognition speaker in the living room and Even without a command, if a voice command is given to the artificial intelligence speaker built in the smart character toy 1110 in the room, the artificial intelligence speaker built in the smart character toy 1110 performs data communication with the other speech recognition speaker in the living room. Through this, it is possible to conveniently control various devices in the home. In this way, it is possible to control various devices such as home appliances by using the ultra-small artificial intelligence speaker built into the smart character toy 1110. Depending on the embodiment, the artificial intelligence speaker of the smart character toy may be implemented in an oval or circular shape, as shown in FIG. 21, but is not limited thereto. For example, hardware having a diameter of 40 to 50 mm and a thickness of less than 1 to 5 mm Can be implemented as

According to an embodiment, the artificial intelligence speaker built into the smart character toy 1110 according to the present invention can communicate with a user, aid in learning and recommend food, as well as music selection. For example, it is possible to perform at least one or more actions related to intelligence, such as-AI speaker, language intelligence, which provides AI consultation, in-depth question and answer, voice recognition, interpretation function, etc., emotion, reputation analysis, social Issue detection, emotional intelligence about personal emotion sign data, language, knowledge learning, prediction, early detection, learning about complex logic reasoning, and game reasoning intelligence, image recognition, scare, behavior understanding, event, disaster detection, etc. , Location tracking intelligence for preventing lost or lost, convenient intelligence for controlling heating, gas, TV, washing machine, refrigerator, home appliances, etc., and detection intelligence for fire alarms, motion detection sensors, etc. may be performed.

Meanwhile, the artificial intelligence speaker of the smart character toy 1110 in FIG. 21 may perform data communication using various wired/wireless communication protocols of FIG. 14 such as other AI devices 1810 or other devices.

Referring to FIG. 17, an embodiment of a detachable structure of the smart character toy 1110 described above is shown. However, the scope of the present invention is not limited thereto.

Referring to FIG. 17A, the smart character toy 1110 is largely divided into a head part 1410 and a body part 1420, and at least one sensor is built into the head part 1410, and the body Part 1420 includes an artificial intelligence module and the like.

Such a model of the smart character toy 1110 may be formed through the 3D printer 1140 of FIG. 14 described above.

If (a) of FIG. 17 is a separated form, (b) of FIG. 17 shows a combined form.

Referring to FIG. 17, both the head part 1410 and the body part 1420 have a storage space for embedding the above-described components, and this may be implemented in a form that can be opened or closed. Therefore, if there is an error or failure in one configuration for the smart character toy 1110, it can be replaced.

Other parts connected to the head part 1410 and the body part 1420 may be implemented in a spherical joint shape and may be attached/removed.

For example, referring to FIGS. 18 to 20, the smart character toy 1110 can be used in various ways through this separation structure.

Referring to FIG. 18, four head shapes, one body, and arm and leg shapes are provided, and a combination of these can form various smart character toys 1110 as shown in FIGS. 19A and 19B. have. At this time, both sides of the body may be implemented in a form in which the head is detachable/attachable.

In the case of (a) of FIG. 19, a first head is coupled to one side of the body part and a second head is coupled to the other side, and in the case of (b) of FIG. 19, a third head and the other side are provided on one side of the body part. It is a structure in which the fourth head is combined.

In this way, a plurality of heads may be combined with one body, or one head may be alternately replaced and combined.

As shown in FIG. 19, the head of each doll has a structure that can be opened and closed, for example, a part of the head is detachable, and a sensor may be installed inside the detached head. Through this, the user can optionally add, modify, or replace a desired function by replacing the sensor inside the head.

Meanwhile, the body of the doll of FIG. 19 may have an artificial intelligence speaker installed therein.

In addition, as shown in (a) to (f) of Figure 20, by implementing the front and rear of the head in different face shapes, one artificial intelligence character toy 1110 can provide the same effect as having multiple toys. May be.

As described above, a smart character toy with an artificial intelligence (AI) function built into it, such as figures and dolls according to the present invention, has a structure that can be transformed into various shapes, and can be used for various functions and purposes. For example, according to the present invention, it is possible to feel less loneliness through communication with a person through artificial intelligence embedded in the smart character toy from an emotional perspective. In other words, it is possible to provide a sense of psychological stability by recognizing the situation of a person playing with a smart character toy and providing dialogue, (preferred) music, etc. according to the recognized situation. Through this, in a society where there is a pathological disorder, a single family or a nuclear family, sociality is relatively insufficient, such as the elderly or children living alone, or kidult adults can have love for smart character toys, sublimating into a hobby and mental It can help relieve treatment or psychological anxiety, and further inspire the desire to purchase products. In addition, not only such situations and people, but also smart character toys are like a secretary in everyday life, such as recommending music that is good to listen to on rainy days, ordering food that is easy to eat, and recommending dishes that can be made with ingredients in the refrigerator. It can perform the function of an artificial intelligence assistant.

In addition, according to the present invention, when there is a disability of the elderly or children who are concerned about health, or there is a risk factor in the surrounding situation or location, the movement is recognized for the safety of the object (person) and the movement accordingly-Regular/irregularly smart Reports or conversations to the terminal registered in the character toy, emergency contact to public institutions when a pathological phenomenon is found, contact with the relevant institution due to gas leaks or electrical problems, and related door locks/opens, etc. can be performed. .

In addition, according to the present invention, the smart character toy provides today's weather by itself or through communication with nearby devices, etc., providing karaoke functions, and interlocking with home appliances-washing machine function control, air conditioner function control, TV function control In addition to -, it can contribute to the convenience of daily life by performing a notification function for not only checking the location of the child, checking the route, etc.

In addition, according to the present invention, the smart character toy provides language acquisition/learning functions such as sound fairy tales and audiobooks to the subject by itself or in conjunction with peripheral devices capable of outputting audio/video data, and creativity through imagination. It can help improve and help prevent dementia with various horse games.

On the other hand, as described above, the smart character toy according to the present invention can be combined in various shapes in terms of design through a spherical joint shape, that is, structuring, for example, the upper and lower faces are different or the front and rear faces are different. Through this, you will be able to tell a character such as a storytelling story. When the smart character toy is produced in the form of a person or animal that the object is familiar with, it provides a familiar and familiar feeling, and through this, it is possible to not only alleviate the rejection of various functions provided by the artificial intelligence speaker, that is, but also provide a sense of stability. have. In addition, it is also possible to combine the configuration of the smart character toy of the present invention with the appearance of an existing figure or stuffed toy.

A smart character toy with an artificial intelligence function according to another embodiment of the present invention includes a memory, a sensor unit for recognizing an object and collecting data sensed through at least one or more sensors related to the recognized object, and an artificial intelligence unit. And a data processing unit that generates output data of the smart character toy based on the collected sensor data through the artificial intelligence module, a control unit that controls the overall operation of the smart character toy, and the generated smart character toy. Including an output unit for outputting output data, the smart character toy is divided into at least two or more parts with a detachable structure, the first part has at least a part of the sensor unit and the output unit built-in, and the second part is at least the A data processing unit including an artificial intelligence module and a control unit are included, and at least a part of the sensor unit embedded in the first part includes sensors related to sight and hearing, and stores at least one of audio data, image data, and video data. Sensing, and at least a part of the output unit built in the first part includes at least one of a speaker and a microphone, and outputs the generated output data in an audio format through the speaker and/or from an object through the microphone Receives the input audio data, the artificial intelligence module built in the second part, including a big data module, processes the input data including the sensed data and the audio data of the recognized object big data, Output data including intelligent data on a service mode for communication with the object is generated from the data processed data, and the generated intelligent data is, according to the service mode, interactive data, notification data, and linked devices. It includes at least one of control data for, and the service mode is at least one of a conversation service mode, a notification service mode, a device control service mode, and an object safety service mode, and the control unit comprises: Whether to separate Is detected, the first part and the second part are separated and then reconnected, recognizes the configuration built into the first part and the second part, controls the recognized configurations of each part to interoperate with each other, and the When the first part and the second part are separated and the separated time is greater than or equal to a predefined time, notification data is transmitted to a pre-registered device, and feedback is received from the pre-registered device according to the transmission of the notification data. , The sensor of the separated first part is randomly turned on to transmit the sensed data to the pre-registered device, and when the first part and the second part are separated, the first part is embedded in the first part immediately before separation. The sensing data immediately before the separation is collected through the sensor and transmitted to the pre-registered device together with the sensing data transmitted according to the feedback received from the pre-registered device after transmission of the notification data.

Specific implementations described in the present invention are examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings exemplarily represent functional connections and/or physical or circuit connections. It may be referred to as a connection, or circuit connections. In addition, if there is no specific mention such as "essential", "important", etc., it may not be an essential component for the application of the present invention.

In the specification of the present invention (especially in the claims), the use of the term "above" and the reference term similar thereto may correspond to both the singular and the plural. In addition, when a range is described in the present invention, the invention to which an individual value falling within the range is applied (unless otherwise stated), and each individual value constituting the range is described in the detailed description of the invention. Same as. Finally, unless explicitly stated or contradictory to the steps constituting the method according to the present invention, the steps may be performed in an appropriate order. The present invention is not necessarily limited according to the order of description of the steps. The use of all examples or illustrative terms (for example, etc.) in the present invention is merely for describing the present invention in detail, and the scope of the present invention is limited by the above examples or illustrative terms unless limited by the claims. It does not become. In addition, those skilled in the art can recognize that various modifications, combinations, and changes may be configured according to design conditions and factors within the scope of the appended claims or their equivalents.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and usable to those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks. medium), and a hardware device specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device can be changed to one or more software modules to perform the processing according to the present invention, and vice versa.

In the above, the present invention has been described by specific matters such as specific elements and limited embodiments and drawings, but this is provided only to aid in a more general understanding of the present invention, and the present invention is not limited to the above embodiments. Anyone with ordinary knowledge in the technical field to which the invention pertains can make various modifications and changes from these descriptions.

Therefore, the spirit of the present invention is limited to the above-described embodiments and should not be defined, and all ranges equivalent to or equivalently changed from the claims to be described later as well as the claims to be described later are the scope of the spirit of the present invention. It will be said to belong to.

Claims (13)

1. In the virtual showroom creation method performed by a computing device that provides a first content,

   Creating a user character based on the first user information;

   Creating a user item based on the first user activity information;

   Displaying a virtual showroom area in which the user item is displayed; And

   Displaying a virtual item generated based on second content information in the showroom area;

   Virtual showroom creation method comprising a.
2. The method of claim 1,

   The step of creating the user item,

   In case the first user activity information is not obtained, transmitting a notification of the user's activity request to the first user terminal,

   How to create a virtual showroom.
3. The method of claim 1,

   The first user activity information,

   Including content use information of the first user,

   The step of creating the user item,

   Including the step of creating a user item corresponding to the object included in the content,

   How to create a virtual showroom.
4. The method of claim 3,

   The first user activity information,

   Including shopping mall use information of the first user,

   The step of creating the user item,

   Including the step of generating a user item corresponding to a product determined based on the shopping mall usage information of the first user among shopping mall products,

   How to create a virtual showroom.
5. The method of claim 4,

   Displaying the virtual showroom area,

   In response to a user input for the user item, displaying product information of a shopping mall corresponding to the user item in the showroom area,

   How to create a virtual showroom.
6. The method of claim 4,

   The virtual item is

   Created based on product information of the shopping mall corresponding to the object included in the second content,

   How to create a virtual showroom.
7. The method of claim 4,

   The second content,

   It is the contents of the virtual showroom area of the second user,

   Displaying the virtual item in the showroom area,

   Acquiring second user information by using the first user information; And

   Including the step of displaying the virtual item based on the second user activity information,

   How to create a virtual showroom.
8. A content receiver for receiving first content and second content;

   A user character generation unit that generates a user character based on the first user information;

   A user item generation unit that generates a user item based on the first user activity information;

   A display unit that displays a virtual showroom area in which the user item is displayed; And

   A virtual item generator configured to display a virtual item generated based on second content information in the showroom area;

   Virtual showroom creation device comprising a.
9. In the smart character toy with built-in artificial intelligence function,

   Memory;

   A sensor unit that recognizes an object and collects data sensed through at least one sensor related to the recognized object;

   A data processing unit comprising an artificial intelligence module and generating output data of the character toy based on the collected sensor data through the artificial intelligence module;

   A control unit for controlling the overall operation of the character toy; And

   Includes; an output unit for outputting the output data of the generated character toy,

   The character toy,

   It is divided into at least two parts with a separable structure,

   The first part includes at least a part of the sensor unit and the output unit,

   The second part includes at least a data processing unit and a control unit including the artificial intelligence module,

   The artificial intelligence module built into the second part,

   Including a big data module, big data processing input data including the sensed data and audio data of the recognized object, and including intelligent data on a service mode for communication with the object from the big data processed data A smart character toy with an artificial intelligence function, characterized in that it generates output data.
10. The method of claim 9,

    At least a portion of the sensor unit built in the first part,

    A smart character toy with a built-in artificial intelligence function, characterized in that it includes sensors related to sight and hearing, and senses at least one of audio data, image data, and video data.
11. The method of claim 9,

    At least a portion of the output unit built in the first part,

    Including at least one of a speaker and a microphone,

    A smart character toy with an artificial intelligence function, characterized in that the generated output data is output in an audio format through the speaker and/or audio data input from an object is received through the microphone.
12. The method of claim 9,

    The generated intelligent data,

    According to the service mode, a smart character toy with an artificial intelligence function, comprising at least one of interactive data, notification data, and control data for a linked device.
13. The method of claim 9,

    The service mode,

    A smart character toy with an artificial intelligence function, characterized in that at least one of a conversation service mode, a notification service mode, a device control service mode, and an object safety service mode.

Images