KR102208256B1 - Smart doll performing the reading function - Google Patents

Abstract

The present invention relates to a smart doll which is operated by being connected to a user terminal and a server. The smart doll comprises: a communicating unit which communicates with the user terminal and the server, and receives target content of the reading operation from at least one of the user terminal and the server; a sensor unit which is provided in at least one region of a body of the doll and senses contact information applied by a user to the doll; an audio processing unit which outputs audio data of the target content through a speaker; and a controlling unit which senses a reading command for the target content, performs the reading operation for target data, and controls a reading operation setting value by sensing an output setting value changing event. The target content includes at least one among SNS posts, messenger conversations, internet news articles, and e-books. The reading operation setting value includes at least one among a type of background sound to be added, a type of a sound effect to be added, a sound volume, and a reading speed. The present invention allows the user to confirm necessary content even though the user does not look at the user terminal.

Description

Smart doll performing the reading function {Smart doll performing the reading function}

The present invention relates to a smart doll that performs a reading function.

Recently, TTS (Text to Sound) technology, a technology that converts text into speech, is in the spotlight. Such TTS technology is being researched and developed in a direction to derive naturalness like human reading when text is spoken.

However, conventional services using the TTS mainly consist of a one-way service that does not perform a change operation based on a user's response. In addition, services using TTS were mainly limited to text-only content.

An object of the present invention is to provide a reading function based on user reaction by controlling to change a set value based on user reaction when performing the TTS function.

Another object of the present invention is to perform a reading operation on content (SNS, messenger, etc.) in which images, videos, and texts exist in combination.

A smart doll that operates in conjunction with a user terminal and a server according to an embodiment of the present invention communicates with the user terminal and the server, and a communication unit that receives content to be read from at least one of the user terminal and the server, the body of the doll A sensor unit that is provided in at least one area of and senses contact information applied by a user to the doll, an audio processing unit that outputs audio data of the target content through a speaker, detects a reading command for the target content, and reads the target data It may include a control unit that performs an operation and controls a reading operation setting value according to detecting an output setting value change event. In this case, the target content includes at least one type of SNS posts, messenger conversation contents, Internet news articles, and e-books, and the reading operation setting value is a type of added background sound, type of added sound effect, sound volume, and reading speed. It may include at least one of.

The control unit includes a context-based control unit for controlling a reading operation setting value based on at least one of a user's motion and a surrounding situation, and the context-based control unit is a user detected by a touch sensor provided in at least one area of the smart doll. A contact-based control unit that determines the type of contact based on the contact information of and controls the setting value of the reading operation in response to the type of contact, and sets the reading operation based on at least one of a user's voice command, ambient noise level, and a specific command sound It may be configured to include a voice-based control unit for controlling the value, and a reaction-based control unit for collecting user reaction information and changing a reading operation setting value. In this case, the reaction-based controller includes a sleep reaction in which the user's movement and voice are not detected for a predetermined time or longer as the reaction information, and when the sleep reaction is detected, the reading operation may be stopped.

In addition, the control unit may include a content-based control unit that controls a setting value of a reading operation in response to a characteristic of the target content.

The content-based control unit classifies the text included in the target content by emotion category according to a preset condition, and controls the text to output a sound effect corresponding to the classified category, and is configured to perform a reading operation. It may include a format-based control unit for differently setting the setting value of the reading operation according to the type of the associated application.

In addition, the control unit may include a character setting unit that increases the age range of the output voice in proportion to the amount of use of the smart doll.

The server communicating with the smart doll calculates the user's application access frequency and major interest information based on the log information of the user terminal, and an output target selection unit that calculates a corresponding list of contents to be read for favorites, reading image information It may be configured to include an AI support unit that performs an AI analysis function to support the operation.

At this time, the AI support unit calculates at least one of a background sound and a sound effect corresponding to an image included in the target content, but calculates a temperature sensation code from at least one of color, lighting, and season from the image, and includes it in the image. An object code may be calculated based on the type of the object, and at least one of a background sound and a sound effect sound in which the temperature feeling code and the object code are similar may be calculated.

According to an embodiment of the present invention, when performing a content reading operation using a TTS function, functions such as adjusting a reading speed, adjusting a sound volume, and stopping a reading operation based on a user's response may be provided according to a user's needs.

According to an exemplary embodiment of the present invention, various types of contents such as SNS posts, messenger conversation contents, webtoons, and the like can be read instead, so that the user can check necessary contents even without looking at the user terminal. Furthermore, in the exemplary embodiment of the present invention, since sound effect and background sound corresponding to the content are output together with text content, it is possible to provide an emotional and human-friendly service compared to the prior art.

1 is a diagram illustrating a network structure of a smart doll according to an embodiment of the present invention.
2 is a block diagram showing components of a smart doll 100 according to an embodiment of the present invention.
3 is a diagram illustrating a configuration of a context-based control unit according to an embodiment of the present invention.
4 is a diagram illustrating a configuration of a content-based control unit according to an embodiment of the present invention.
5 is a diagram showing the configuration of a server according to an embodiment of the present invention.
6 is a diagram illustrating an operation sequence of a smart doll according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

The term "unit" or "module" used in the specification refers to a hardware component such as software, FPGA or ASIC, and the "unit" or "module" performs certain roles. However, "unit" or "module" is not meant to be limited to software or hardware. The “unit” or “module” may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example, "sub" or "module" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, It includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. Components and functions provided within "sub" or "module" may be combined into a smaller number of components and "sub" or "modules" or into additional components and "sub" or "modules". Can be further separated.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc., as shown in the figure It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to orientation.

The smart doll disclosed in the present specification may include a toy having a shape such as a robot, a car, an animal, etc., and the shape and material of the exterior are not particularly limited.

1 is a diagram illustrating a network structure of a smart doll according to an embodiment of the present invention.

As shown in Figure 1, the smart doll network system according to an embodiment of the present invention may be configured to include a smart doll 100, a user terminal 200, a server 300. The smart doll 100 according to an embodiment of the present invention may perform communication between the user terminal 200 and a short-range communication module such as Bluetooth. In addition, the user terminal 200 may install an application related to driving of the smart doll 100, and the driving of the smart doll 100 may be controlled based on an application setting value in the user terminal 200.

For example, the user may select a data item (eg, SNS application type) to be output (read) through the smart doll 100 from the user terminal 200. Information on a data item that is a target of an output function (eg, a reading function) may be provided to the server 300, and the server 300 may transmit the data item to be output to the smart doll 100 side.

The server 300 according to an embodiment of the present invention, so that the smart doll 100 can perform an audio service (reading function), output target data selected by the user terminal 200 (eg, SNS feed content, instant messenger conversation content, News articles, webtoons, e-books, etc.) can be provided. The server 300 according to an embodiment of the present invention may be implemented as an integrated type (eg, a content providing server for exclusive use of a smart doll) so as to provide a data item to be output and to perform a processing operation of the data item.

According to another embodiment, the server 300 accesses an additional service server to receive the content to be output, and then performs a processing operation (e.g., a classification operation, a specific content extraction operation, etc.) required to be output from the smart doll 100. Can be done. In this case, the additional service server may correspond to, for example, various SNS servers, portal servers, and e-book providing servers.

The smart doll 100 may be implemented to enable a wireless communication function such as Wi-Fi, and accordingly, communication with the user terminal 200 and the server 300 may be performed. When receiving the output target data, the smart doll 100 may be directly received from the server 300, or may be transmitted from the server 300 to the user terminal 200 and then received from the user terminal 200.

In addition, according to various embodiments, the smart doll 100 may transmit some collected or generated information (eg, sensing information, user voice input information, etc.) to the user terminal 200 or the server 300.

In the following, a detailed description of the configuration of the smart doll will be described with reference to FIGS. 2 to 4.

First, Figure 2 is a configuration diagram showing the components of the smart doll 100 according to an embodiment of the present invention.

As shown in FIG. 2, the smart doll 100 according to an embodiment of the present invention may include a communication unit 110, a storage unit 120, an input unit 130, an audio processing unit 140, a sensor unit 150, a camera unit 160, and a control unit 170. . Although not shown in FIG. 2, according to various embodiments, the smart doll 100 may further include a separate display unit. In this case, the display unit (not shown) may include a projector shape.

The communication unit 110 may use a network to transmit and receive data between the user terminal and the server and the smart doll, and the type of the network is not particularly limited. The network may be, for example, an Internet Protocol (IP) network that provides a service for transmitting and receiving large amounts of data through an Internet Protocol (IP) or an All IP network integrating different IP networks. In addition, the network includes a wired network, a wireless broadband (Wibro) network, a mobile communication network including WCDMA, a high speed downlink packet access (HSDPA) network and a mobile communication network including a long term evolution (LTE) network, and LTE advanced (LTE-A). ), a mobile communication network including 5G (Five Generation), a satellite communication network, and a Wi-Fi network, or at least one or more of them may be combined.

The communication unit 110 according to an embodiment of the present invention may support an operation of transmitting and receiving output content (data) that is an object of a reading operation.

The storage unit 120 may include, for example, an internal memory or an external memory. The internal memory includes, for example, volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.)), non-volatile memory (e.g., OTPROM (one time programmable ROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash), hard drive, Alternatively, it may include at least one of a solid state drive (SSD).

External memory is a flash drive, for example, compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (mini-SD), extreme digital (XD), It may further include a multi-media card (MMC) or a memory stick. The external memory may be functionally and/or physically connected to the electronic device through various interfaces.

The storage unit 120 according to an embodiment of the present invention may store sounds such as a text to sound (TTS) program and various versions of voices, background sounds, and effect sounds. In addition, the storage unit 120 may store content information that is an object of a reading operation, and may store information related to change of a setting value of the reading operation.

The input unit 130 may include, for example, a touch panel, a (digital) pen sensor, a key, or an ultrasonic input device. The touch panel may use at least one of, for example, a capacitive type, a pressure sensitive type, an infrared type, or an ultrasonic type. Also, the touch panel may further include a control circuit. The touch panel may further include a tactile layer to provide a tactile response to a user.

The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate sheet for recognition. The key may include, for example, a physical button, an optical key, or a keypad.

The input unit 130 according to the exemplary embodiment of the present invention may be provided in the form of a key button or a touch panel to receive a user input in a region of the doll body.

The audio processing unit 150 may include a speaker and a microphone, and may bidirectionally convert an electric signal and a sound signal.

First, the audio processing unit 150 according to an embodiment of the present invention may output audio data to be output through a speaker. Further, the audio processing unit 150 may input or sense user's voice information or other sound information through a microphone. For example, the audio processing unit 150 may receive sound data such as ambient noise and a user's voice input. In addition, the audio processing unit 150 may output data converted from text form to audio form to a speaker through TTS.

The sensor unit 150 may measure a physical quantity or detect an operating state of a watch and convert the measured or sensed information into an electric signal. The sensor unit includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor (eg, RGB (red, green, blue) sensor), a biometric sensor, It may include at least one of a temperature/humidity sensor, an illuminance sensor, or an ultra violet (UV) sensor. Additionally or alternatively, the sensor unit may include, for example, an E-nose sensor, an electromyography sensor, an electroencephalogram sensor, an electrocardiogram sensor, an infrared sensor. ) Sensor, iris sensor and/or fingerprint sensor. The sensor unit may further include a control circuit for controlling at least one or more sensors included therein.

The sensor unit 150 according to an embodiment of the present invention may detect whether a user is in proximity or a user's touch (eg, a touch on a part of a smart doll). For example, the sensor unit 150 may include a touch sensor provided on one side of the smart doll 100 to determine whether the user touches or not. In addition, the sensor unit 150 may determine whether or not the smart doll 100 has been moved by a user through a gyro sensor or the like.

In addition, the sensor unit 150 may sense surrounding environment information such as ambient illumination and humidity.

The camera unit 160 is a device capable of photographing, for example, a still image and a moving picture, and according to an embodiment may include one or more image sensors, a lens, an image signal processor (ISP), and an Ehsms flash.

The camera unit 160 according to an embodiment of the present invention may photograph user reaction information.

The control unit 170 may also be referred to as a processor, a controller, a microcontroller, a microprocessor, a microcomputer, and the like. Meanwhile, the control unit may be implemented by hardware, firmware, software, or a combination thereof.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code may be stored in a memory and driven by the control unit. The memory may be located inside or outside the user terminal and the server, and may exchange data with the controller through various known means.

The control unit 170 according to an embodiment of the present invention may detect a reading command for target content and perform a reading operation for target data accordingly. In addition, in performing a reading operation, the controller 170 may detect an output setting value change event and perform an operation of changing an output setting value in response thereto.

The control unit 170 may include a context-based control unit 171, a content-based control unit 172, and a character setting unit 173.

First, the context-based controller 171 may control a setting value of a reading operation based on context information such as a motion of a user using the smart doll 100.

In addition, the content-based controller 172 may control a setting value of the reading operation based on a characteristic of the target content of the reading operation performed by the smart doll 100.

In this case, the setting value of the reading operation may be a concept including an added background sound, a type of sound effect, a volume of a sound, a reading speed, and the like.

In this case, the target content for the reading operation may refer to content (content including text) for outputting audio data through a TTS program and content including sound data. More specifically, the content subject to the reading operation is a message of an instant messenger installed in the user terminal 200, text message, schedule content, alarm content, posting content of SNS (eg, Instagram, Facebook), and portal site. Posts (news articles, etc.), e-books, etc. may be included.

The character setting unit 173 may designate and change a setting value corresponding to the personality of the smart doll. The character setting unit 173, for example, changes the output voice in proportion to the level of the amount of use of the smart doll (which may be defined including the number and frequency of the reading operation using the smart doll), but the recorded voice sample Among the items, the model that recorded the voice can be changed step by step from a low age group (eg, a sample recorded by a child) to a higher item (eg, a sample recorded by an adult).

Previously, it has been described that the configuration of the control unit 170 of the smart doll 100 may include a context-based control unit 171, a content-based control unit 172, and a character setting unit 173. Hereinafter, a more detailed description of the context-based control unit 171 and the content-based control unit 172 of the configuration of the control unit 170 will be described with reference to FIGS. 3 and 4, respectively.

3 is a diagram illustrating a configuration of a context-based control unit according to an embodiment of the present invention.

As shown in FIG. 3, the context-based control unit 171 according to an embodiment of the present invention may include a contact-based control unit 171a, a voice-based control unit 171b, and a response-based control unit 171c. The context-based controller 171 may control an output setting value of a reading operation based on at least one of a user's motion and a surrounding situation.

First, the contact-based controller 171a may control a set value based on whether the user has contacted the smart doll 100 and the type of contact. In this case, the contact-based controller 171a may control a set value based on whether the smart doll 100 is in proximity to the user and the proximity degree.

According to an embodiment, the contact-based control unit 171a may determine a portion that the user has contacted through a contact sensor provided on at least one side of the smart doll 100. The contact sensor may be provided at a characteristic position such as a head, a stomach, and a hip of the doll, for example. And the touch sensor is one-time touch / repeated touch, single touch / multi-touch / palm touch (when the touch area exceeds a preset value, it can be recognized as a palm (palm) touch that is distinguished from multi-touch), pressure Various contact methods, such as touch with applied/touch without applying pressure, can be classified and detected.

The contact-based controller 171a may determine a user's contact type by combining items of signals sensed through the contact sensor. When the signal of the contact sensor is detected at the position of the doll's head, it is a repetitive touch, a palm touch, or a touch without pressure, the touch-based controller 171a combines the items of each signal to determine the user's contact motion. It can be determined that it is the movement of stroking the head. Similarly, the contact-based control unit 171a tickles the sole of the foot (repeated touch + single touch + touch without pressure), hitting the hip (one-time touch + palm touch + pressure applied touch), and It is possible to distinguish between a stabbing operation (one-time touch + single touch + pressure applied touch).

In addition, after classifying the type of contact operation, the contact-based controller 171a may change a setting value of the reading operation corresponding to each contact operation. The setting value that is changed in response to the type of the contact operation may include a sound effect, a voice change, a sound volume, a reading speed, a stop/restart of the reading operation, and the like.

For example, the contact-based controller 171a may decrease a reading speed when a motion of strokes the head of the smart doll is detected. Alternatively, when a contact motion that tickles the sole of the smart doll is sensed, the contact-based controller 171a may control the reading operation to be temporarily stopped, output a laughter sound effect, and then restart the reading operation.

The voice-based controller 171b may control an output setting value of a reading operation in response to voice and other sound inputs. For example, the voice-based controller 171b may control an output setting value of a reading operation based on a user's voice command, ambient noise level, and a specific command sound.

The voice command can be executed to directly change the setting value of the reading operation, and the types are, for example, "play", "volume up", "read quickly", "read with a child's voice." ”, etc.

The voice-based control unit 171b may determine an ambient noise level value and change a setting value of a reading operation in response to the determined noise level value. For example, the voice-based control unit 171b may increase the output volume corresponding to the larger value of the noise level of the surrounding environment. Through this, the user can hear the sound automatically adjusted to an appropriate value without having to directly adjust the volume according to the external noise level.

In addition, the voice-based control unit 171b may change a setting value of a reading operation in response to other sounds (hereinafter, referred to as specific command sounds) that do not have the same meaning as a word. For example, the voice-based controller 171b may change a set value (effect sound, voice change, sound volume, reading speed, etc.) in response to a clap sound, a whistle sound, and the like.

The reaction-based controller 171c may collect and determine the user's reaction information, and may change a setting value of the reading operation based on the determined user's reaction information. In this case, the user's reaction information may be determined through a user's facial expression, a user's motion, etc. generated after a reading operation is started. In addition, the user's reaction information may be determined based on information input through a camera and a microphone provided in the smart doll 100. Examples of the user's reaction information include positive reactions (e.g., laughter detection), concentration reactions (e.g., face-front image and pupil detection), yawning reactions (e.g., face image and yawning motion detection), sleep reactions (e.g., User detection, motion and voice not detected for more than a preset time), etc. may exist.

The response-based control unit 171c may first determine whether to maintain or change a setting value of a reading operation corresponding to a user's reaction, and then, when it is determined that the reading operation should be changed, may calculate a setting value of the reading operation to be changed. . For example, the response-based controller 171c may control to maintain a setting value of a reading operation when the user's reaction is a positive reaction or an intensive reaction, and to change a setting value of the reading operation in the case of other reactions. In addition, the reaction-based controller 171c may control a volume up when it is determined that a yawning reaction has occurred from the user, and to stop a reading operation when a sleep reaction is detected by the user.

In addition to the above-described examples, the context-based controller 171 may detect and determine various types of context information, and perform preset set value control related to a reading operation in response thereto.

4 is a diagram illustrating a configuration of a content-based control unit according to an embodiment of the present invention.

The content-based control unit 172 illustrated in FIG. 4 may control at least one of various setting values of the reading operation in response to characteristics of the content subject to the reading operation. And, as shown in FIG. 4, the content-based control unit 172 according to an embodiment of the present invention may include a meaning-based control unit 172a and a type-based control unit 172b.

Among the configurations of the content-based control unit 172, the meaning-based control unit 172a may control at least one set value of the reading operation according to the meaning of the text and image that are the target of the reading operation. In this case, the smart doll 100 may select an object to perform a reading operation from among contents in a previously linked application. In addition, the previously linked application may include, for example, an SNS application, a messenger application, an e-book application, and the like. In addition, the target to perform the reading operation may correspond to the entire content of the previously linked application, specific content selected by the user (eg, a conversation list in a chat room selected by the user, e-book content selected by the user), and the like.

The meaning-based control unit 172a may perform an operation of determining the meaning of the target content subject to the reading operation. Then, the meaning-based controller 172a may control at least one set value of the reading operation in response to the determined meaning.

According to an embodiment, the meaning-based controller 172a extracts semantic elements, such as a specific word, a specific punctuation mark, and a specific consonant, from text included in the target content, and evaluates the extracted semantic element according to a preset condition. It can be classified by category. In addition, the meaning-based controller 172a may output a sound effect corresponding to the category of the semantic element. Specifically, for example, the meaning-based control unit 172a may extract semantic elements classified into'laugh' categories such as'ㅋ','ㅋㅋㅋ', and'ㅋㅋㅋㅋㅋ' according to a preset criterion, and smile in response thereto. You can control to output sound effects.

Similarly, the semantic-based control unit 172a is a set value including at least one of a reading speed, a voice type (e.g., a gender of a voice, a change in an age group, a change in a voice frequency, etc.), and a sound volume corresponding to the category of the extracted semantic element Can be controlled. Specifically, for example, the meaning-based control unit 172a includes'!' and'!!!!!!!!' The sound volume or voice frequency of a unit text (eg, a sentence or one message of a messenger) including semantic elements classified in the'exclamation mark' category may be classified as a'exclamation mark' category. Accordingly, when reading a sentence containing an exclamation point, the smart doll 100 can read it aloud in a high tone.

Furthermore, the semantic-based control unit 172a may designate the level of the set value according to the level of each semantic element even if it corresponds to the same category. For example, the meaning-based control unit 172a may designate'ㅋ' as a first-stage semantic element of the'laugh' category, and designate'ㅋㅋㅋㅋㅋ' or higher as a second stage, and'ㅋㅋㅋㅋㅋㅋㅋㅋㅋㅋㅋㅋ' as three stages. In response to step information to which each semantic element is assigned, the meaning-based control unit 172a may also output the level of the output laughter sound effect as a first-stage laughter sound, a second-stage laughter sound, and a third-stage laughter sound.

Likewise, the semantic-based controller 172a may designate and apply a level of a sound volume to be changed, a level of a voice frequency, etc. in response to step information of a semantic element.

The format-based controller 172b may change a setting value of a reading operation in response to a data format of the content to be output.

According to an embodiment, the format-based controller 172b may determine and apply a setting value of a reading operation in response to a data format classified into image, audio, video, text, and the like. The format-based controller 172b may determine whether a conversion by a TTS program is required for a reading operation through a data format, and then perform a reading operation. For example, when performing a reading operation on a post in an SNS such as Instagram, the format-based control unit 172b provides a general method without a separate conversion operation for audio data that does not require TTS and a video containing audio. It can be controlled to perform the audio output function. On the other hand, the format-based controller 172b may perform a TTS reading operation on text data in a format capable of converting and outputting sound to TTS among posts.

Further, the format-based control unit 172b may differently set a setting value of the reading operation according to the type of an application previously linked to perform the reading operation. For example, SNS applications (eg Instagram posts) and portal news articles, instant messenger applications (eg, conversation content), e-books (children's fairy tales), the type of voice reading, reading speed, sound effect, sound volume, etc. The setting values of can be set differently.

Hereinafter, a description of the server 300 communicating with the smart doll 100 will be described.

5 is a diagram showing the configuration of a server according to an embodiment of the present invention.

The server 300 communicates with the smart doll 100 and the user terminal 200, and may provide target content and additional setting value information required for the smart doll 100 to perform a reading operation.

Although not shown in FIG. 5, it is obvious that the server 300 has a communication unit to communicate with the smart doll 100 and the user terminal 200, and can be configured to include a storage unit for storing output target data. A detailed description will be omitted.

As illustrated in FIG. 5, the server 300 may include an output target selection unit 301, an output target providing unit 302, and an AI support unit 303.

In an embodiment, the user may select an object (target application and content) to perform a reading operation through the smart doll 100 on an application of the user terminal 200. However, in addition to this, in various embodiments of the present disclosure, the user may select a target application to perform a reading operation and specific content belonging to a specific application through a voice command to the smart doll 100 instead of the user terminal 200. According to various embodiments of the present disclosure, the smart doll 100 may request the output target selection unit 301 of the server 300 to select an output target. For example, as the user receives the voice command “Read the webtoon” to the smart doll 100, the smart doll 100 transmits an output target selection request signal to the server 300 in order to select a webtoon that is the target of the reading operation. I can. In response, the output target selection unit 301 of the server 300 calculates a list of webtoons of interest of the user in response to the webtoon viewing record of the user terminal 200, selects and reads one webtoon among them, and text information included in the webtoon. Can be transferred to the 100 side of the smart doll.

As described above, the output target selection unit 301 may calculate the access frequency of a user's application and information on major interests based on log information of the user terminal 200, and calculate a list of contents to be read as a favorite. Accordingly, when a reading operation is requested while the target content for the reading operation is not determined, the output target selection unit 301 may randomly select a target content to perform the reading operation based on the user's favorite list. Accordingly, even if there is no separate specific command, if the user has a lifestyle in which he or she mainly performs the reading operation through the smart doll 100, the user can expect the effect that the corresponding operation is routineized and provided.

The output target providing unit 302 may provide an updated sound effect (including background sound), a voice, and other set values to the smart doll 100 side. According to various embodiments, various set value information additionally provided by the output target provider 302 may be provided conditionally in response to a paid payment.

When the server 300 is an integrated server with a content providing server, the server 300 may provide output target content such as pre-stored e-book data and webtoon data to the smart doll 100 side. However, when the content providing server and the server 300 are dualized, the output target providing unit 302 may access the content providing server to be output, collect the corresponding output target site, and then provide it to the smart doll 100 side.

The AI support unit 303 may support an AI analysis function to support a reading operation of image information.

The AI support unit 303 may calculate a background sound and a sound effect corresponding to image information (eg, SNS posts). According to the reading operation of the image information supported by the AI support unit 303, the smart doll 100 reads the post and the background sound corresponding to the image when the reading operation for images and posts posted on SNS such as Instagram Or sound effects can be output together. Likewise, when reading the contents of a messenger conversation, the conversation history may be output as a text-corresponding sound based on the TTS, and a background sound corresponding to the profile image information of the conversation partner may be output together.

delete

6 is a diagram illustrating an operation sequence of a smart doll according to an embodiment of the present invention.

As shown in FIG. 6, the reading operation of the smart doll according to the embodiment of the present invention may be initiated by operation 605 in which the user selects data to be output. The operation 605 may be an operation in which the user accesses an application for controlling the smart doll 100 in the user terminal 200 and selects data to be read operation (output). In addition, operation 605 may be a direct command input (eg, voice command) operation through the smart doll 100. In addition, data to be output may be selected by various methods described above.

Thereafter, the smart doll 100 may perform operation 610 of receiving the selected output target data. Thereafter, the controller 170 of the smart doll 100 may perform operation 615 of converting and outputting the content to be output into audio data. To this end, the smart doll 100 may have a built-in TTS program that converts text data into audio data.

Thereafter, the controller 170 may perform operation 620 of detecting an output setting value change event. When an event of changing the output setting value (the setting value of the reading operation) is not detected, the operation 620 or less may be omitted. The output setting value change event has been described above in the context-based control unit, the content-based control unit, and the AI support unit, and thus a detailed description thereof will be omitted.

In addition, the controller 170 may perform operation 625 of changing an output setting value in response to an output setting value change event detected in 620.

The operation of changing the setting value of the reading operation illustrated in FIG. 6 corresponds to one of various embodiments, and the setting value of the reading operation may be changed and applied at the time when an output target is selected based on the foregoing description.

Although the present invention has been described in detail with reference to the above-described examples, those skilled in the art can make modifications, changes, and modifications to these examples without departing from the scope of the present invention. In short, in order to achieve the intended effect of the present invention, it is not necessary to separately include all functional blocks shown in the drawings or to follow all the sequences shown in the drawings as shown in the order shown. Note that it may fall within the range.

100: Smart Doll
110: communication department
120: storage
130: input unit
140: audio processing unit
150: sensor unit
160: camera unit
170: control unit
171: context-based control unit
172: Content-based control unit
173: Character setting unit
200: user terminal
300: server

Claims (9)

In a smart doll that operates in conjunction with a user terminal and a server,
A communication unit that communicates with the user terminal and the server, and receives target content that is a target for performing a reading operation of converting and outputting text data into sound from at least one of the user terminal and the server;
A sensor unit provided in at least one area of the main body of the doll and sensing contact information applied by a user to the doll;
An audio processing unit for outputting audio data of the target content through a speaker;
Including; a control unit that detects a reading command for the target content, performs a reading operation on the target data, and controls a reading operation setting value according to detecting an output setting value change event; and
The control unit
Includes; a context-based control unit for controlling a reading operation setting value based on at least one of a user's motion and a surrounding situation
The context-based control unit
The type of contact is determined based on the user's contact information sensed by the contact sensor provided in at least one area of the smart doll, and the set value of the reading operation is controlled in response to the type of contact, but the contact type is detected through a sensor. Individual signal items and a combination of multiple signal items are classified as individual signal items. A touch-based control unit including whether or not a touch is accompanied by pressure;
A voice-based controller configured to control a reading operation setting value in response to a sound input including a user's voice command, an ambient noise level, and a specific command sound, and perform an operation of increasing an output sound volume of the reading operation as the ambient noise level increases; Including,
The target content is
Includes at least one of SNS posts, messenger conversations, Internet news articles, and e-books,
The reading operation setting value is
A smart doll performing a reading function, comprising at least one of an added background sound type, an added sound effect type, a sound volume, a reading speed, and a stop setting of a reading operation. delete delete The method of claim 1,
The context-based control unit
It includes a response-based control unit for collecting the user's response information and changing a reading operation setting value,
The reaction-based control unit
Including a sleep reaction in which the user's movement and voice are not detected for more than a preset time as the reaction information,
Smart doll performing a reading function, characterized in that controlling to stop the reading operation when the sleep reaction is detected. The method of claim 1,
The control unit
Including; a content-based control unit for controlling a set value of the reading operation in response to the characteristics of the target content,
The content-based control unit
And a semantic-based control unit configured to classify text included in the target content by emotion category according to a preset condition, and to output a sound effect corresponding to the category in which the text is classified; and performing a reading function, comprising: Smart doll. The method of claim 5,
The content-based control unit
A smart doll performing a reading function, comprising: a format-based control unit configured to differently set a setting value of the reading operation according to the type of the application previously linked to perform the reading operation. The method of claim 1,
The control unit
Change the output voice in proportion to the stage of usage of the smart doll, including the number and frequency of reading movements using the smart doll, but among the recorded voice sample items, the age group of the model that recorded the voice is low to the high item. Character setting unit that changes step by step; Smart doll for performing a reading function comprising a. The method of claim 1,
The server
An output target selection unit that calculates a user's application access frequency and major interest information based on the log information of the user terminal, and calculates a corresponding list of contents to be read as favorites;
An AI support unit that performs an AI analysis function for supporting the reading operation of image information; a smart doll performing a reading function, comprising: a.



delete

Images