KR102175751B1 - Watch type device for complementary alternative communication and method for providing complementary alternative communication using it - Google Patents

Abstract

Disclosed are a clock-type terminal for complementary and alternative communication, and a method for providing complementary and alternative communication using the same. The method for providing complementary and alternative communication using the clock-type terminal according to an embodiment of the present invention comprises the following steps: displaying a plurality of symbol icons on a screen of the clock-type terminal; and outputting a preset voice corresponding to a selected symbol icon by receiving a user input which selects one of the symbol icons.

Description

A watch-type terminal for complementary and alternative communication and a method of providing complementary and alternative communication using the same

The present application relates to a watch-type terminal for complementary and alternative communication and a method of providing complementary and alternative communication using the same.

In general, Augmentative and Alternative Communication (AAC) refers to a variety of forms of communication other than spoken (colloquial) used to reduce problems and promote language skills for people with difficulty in expressing. This includes both complementary and complete replacements for spoken language. In other words, complementary and alternative communication collectively refers to allowing people who have difficulty communicating through the way of speaking or writing to communicate what they want to say to others using gestures, photographs, and drawings.

In this complementary and alternative communication, symbols such as pictures and gestures are used, and auxiliary tools such as communication boards and communication tools with voices are often used. For example, a communication board or a communication book that allows a child who cannot speak by attaching a simple picture to a board or notebook to point out the necessary pictures to communicate.

However, the conventional communication board consists of a binder structure in which the communication board to which the symbol is attached is attached to the fastening ring, so that the symbol is often lost, and communication cannot be smoothly due to the loss of the symbol. There is a hassle of having to re-create it.

In addition, the user must be able to quickly select a symbol that suits the situation, and the task of opening the engagement ring and drawing out the communication board each time is cumbersome and difficult for the disabled, such as developmental disabilities and intellectual disabilities, which mainly utilize complementary and alternative communication. There were inconveniences in use, such as taking a long withdrawal time. In addition, since such a communication board is generally hard and heavy material is used, there is a problem that it is not easy to carry.

In addition, it is possible to consider a method of communicating using the portable terminal by installing an application linked to complementary and alternative communication on a portable terminal such as a smartphone, but the theft and damage of the portable terminal, the user's application download and continuous There was a limitation in that there were difficulties in management due to lack of update management ability. Moreover, portable terminals such as smartphones are not fixedly disposed, such as worn by the user or attached to a part of the user's body, but have a limit that is vulnerable to loss because the user must always carry and carry with care. In addition, conventional complementary and alternative communication-related applications have not been able to optimize symbols that can be provided through applications to suit the characteristics of users or provide a function for individual users to customize symbols.

The technology behind the present application is disclosed in Korean Patent Publication No. 10-1169249.

The present application is to solve the problems of the prior art described above, and by supporting complementary and alternative communication through a watch-type terminal that can be worn on the user's wrist, it is easy to carry, there is no fear of loss, as well as the characteristics of the user. It is an object of the present invention to provide a watch-type terminal for complementary and alternative communication that can reflect or display a plurality of symbols for complementary and alternative communication based on the user's selection, and a method of providing complementary and alternative communication using the same.

The present application is to solve the problems of the prior art described above, and an object thereof.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, a method for providing complementary and alternative communication using a watch-type terminal according to an embodiment of the present application includes the steps of displaying a plurality of symbol icons on the screen of the watch-type terminal, and the symbol It may include receiving a user input for selecting one of the icons, and outputting a preset voice corresponding to the selected symbol icon.

Further, the user input may include a bezel rotation input applied in a manner of rotating a bezel area of the watch-type terminal.

In addition, the method of providing complementary and alternative communication using a watch-type terminal according to an exemplary embodiment of the present application may include accumulating and storing the received details of the user input.

In addition, the displaying of the symbol icon may include determining a type of the symbol icon displayed based on the accumulated user input received details.

In addition, the method of providing complementary and alternative communication using a watch-type terminal according to an exemplary embodiment of the present disclosure may include deriving a symbol selection pattern for each time zone of the user based on the accumulated reception details of the user input.

In addition, the displaying of the symbol icon may include determining a type of the symbol icon displayed based on the current time information and the symbol selection pattern for each time zone.

In addition, the method for providing complementary and alternative communication using a watch-type terminal according to an embodiment of the present application includes an abnormal body state of the user based on the user's bio-signal measured from a bio-signal acquisition sensor provided in the watch-type terminal. If it is determined as a situation, it may include outputting a warning alarm and transmitting a warning notification signal to a user terminal previously linked with the watch-type terminal.

In addition, in the method for providing complementary and alternative communication using a watch-type terminal according to an embodiment of the present application, the user deviates from a preset location range based on the location information of the user obtained from a GPS sensor provided in the watch-type terminal. If it is determined that there is one, transmitting the location information to a user terminal previously linked with the clock-type terminal to output a warning alarm through the user terminal.

In addition, in the displaying of the symbol icon, when it is determined that the user has deviated from a preset location range, a preset symbol icon associated with the location range departure may be displayed.

In addition, the method of providing complementary and alternative communication using a watch-type terminal according to an exemplary embodiment of the present application may include setting a category icon including a plurality of the symbol icons.

In addition, the displaying of the symbol icon may include displaying the category icon on the screen of the watch-type terminal and when a user input for selecting the category icon is received, a plurality of symbol icons included in the category icon are displayed. It may include the step of displaying.

In addition, the method of providing complementary and alternative communication using a watch-type terminal according to an embodiment of the present application may include receiving learning information data from a user terminal previously linked with the watch-type terminal.

In addition, displaying the symbol icon may include determining a type of the symbol icon to be displayed based on the learning information data.

On the other hand, the watch-type terminal for providing complementary and alternative communication according to an embodiment of the present application receives a user input for selecting any one of the display module and the symbol icon to display a plurality of symbol icons, and A body portion including a sound output module for outputting a corresponding preset voice, and a strap portion connected to both sides of the body portion to fix the body portion to the user's body may be included.

In addition, the main body unit may determine the type of the symbol icon displayed on the display module based on a storage module that accumulates and stores the received details of the user input and the accumulated user input, or the accumulated user input A control module for determining the type of the symbol icon displayed on the display module based on the symbol selection pattern for each time zone and current time information by deriving a symbol selection pattern for each time zone of the user based on the reception details of .

In addition, the main body may include a sensor module including a biosignal acquisition sensor for measuring the user's biosignal and a GPS sensor for obtaining location information of the user.

In addition, when it is determined that the user has deviated from a preset location range based on the location information, the control module may cause the symbol icon displayed on the display module to include a preset symbol icon linked to the location range departure. Can be controlled.

In addition, the main body may include a communication module for transmitting and receiving data between the watch-type terminal and a user terminal previously linked.

In addition, the communication module may transmit a warning notification signal to the user terminal when it is determined as the abnormal situation, and may transmit the location information to the user terminal when it is determined that it is out of the preset location range.

In addition, when learning information data is received from the user terminal through the communication module, the control module may determine a type of the symbol icon displayed on the display module based on the learning information data.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-described problem solving means of the present application, by supporting complementary and alternative communication through a watch-type terminal that can be worn on the user's wrist, it is easy to carry, there is no fear of loss, and reflects the characteristics of the user or A watch-type terminal for complementary and alternative communication capable of displaying a plurality of symbols for complementary and alternative communication based on the selection of and a method of providing complementary and alternative communication using the same can be provided.

According to the above-described problem solving means of the present application, when a bio-signal acquisition sensor, a GPS sensor, etc. are mounted, when the user's physical condition is determined to be abnormal, when an emergency situation that may occur unexpectedly, such as when the user deviates from a predetermined location range This can be immediately notified to the linked user terminal, thereby promoting the safety of users such as children with developmental disabilities.

However, the effect obtainable in the present application is not limited to the effects as described above, and other effects may exist.

1 is a schematic configuration diagram of a system for providing complementary and alternative communication according to an embodiment of the present application.
2 is a conceptual diagram illustrating a category icon displayed on a screen of a watch-type terminal according to an embodiment of the present application.
3 is a conceptual diagram illustrating a symbol icon displayed on a screen of a watch-type terminal according to an embodiment of the present application.
4 is a schematic perspective view of a watch-type terminal for providing complementary and alternative communication according to an embodiment of the present application.
5 is a schematic configuration diagram of a main body of a watch-type terminal for providing complementary and alternative communication according to an embodiment of the present application.
6 is a flowchart illustrating a method for providing complementary and alternative communication using a watch-type terminal according to an embodiment of the present application.

Hereinafter, exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the present specification, when a part is said to be "connected" with another part, it is not only "directly connected", but also "electrically connected" or "indirectly connected" with another element interposed therebetween. "Including the case.

Throughout this specification, when a member is positioned "on", "upper", "upper", "under", "lower", and "lower" of another member, this means that a member is located on another member. It includes not only the case where they are in contact but also the case where another member exists between the two members.

Throughout the specification of the present application, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

The present application relates to a watch-type terminal for complementary and alternative communication and a method of providing complementary and alternative communication using the same.

1 is a schematic configuration diagram of a system for providing complementary and alternative communication according to an embodiment of the present application.

Referring to FIG. 1, a complementary and alternative communication providing system 10 according to an embodiment of the present application is a watch-type terminal 100 for providing complementary and alternative communication (hereinafter, referred to as'clock-type terminal 100'). .), may include a user terminal 200 and an integrated management server 300.

The watch type terminal 100, the user terminal 200, and the integrated management server 300 may communicate with each other through the network 20. The network 20 refers to a connection structure in which information exchange is possible between respective nodes such as terminals and servers, and examples of such a network 20 include a 3rd Generation Partnership Project (3GPP) network, and a Long Term Evolution) network, 5G network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area) Network), a wifi network, a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, and a Digital Multimedia Broadcasting (DMB) network, but are not limited thereto.

The user terminal 200 is, for example, a smart phone (Smartphone), a smart pad (SmartPad), a tablet PC, etc. and PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS ( Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal It can be any kind of wireless communication device.

In particular, the user terminal 200 may include a guardian terminal 210 held by a guardian (parent, nanny, guardian, etc.) of a user who performs complementary and alternative communication through the watch-type terminal 100. In addition, the user terminal 200 may include an instructor terminal 220 held by a person in charge of education (a homeroom teacher, a teacher in charge of a specific class, etc.) of the user in a special school to which the user belongs. In this regard, in the description of the embodiment of the present application described later, the term user terminal 200 may be understood to include at least one of the guardian terminal 210 and the instructor terminal 220. In other words, each step of the embodiment of the present application performed in connection with the user terminal 200 is performed by the guardian terminal 210 or the instructor terminal 220 as a subject, or the guardian terminal 210 and the instructor terminal 220 It may be that everyone is the subject and is performed.

The watch-type terminal 100 may display a plurality of symbolic icons on the screen of the watch-type terminal 100. Here, the screen of the watch type terminal 100 may be understood to mean the display module 111 to be described later.

In addition, according to an embodiment of the present application, the watch-type terminal 100 may set a category icon including a plurality of symbol icons. In addition, according to an exemplary embodiment of the present disclosure, the category icons may be layered in a plurality of stages. For example, the watch type terminal 100 may set a higher category icon including a plurality of category icons, each including a plurality of symbol icons. For example, the watch type terminal 100 may receive a customizing input for setting a category icon, and may determine a plurality of symbol icons or a plurality of category icons included in a predetermined category icon based on the received customizing input.

According to an embodiment of the present application, not only when a customizing input is applied to set a category icon including a plurality of symbol icons, but also a symbol icon displayed on the screen of the watch-type terminal 100 and/or a display between the category icons A user interlocked with the watch-type terminal 100 or the watch-type terminal 100 in order to determine the order (sort) or determine a symbol icon and/or a category icon displayed on the initial interface of the screen of the watch-type terminal 100 It may be applied to the terminal 200.

In other words, the watch-type terminal 100 may display at least one category icon on the screen of the watch-type terminal 100. In addition, when a user input for selecting a category icon is received, the watch-type terminal 100 displays a plurality of symbol icons (or a plurality of sub-category icons) included in the selected category icon on the screen of the watch-type terminal 100. It can work.

Here, the symbol icon and the category icon implicitly include the content associated with the symbol icon or category icon so that the user of the watch type terminal 100 can intuitively understand the content that the user can deliver through the symbol icon or category icon. It may be displayed on the screen of the watch-type terminal 100 in the form of an indicated text, picture, or pictogram.

In this regard, in the case of the watch-type terminal 100 such as a smart watch, the inventors of the present application generally have a limited display screen size compared to a device such as a smart phone, so that the symbol icon for supporting complementary and alternative communication Focusing on the difficulty of displaying all types on the screen of the watch-type terminal 100, a plurality of symbol icons are included, and a category icon that can reflect commonly applied contents of the plurality of symbol icons is set to When displaying on the screen of the type terminal 100 and applying a user input for selecting a predetermined category icon by the user, a plurality of symbol icons included in the category icon are displayed so that various contents can be displayed through a limited display screen. It is designed to provide communication.

2 is a conceptual diagram illustrating a category icon displayed on a screen of a watch-type terminal according to an embodiment of the present application.

Referring to FIG. 2, the watch type terminal 100 may display a plurality of category icons on the screen of the watch type terminal 100. Also, the watch-type terminal 100 may receive a user input A1 for selecting any one of a plurality of category icons. In addition, when a predetermined category icon is selected, the watch-type terminal 100 may display the representative name ('water') of the selected category icon in the center of the screen of the watch-type terminal 100 as shown in FIG. 2. However, it is not limited thereto.

According to an exemplary embodiment of the present disclosure, the user input A1 for selecting any one of a plurality of category icons may be a bezel rotation input applied in a manner of rotating the bezel area 130 of the watch-type terminal 100. In addition, according to an embodiment of the present application, the watch-type terminal 100 has a paging function so that the degree of rotation of the bezel region 130 by the user (eg, rotation angle displacement, rotation angular velocity, etc.) When it exceeds a preset level, it may operate to update at least some of the plurality of category icons currently displayed on the screen of the watch-type terminal 100.

3 is a conceptual diagram illustrating a symbol icon displayed on a screen of a watch-type terminal according to an embodiment of the present application.

Referring to FIG. 3, when a user input A1 for selecting one of a plurality of category icons is received, the watch-type terminal 100 receives a plurality of symbol icons included in the selected category icon ('please','dislike'). ,'Like', etc.) may be displayed on the screen of the watch-type terminal 100. In addition, the watch-type terminal 100 may receive a user input A2 for selecting any one of a plurality of symbol icons. In addition, according to the embodiment of the present application, even when a predetermined category icon is selected, another category icon that is not selected may be displayed on the screen of the watch-type terminal 100 together. For example, if the number of symbol icons included in the category icon selected based on the user input (A1) is less than a predetermined level, other category icons that are not selected in the remaining space on the screen of the watch type terminal 100 (for example, For example, referring to FIG. 3,'teacher','toilet', etc.) may be displayed together.

That is, the watch type terminal 100 may receive a user input for selecting any one of the symbolic icons. In this case, the watch-type terminal 100 may output a preset voice corresponding to the selected symbol icon based on the received user input. For example, referring to FIGS. 2 and 3, the user of the watch-type terminal 100 applies a user input (A1) for selecting a category icon corresponding to'water', and a symbol icon corresponding to'please' When the user input (A2) for selecting is applied, a voice of content corresponding to a symbolic icon such as'please water' may be output through the sound output module 112 of the watch-type terminal 100.

However, it is preferable to understand that the arrangement, arrangement, etc. of each symbol icon and each category icon displayed on the screen of the watch-type terminal 100 described above through FIGS. 2 and 3 are exemplary, and such an arrangement, The arrangement and the like may be variously determined according to the embodiments of the present application. For example, the number of symbol icons or category icons displayed based on the shape and area of the display module 111 of the watch type terminal 100 to which the present application is applied, and the shape and size of each symbol icon or category icon are required. It may be set in various ways according to, and as another example, the arrangement and arrangement method of each symbol icon and each category icon displayed on the screen of the watch-type terminal 100 can be determined by the selection of the user or the guardian of the user. It can also be implemented in a determined way (in other words, a customized way).

According to an exemplary embodiment of the present disclosure, the user input A2 for selecting any one of a plurality of symbol icons may be a bezel rotation input applied in a manner of rotating the bezel area 130 of the watch-type terminal 100. In addition, according to an embodiment of the present application, the watch-type terminal 100 has a paging function so that the degree of rotation of the bezel region 130 by the user (eg, rotation angle displacement, rotation angular velocity, etc.) When it exceeds a preset level, at least some of the plurality of symbol icons displayed on the screen of the current watch-type terminal 100 are operated to be updated, or the user can select a category icon other than the currently displayed category icon. It can operate to return to the screen displaying the category icon.

However, outputting the content corresponding to the symbol icon selected by the user through the watch-type terminal 100 is not limited to the above-described audio output method. As another example, when a user input (A1) for selecting one of the symbolic icons is applied by the user, the watch-type terminal 100 displays text corresponding to the symbolic icon in the display module 111 to be described later. It can be implemented to be output in relatively large letters to make it easier to check. This text output method is provided to enable communication with surrounding people through the watch-type terminal 100 of the present application even in places where it is difficult to communicate through voice (for example, places where quietness is required, such as a library or subway). Can be. According to an embodiment of the present application, the watch-type terminal 100 receives a separate user input for selecting an output method for the contents of the symbolic icon, and outputs an output method based on the received user input by voice output, text output, etc. It may be determined to provide the contents of the symbol icon.

In addition, even when at least one category icon including a plurality of symbol icons is displayed on the screen of the watch-type terminal 100, a user input for selecting a category icon and a user input for selecting a symbol icon are always sequentially applied. In addition, when a predetermined symbol icon is included in the initial screen of the watch-type terminal 100, only a user input for selecting the symbol icon is applied and a voice or text corresponding to the symbol icon may be output.

According to an embodiment of the present application, the user input applied to the watch type terminal 100 is applied by a touch input applied to the screen of the watch type terminal 100 and a method of rotating the bezel area of the watch type terminal 100. It may include at least one of the bezel rotation input.

Here, the bezel rotation input refers to a physical input method (hardware input method) applied by rotating a bezel part provided in a structure surrounding the outside of the display module 111 of the watch-type terminal 100 and within the display module 111. It may be understood to include a software input method applied through a touch input for rotating a bezel-shaped image formed and provided to rotate based on a touch input. In other words, the bezel area 130 for receiving a user input surrounds the outside of the display module 111 and recognizes the degree of physically rotating the bezel area 130 to determine whether to receive a user input. ) Or formed as a part of the display so that the touch input can be applied to the inside of the display area displayed by the display module 1110.

In addition, the watch-type terminal 100 may accumulate and store the reception details of a user input (a user input to select one of the category icons, a user input to select one of the symbol icons, etc.). In addition, the watch-type terminal 100 may determine the type of a symbol icon displayed on the screen of the watch-type terminal 100 based on the accumulated user input reception details. In other words, the watch-type terminal 100 may accumulate and count the number of times the user selects a predetermined symbol icon, and operate to preferentially display a symbol icon having a high selected number on the screen of the watch-type terminal 100. Accordingly, according to the exemplary embodiment of the present application, the watch-type terminal 100 may learn in advance an icon mainly used by a user and display a personalized symbol icon according to a learning result.

In addition, according to an embodiment of the present application, the watch-type terminal 100 may derive a symbol selection pattern for each time zone of the user based on the received details of the accumulated user input. In addition, the watch-type terminal 100 may determine a type of a symbol icon displayed on the screen of the watch-type terminal 100 based on the derived symbol selection pattern for each time zone and current time information. In other words, the watch-type terminal 100 may classify and analyze the reception details of the user input by time zone, and operate so that a symbol icon frequently selected in a specific time zone is displayed on the screen of the watch-type terminal 100 in the corresponding time zone.

Illustratively for better understanding, the watch-type terminal 100 determines that the characteristic time zone is meal time based on the received details of the accumulated user input, so that symbol icons related to food and meals are preferentially displayed on the screen in the corresponding time zone. It can work. As another example, the clock-type terminal 100 may determine that a specific time zone is a class time based on the accumulated user input reception history, and operate to preferentially display a symbol icon related to class content and teaching aids in the corresponding time zone. have.

In addition, according to an exemplary embodiment of the present disclosure, the watch-type terminal 100 may monitor the user's body condition based on the user's bio-signal measured from a bio-signal acquisition sensor provided in the watch-type terminal 100. The biosignal acquisition sensor may include, for example, a heart rate sensor, an acceleration sensor, a blood pressure sensor, etc., but is not limited thereto and may be provided to acquire various types of biosignals as needed.

In addition, when it is determined that the user's body condition identified based on the user's bio-signal is an abnormal condition, the watch-type terminal 100 transmits the communication module 116 to the user terminal 200 previously linked with the watch-type terminal 100. A warning notification signal can be transmitted through. In other words, the watch-type terminal 100 according to the exemplary embodiment of the present disclosure determines that the user's body condition, which is determined based on the user's bio-signal, is an abnormal situation, and the user terminal 200 previously linked with the watch-type terminal 100 ) (For example, the guardian terminal 210, etc.), the situation can be transmitted.

In addition, according to an exemplary embodiment of the present disclosure, the watch-type terminal 100 may monitor the user's location based on the user's location information acquired from a GPS sensor provided in the watch-type terminal 100.

In addition, when it is determined that the user has deviated from a preset location range based on the location information of the user acquired from the GPS sensor, the watch type terminal 100 may output a warning alarm through the sound output module 112. In addition, the watch-type terminal 100 communicates to the user terminal 200 previously linked with the watch-type terminal 100 when it is determined that the user is out of the preset location range based on the user's location information acquired from the GPS sensor. The current location information of the user identified through the module 116 may be transmitted. In addition, if the watch-type terminal determines that the user has deviated from the preset location range based on the user’s location information obtained from the GPS sensor, the watch-type terminal displays a preset symbol icon associated with the location range departure through the display module 111. It can work.

Here, the preset symbol icon associated with the departure from the location range may be, for example, a symbol icon corresponding to a voice of content such as'I'm lost', but is not limited thereto. In addition, according to an embodiment, the preset location range may be determined as a location range extended based on a predetermined allowable radius from a specific location, such as a location of a school where education for a user is performed, or a location of a user's residence. As another example, the preset location range may be determined based on a distance from the location of the user terminal 200 linked to the watch-type terminal 100 such as the guardian terminal 210 or the instructor terminal 220.

In addition, according to an embodiment of the present application, the watch-type terminal 100 may receive learning information data from the user terminal 200 previously linked with the watch-type terminal 100. Also, the watch-type terminal 100 may determine a type of a symbol icon displayed on the screen of the watch-type terminal 100 based on the received learning information data. Here, the learning information data may include, for example, information related to a class, an education program, etc., in which the user of the watch type terminal 100 participates. For example, the learning information data may include information related to class subjects, teaching aids, and class contents conducted in a class.

For better understanding, for example, a teacher who provides education and classes for users (for example, a teacher in charge of a special class) is a currency that can be used in the class if the content of the class on the day corresponds to a'product purchase class using money'. The corresponding learning information data may be transmitted to the student's watch type terminal 100 by using the instructor terminal 220 so that the symbolic icon corresponding to the card is displayed on the student's watch type terminal 100.

The clock-type terminal 100 of the present application is a user terminal 200 (e.g., a teacher terminal 220) that provides education for a user and a class. By receiving the associated learning information data and determining the type of the symbolic icon displayed on the screen of the watch-type terminal 100 based on the learning information data, it is possible to assist the user to easily learn in the corresponding class. . As described above, by using the watch-type terminal 100 of the present application, it is possible to facilitate effective instruction by facilitating communication between instructor-students in education and instruction for users having difficulty in general communication such as children with developmental disabilities.

The integrated management server 300 may receive and store user information of a user of the watch type terminal 100 from the watch type terminal 100 or the user terminal 200 interlocked with the watch type terminal 100. Here, the user information may include personal information including the user's gender, age, and place of residence, and the user's disability level information. According to an embodiment of the present application, the integrated management server 300 may match and store identification information (unique number, RFID tag, etc.) assigned to the watch-type terminal 100 with user information.

In addition, according to an embodiment of the present application, the integrated management server 300 is intended to interlock with the watch-type terminal 100 or the watch-type terminal 100 when the watch-type terminal 100 and the user terminal 200 are initially linked. It may be obtaining user information from the user terminal 200.

In addition, according to an embodiment of the present application, the integrated management server 300 acquires and stores the received details of the user input applied to the watch type terminal 100 stored in the storage module 113 from the watch type terminal 100 Can be managed. In addition, the integrated management server 300 may acquire, store and manage the customized input received details applied to the watch type terminal 100 from the watch type terminal 100. In this regard, when a specific user replaces the watch type terminal 100, the integrated management server 300 provides the previously stored user input reception details and the customized input reception details to the replaced watch type terminal 100 Thus, the personalization setting applied in the watch-type terminal 100 before replacement can be maintained in the replaced watch-type terminal 100 as well.

4 is a schematic perspective view of a watch-type terminal for providing supplementary and alternative communication according to an embodiment of the present application, and FIG. 5 is a schematic perspective view of a main body of a watch-type terminal for providing supplementary and alternative communication according to an embodiment of the present application. It is a schematic diagram.

In particular, FIG. 4A is a view for explaining the front part of the watch-type terminal 100, and FIG. 4B is a view for explaining the rear part of the watch-type terminal 100.

Referring to FIG. 4, the watch-type terminal 100 may include a main body 110 and a strap 120.

The main body 110 may display a plurality of symbol icons. In addition, the main body unit 110 may receive a user input for selecting any one of the symbol icons and output a preset voice corresponding to the selected symbol icon.

In addition, the strap unit 120 may be connected to both sides of the main unit 110 in order to fix the main unit 110 to the user's body.

In addition, referring to FIGS. 4 and 5, the main body 110 of the watch-type terminal 100 includes a display module 111, an audio output module 112, a storage module 113, a control module 114, A sensor module 115 and a communication module 116 may be included.

The display module 111 may display a plurality of symbol icons. In addition, according to the exemplary embodiment of the present disclosure, the display module 111 may be a flexible display in which at least a part of the display module is bent and deformable.

In addition, the display module 111 may receive a user input for selecting any one of the symbolic icons. Here, the user input may include at least one of a touch input applied to the screen of the display module 111 and a bezel rotation input applied in a manner of rotating the bezel area of the watch type terminal 100.

The sound output module 112 may output a preset voice corresponding to a symbol icon selected based on a user input.

The storage module 113 may accumulate and store the received details of the user input.

The control module 114 may determine the type of the symbol icon displayed on the display module 111 based on the received details of the user input accumulated in the storage module 113.

In addition, the control module 114 may derive a symbol selection pattern for each time zone of the user based on the received details of the user input accumulated in the storage module 113. Also, the control module 114 may determine the type of the symbol icon displayed on the display module 111 based on the derived symbol selection pattern for each time zone and current time information.

In addition, if the control module 114 determines that the user has deviated from the preset location range based on the location information of the user acquired through the GPS sensor 115b, the symbol icon displayed on the display module 111 is the location range. It can be controlled to include a preset symbol icon associated with departure.

In addition, when the learning information data is received from the user terminal 200 through the communication module 116, the control module 114 determines the type of the symbol icon displayed on the display module 111 based on the received learning information data. I can.

In addition, according to an embodiment of the present application, the control module 114 is a symbol icon displayed on the display module 111 based on the user's disability level information of the watch-type terminal 100 obtained from the integrated management server 300 You can decide the type of For example, the control module 114 prefers a symbol icon for supporting relatively simple communication as the user's failure severity is higher based on the user's disability level information of the watch-type terminal 100. On the contrary, the lower the user's failure severity is, the higher the user's failure severity is, the more advanced communication is supported.

The sensor module 115 may include a biosignal acquisition sensor 115a for measuring a user's biosignal and a GPS sensor 115b for acquiring location information of a user. In addition, referring to FIG. 4, at least one of the biosignal acquisition sensor 115a and the GPS sensor 115b may be provided on the rear surface of the main body 110 to allow contact with the user's body.

The communication module 116 may be provided for data transmission/reception between the user terminal 200 previously linked with the watch type terminal 100.

According to an embodiment of the present application, the communication module 116 is a user linked to the watch-type terminal 100 when it is determined that the user's body condition is an abnormal condition based on the biosignal acquired through the biosignal acquisition sensor 115a. A warning notification signal may be transmitted to the terminal 200.

In addition, if the communication module 116 determines that the user has deviated from a preset location range based on the user's location information acquired through the GPS sensor 115b, the user terminal 200 linked with the watch-type terminal 100 The location information can be transmitted to.

In addition, the communication module 116 may receive learning information data from the user terminal 200.

In addition, referring to FIG. 4, the main body 110 may include a charging module 117 for charging power for driving the watch-type terminal 100. For example, referring to FIG. 4, the charging module 117 may be provided in at least a partial area of the side portion of the main body 110, but is not limited thereto.

In addition, although not shown in the drawings, the body unit 110 according to the exemplary embodiment of the present disclosure may include a voice recognition module (not shown). The voice recognition module (not shown) may receive a voice language spoken by a talker who communicates with the user of the watch type terminal 100, interprets the received voice language, and converts the received voice language into text data. In this regard, the control module 114 may determine intention information of the spoken language spoken by the speaker through analysis of the converted text data. In addition, the control module 114 may control the symbol icon displayed on the display module 111 to include a symbol icon corresponding to the flow of conversation with the speaker based on the determined intention information of the speaker. As described above, the clock-type terminal 100 of the present application recognizes the intention of the speaker based on the STT (Speech to Text) technique from the speech of the speaker, and displays a symbol icon corresponding to the intention of the speaker on the display module 111 It is possible to support a user of the terminal 100 to perform a natural conversation with a talker.

Hereinafter, based on the details described above, the operation flow of the present application will be briefly described.

6 is a flowchart illustrating a method for providing complementary and alternative communication using a watch-type terminal according to an embodiment of the present application.

The method of providing complementary and alternative communication using the watch type terminal shown in FIG. 6 may be performed by the watch type terminal 100 described above. Therefore, even if omitted below, the description of the watch-type terminal 100 may be equally applied to the description of a method of providing complementary and alternative communication using a watch-type terminal.

Referring to FIG. 6, in step S610, the display module 111 may display a plurality of symbol icons on the screen of the watch-type terminal 100.

Next, in step S620, the watch type terminal 100 may receive a user input for selecting any one of the symbolic icons.

Next, in step S630, the sound output module 112 may output a preset voice corresponding to the selected symbol icon.

In addition, in step S641, the storage module 113 may accumulate and store the received details of the user input.

Next, in step S642, the control module 114 may derive a symbol selection pattern for each time zone of the user based on the accumulated user input reception details.

Further, although not shown in the drawing, prior to step S610 of displaying a plurality of symbolic icons on the screen of the watch-type terminal 100, the control module 114 performs the display module 111 based on the received details of the accumulated user input. Determining the type of symbol icon displayed in or derive a symbol selection pattern for each time zone of the user based on the received details of accumulated user input, and displayed on the display module 111 based on the symbol selection pattern for each time zone and current time information You can determine the type of symbolic icon to be used.

In the above description, steps S610 to S642 may be further divided into additional steps or may be combined into fewer steps, depending on the embodiment of the present application. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

The method of providing complementary and alternative communication using a watch-type terminal according to an exemplary embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the above-described method of providing complementary and alternative communication using a watch type terminal may be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present application.

10: Complementary and alternative communication provision system
100: Watch-type terminal for providing complementary and alternative communication
110: main body
111: display module
112: sound output module
113: storage module
114: control module
115: sensor module
116: communication module
120: strap portion
20: network
200: user terminal
300: Integrated management server

Claims (14)

In the method of providing complementary and alternative communication using a watch-type terminal,
Interlocking the watch-type terminal with a user terminal held by a guardian or instructor of the user of the watch-type terminal;
Receiving a customizing input through the watch-type terminal or the user terminal, and determining a plurality of symbol icons displayed on an initial interface of the screen of the watch-type terminal and a display order of the plurality of symbol icons;
Transmitting the received details of the customizing input to the integrated management server;
Displaying a plurality of symbol icons on the screen of the watch-type terminal;
Receiving a user input for selecting one of the symbolic icons; And
Outputting a preset voice corresponding to the selected symbol icon,
Including,
Displaying the symbolic icon,
If it is determined that the separation distance between the location of the watch-type terminal and the location of the user terminal is out of a preset range based on the location information obtained from the GPS sensor provided in the watch-type terminal, a symbol associated with the departure of the location range The steps to display the icon,
Including,
The step of performing the customization,
When the watch-type terminal is replaced, comprising receiving a reception detail of the customizing input from the integrated management server,
Displaying the symbolic icon,
A method for providing complementary and alternative communication, characterized in that displaying a plurality of customized symbolic icons. The method of claim 1,
The user input,
Complementary and alternative communication providing method comprising a bezel rotation input applied in a manner of rotating the bezel region of the watch-type terminal. The method of claim 2,
After receiving the user input,
Accumulating and storing the received details of the user input,
Including more,
Displaying the symbolic icon,
And determining the type of the symbolic icon displayed based on the accumulated user input received details. The method of claim 3,
After the accumulating and storing step,
Deriving a symbol selection pattern for each time zone of the user based on the accumulated user input received details,
Including more,
Displaying the symbolic icon,
And determining a type of the symbol icon displayed based on the symbol selection pattern for each time zone and current time information. The method of claim 1,
After the step of displaying the symbolic icon,
When the user's physical condition is determined to be an abnormal condition based on the user's biosignal measured from the biosignal acquisition sensor provided in the watch-type terminal, a warning alarm is output and a warning to the user terminal previously linked with the watch-type terminal Transmitting a notification signal,
The method of providing complementary and alternative communication further comprising. The method of claim 1,
After the step of displaying the symbol icon associated with the departure from the location range,
Transmitting the location information to a user terminal previously linked with the watch-type terminal to output a warning alarm through the user terminal,
The method of providing complementary and alternative communication further comprising. delete The method of claim 1,
The step of performing the customization,
Including the step of setting a category icon encompassing the plurality of symbol icons,
Displaying the symbolic icon,
Displaying the category icon on the screen of the watch type terminal; And
When a user input for selecting the category icon is received, displaying a plurality of the symbol icons included in the category icon,
That includes, a method of providing complementary and alternative communication. The method of claim 1,
Prior to the step of displaying the symbolic icon,
Further comprising the step of receiving learning information data from a user terminal previously linked with the watch type terminal,
Displaying the symbolic icon,
And determining the type of the symbolic icon displayed based on the learning information data. In a watch-type terminal for providing complementary and alternative communication,
A main body including a display module displaying a plurality of symbol icons and a sound output module receiving a user input for selecting one of the symbol icons and outputting a preset voice corresponding to the selected symbol icon; And
Strap portions connected to both sides of the main body to fix the main body to the user's body,
Including,
The body part,
A control module that determines a type of the symbolic icon displayed on the display module;
A sensor module including a GPS sensor that acquires location information of the user; And
A communication module for linking the watch-type terminal with a user terminal held by a guardian or instructor of the user of the watch-type terminal,
Including more,
The control module,
Performing customization to determine a display order of a plurality of symbol icons and the plurality of symbol icons displayed on the initial interface of the display module based on the customizing input received through the watch-type terminal or the user terminal, and the customization input Control so that the received details of
If it is determined that the separation distance between the location of the user and the location of the user terminal is out of a preset range based on the location information obtained from the GPS sensor, the symbol icon displayed on the display module is associated with the departure of the location range. Control to include the symbolic icon,
The communication module,
When the watch-type terminal is replaced, receiving details of reception of the customizing input from the integrated management server,
The display module,
A clock terminal, characterized in that displaying a plurality of customized symbol icons. The method of claim 10,
The body part,
A storage module that accumulates and stores the received details of the user input,
Including more,
The control module,
The symbol for each time zone is determined by determining the type of the symbol icon displayed on the display module based on the accumulated user input reception history or by deriving a symbol selection pattern for each time zone of the user based on the accumulated user input reception history To determine the type of the symbol icon displayed on the display module based on the selection pattern and current time information. delete The method of claim 11,
The sensor module,
Further comprising a bio-signal acquisition sensor for measuring the bio-signal of the user,
The communication module,
When the user's physical condition is determined to be an abnormal condition based on the bio-signal, a warning notification signal is transmitted to the user terminal,
When it is determined that the preset location range is deviated, the location information is transmitted to the user terminal. The method of claim 13,
The control module,
When learning information data is received from the user terminal through the communication module, the type of the symbol icon displayed on the display module is determined based on the learning information data.

Images