KR20190121603A - Concentration mode according to time, place and condition of setted schedule of child in wearable device - Google Patents

Abstract

Provided is a technology of an automatic concentration mode in a wearable device in accordance with time and place conditions of a set schedule of children. According to one embodiment of the present invention, by referring to schedule information of a place, time, and/or condition information, a concentration mode can be set only when the corresponding conditions are all satisfied.

Description

CONCENTRATION MODE ACCORDING TO TIME, PLACE AND CONDITION OF SETTED SCHEDULE OF CHILD IN WEARABLE DEVICE}

The following descriptions are based on the time of the setting schedule of the child, the automatic concentration mode in the wearable device according to the place condition, the interface for displaying the text in the recording message when the voice recording message is transmitted, the method of selecting the user context based positioning method efficiently, and the screen are turned on. The present invention relates to a technique for minimizing current consumption by processing a keyword spotting operation only when there is one.

Conventionally, the concentrated mode is set directly in the guardian app managing a child's device or the concentrated mode is set according to a time condition.

Intensive mode setting method that can set the concentrated mode only when all the conditions are satisfied by referring to the location, time and / or condition information among the schedule information of the child, a computer device for performing the concentrated mode setting method, combined with a computer A computer program stored in a computer readable recording medium and the recording medium for causing the computer to execute the concentrated mode setting method are provided.

Upon receiving the recorded message, an information output method for automatically viewing the contents converted into text through STT (Speech To Text), a computer device for performing the information output method, combined with a computer, and the computer outputs the information output method. A computer program stored on a computer readable recording medium and the recording medium are provided for execution.

Location accuracy (eg, GPS, WiFi, base station) in the terminal with a small battery capacity, such as trackers and wearable devices to select the most effective method according to the user's actual mobile context (location), positioning accuracy and coverage (coverage) Location selection method, a computer device performing the location selection method, a computer stored in a computer readable recording medium in combination with a computer to execute the location selection method in a computer. Provide a program and a recording medium thereof.

Only when the screen is on, keyword spotting in the sensor hub (for example, trigger through voice such as clova, saliya, and okidoki) operates. A speech recognition method capable of minimizing quiescent current, a computer device for performing the speech recognition method, a computer program coupled to a computer and stored in a computer readable recording medium for executing the speech recognition method on a computer, and a recording medium thereof do.

It provides a concentrated mode setting method comprising the step of setting the concentrated mode.

The centralized mode can be set only when all the conditions are satisfied by referring to the place, time and / or condition information among the schedule information of the child.

When you receive the recorded message, you can automatically view the contents converted to text through STT (Speech To Text).

Location accuracy (eg, GPS, WiFi, base station) in the terminal with a small battery capacity, such as trackers and wearable devices to select the most effective method according to the user's actual mobile context (location), positioning accuracy and coverage (coverage) ) As high as possible and current consumption can be minimized.

Only when the screen is on, keyword spotting in the sensor hub (for example, trigger through voice such as clova, saliya, and okidoki) operates. Standby current can be minimized.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
2 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention.
3 to 6 are diagrams showing examples of a dialog tab UI according to an embodiment of the present invention.
7 is a diagram illustrating a moving state context engine and a location provider according to one embodiment of the present invention.
8 is a flowchart illustrating an example of a positioning method selection method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings.

The concentrated mode setting method, the information output method, the positioning method selection method and / or the voice recognition method according to the embodiments of the present invention may be implemented through at least one computer device such as an electronic device and / or a server which will be described later. . In this case, the computer device may be installed and run a computer program according to an embodiment of the present invention, the computer device is a concentrated mode setting method, an information output method according to embodiments of the present invention under the control of the driven computer program , Location selection method and / or speech recognition method. The above-described computer program may be stored in a computer-readable recording medium in combination with a computer device to execute a concentrated mode setting method, an information output method, a positioning method selection method, and / or a voice recognition method in a computer.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 illustrates an example including a plurality of electronic devices 110, 120, 130, and 140, a plurality of servers 150 and 160, and a network 170. 1 is an example for describing the present invention, and the number of electronic devices or the number of servers is not limited as shown in FIG. 1. In addition, the network environment of FIG. 1 merely illustrates an example of one of the environments applicable to the embodiments, and the environment applicable to the embodiments is not limited to the network environment of FIG. 1.

The plurality of electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals implemented as computer devices. Examples of the plurality of electronic devices 110, 120, 130, and 140 include a smart phone, a mobile phone, a navigation device, a computer, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), and a portable multimedia player (PMP). Tablet PC). For example, although FIG. 1 illustrates the shape of a smart phone as an example of the electronic device 1 110, in the embodiments of the present invention, the electronic device 1 110 may use a wireless or wired communication method to substantially connect the network 170. It may mean one of various physical computer devices that can communicate with other electronic devices 120, 130, 140 and / or servers 150, 160.

The communication method is not limited, and may include not only a communication method using a communication network (for example, a mobile communication network, a wired internet, a wireless internet, a broadcasting network) that the network 170 may include, but also a short range wireless communication between devices. For example, the network 170 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). And one or more of networks such as the Internet. The network 170 may also include any one or more of network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, trees, or hierarchical networks, but It is not limited.

Each of the servers 150 and 160 communicates with the plurality of electronic devices 110, 120, 130, and 140 through the network 170 to provide a command, code, file, content, service, or the like. It may be implemented in devices. For example, the server 150 may serve as a plurality of electronic devices 110, 120, 130, and 140 connected through the network 170 (for example, financial services, payment services, social network services, messaging services, Search service, mail service, content providing service, artificial intelligence service, voice recognition service, etc.).

2 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention. Each of the plurality of electronic devices 110, 120, 130, and 140 or each of the servers 150 and 160 described above may be implemented by the computer device 200 illustrated in FIG. 2. The product recommendation method may be performed by a product recommendation system implemented by such a computer device 200.

As illustrated in FIG. 2, the computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240. The memory 210 may be a computer-readable recording medium, and may include a permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. In this case, the non-volatile mass storage device such as a ROM and a disk drive may be included in the computer device 200 as a separate permanent storage device separate from the memory 210. In addition, the memory 210 may store an operating system and at least one program code. These software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such a separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD / CD-ROM drive, memory card, and the like. In other embodiments, the software components may be loaded into the memory 210 via the communication interface 230 rather than the computer readable recording medium. For example, software components may be loaded into memory 210 of computer device 200 based on a computer program installed by files received via network 170.

The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, the processor 220 may be configured to execute a command received according to a program code stored in a recording device such as the memory 210.

The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (eg, storage devices described above) through the network 170. For example, a request, a command, data, a file, etc. generated by the processor 220 of the computer device 200 according to a program code stored in a recording device such as the memory 210 may be controlled according to the control of the communication interface 230. 170 may be transferred to other devices. Conversely, signals, commands, data, files, and the like from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. Signals, commands, data, and the like received through the communication interface 230 may be transmitted to the processor 220 or the memory 210, and the files and the like may be further included in the storage medium (described above). Persistent storage).

The input / output interface 240 may be a means for interfacing with the input / output device 250. For example, the input device may include a device such as a microphone, a keyboard or a mouse, and the output device may include a device such as a display or a speaker. As another example, the input / output interface 240 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 250 may be configured as the computer device 200 and one device.

In addition, in other embodiments the computer device 200 may include fewer or more components than the components of FIG. 2. However, it is not necessary to clearly show most of the prior art components. For example, the computer device 200 may be implemented to include at least some of the input and output devices 250 described above, or may further include other components such as a transceiver, a database, and the like.

1. [Automatic concentration mode in wearable device according to time and place condition of child's setting schedule]

1) Overview of the invention: Automatically switch to the concentrated mode according to the child's schedule-time and place-to prevent the situation that can be disturbed

2) Difference from the prior art

-Prior art: Set the intensive mode directly or set according to the time condition in the guardian app managing the child's device

-Problems of the prior art and problems of the invention:

[Problem]

-Requires parental setting each time

-In case of a time condition, it may be set in a situation where the mode does not need to be set according to a different school or schedule according to the day of the week.

-If there is a place condition, the place may be misplaced

[solution]

-Set the concentrated mode only when all the conditions are satisfied by referring to the place and time information of the child's schedule information

3) Detailed description of the invention:

Intensive mode is a function that restricts the main functions by activating the situation where the child should not be disturbed in the school / academy while using the wearable device. The guardian can set the child's daily schedule-such as school / institute-for the first time and can automatically set the concentration mode after setting. If the intensive mode is set automatically, it will be set if it is located at the corresponding time according to the time and place condition registered as the schedule. If any of the conditions are not met, the mode can be released. When the concentrated mode is set, all functions such as phone / message are unavailable, but only the guardian's phone is available. If the guardian sends a call / message to the child without knowing the intensive mode setting status, the guardian will be informed.

2. [Interface regarding the display of texts in recorded messages when sending voice recording messages]

1) Outline of the Invention: Interface that allows the sender / receiver to see the message converted to text when the voice recording message is transmitted

2) Difference from the prior art

-Prior art: only the recorded message is transmitted when the voice recording message is transmitted

-Problems of the prior art and problems of the invention:

[problem]

-Recipient must play when sending recorded message

[solution]

-When you receive a recorded message, you can automatically view the contents converted to text through Speech To Text (STT).

3) Detailed description of the invention:

In a parent-child relationship, a voice recording message can be sent from each device to allow parents to play and listen to the recorded message, but the text can be viewed in the office or when it is difficult to play indoors. In the case of STT, the recognition rate is increased by learning the pattern of conversation that can be much from the dialogue between parents and children, and then recognizing it in the form of conversation with high possibility. In addition, if the slang and adult-related phrases are recognized in the message that has been converted to STT, the contents may be hidden or replaced with other similar words.

Senders of voice recordings can see how their messages are converted, and texts that are likely to be in error when trying to correct them are displayed and can be selected from candidate words / phrases with a simple tab. .

[theorem]

-STT contents of voice recording message sent / received within speech bubble

-Increased recognition rate according to conversation type of specific use target such as parent-child during STT

-Filtering profanity / adult words, etc. in STT

-Sender checks STT content and suggests corrected words

3 to 6 are diagrams showing examples of a dialog tab UI according to an embodiment of the present invention. 3 and 4 illustrate a conversation tab UI (User Interface) with a person, and FIGS. 5 and 6 illustrate a conversation tab UI representing a bot message type, respectively.

3. [Effective Selection Method for Positioning Method Based on User Context]

1) Summary of the Invention: In a terminal with a small battery capacity such as a tracker and a wearable device, various positioning methods (GPS (Global Positioning System), WiFi, base station) have the highest effect according to the user's actual mobile context. By making a selection, it is an object of the present invention to maximize positioning accuracy and coverage and minimize current consumption.

Accuracy is high in order of GPS> WiFi> base station, coverage is WiFi = base station> GPS because GPS is not available indoors, and current consumption is base station based WiFi in order of base station> WiFi> GPS. Consumes less current.

In general, the purpose of using a tracker or wearable device is to determine the exact location. Therefore, if the GPS is used outdoors and the WiFi / base station location is automatically selected, the highest user satisfaction can be obtained. The present embodiments propose a method for this.

2) Difference from the prior art

-Prior art: Conventional location trackers and location-oriented wearable devices (e.g. kids phones, pet trackers, etc.) are designed with a small capacity due to their small size and are designed to reduce current consumption.

As a result, WiFi-based positioning system (WPS) or base station-based positioning method (WPS), which has high accuracy when requesting positioning but consumes a lot of current and has characteristics opposite to GPS, which cannot be used indoors. System, hereinafter CPS).

The problem is that in case of WPS and CPS method, the error is larger than GPS and it is influenced by the quality of positioning service server, so it is often impossible to specify the exact location, so it is possible to use GPS / WPS / CPS at the same time. It offers the option to choose between current priority, or measures satellite signal strength to determine whether to perform GPS positioning.

-Problem of the prior art and problem solving method of the invention: When using multiple positioning methods (GPS / WPS / CPS) at the same time, it is necessary to use several modules (GPS, WiFi, modem, etc.) at the same time, so the current consumption increases and the most Since the result of successful positioning is used first, the response is fast, but the positioning is based on WPS / CPS with low accuracy.

Also, letting the user choose between accuracy and current consumption is not a solution to the underlying problem, but rather a delegation of responsibility. The method of measuring satellite signal strength also requires additional current consumption since the GPS module must be driven at every positioning. There is a problem.

Embodiments of the present invention provide a positioning method suitable for the current user without additional current consumption because it operates based on the movement or retention state calculated on the basis of the previous movement history of the user.

3) Detailed description of the invention:

Embodiments of the present invention in response to the module responsible for the context management associated with the user's movement (Move State Context Engine) so as to automatically change the positioning method according to the movement situation If it is determined that the user is moving with a module (Location Provider) that controls the actual positioning method, the positioning is performed with GPS priority, and if it is determined that the user is stationary, WPS / CPS priority positioning is performed.

According to this method, it is used with high accuracy GPS mode when moving outdoors and WPS / CPS positioning automatically when indoors, allowing the device to be optimized for both accuracy and current consumption.

The Move State Context Engine compares the current state with previous states to determine if the user and the device are moving or staying in one place. At this time, the movement and the staying state can be determined using a change in the distance between the movements or the peripheral external factors (for example, RF signal strength, other wireless devices, brightness through the illumination sensor). The module may be internal or external to the device.

The location provider has a role of determining the positioning method in the device and performs the positioning directly according to the selected positioning method according to the current situation or requests a separate module to be finally delivered to the module showing the current location to the user. To control.

The determination of whether to move is based on the information when the distance traveled for a unit time exceeds a certain threshold (ex. 100m), when the WiFi AP or other surrounding RF environment changes, when a sensor-detected movement is determined to be walking, or when the vehicle is moved. It is determined by a comprehensive judgment algorithm.

7 is a diagram illustrating a moving state context engine and a location provider according to an embodiment of the present invention, and FIG. 8 is a flowchart illustrating an example of a positioning method selection method according to an embodiment of the present invention.

4. [Minimize current consumption by keyword spotting only when screen is on]

In embodiments of the present invention, keyword spotting in a sensor-hub only when the screen of the electronic device is turned on (eg, ex. Clova, Sally). The present invention provides a voice recognition method capable of minimizing standby current by operating a trigger through a voice recognition-based artificial intelligence service such as Oki Doki.

As described above, according to embodiments of the present invention, the concentration mode may be set only when all the conditions are satisfied by referring to the place, time, and / or condition information of the child's schedule information. In addition, when the recorded message is received, contents that are automatically converted into text through STT (Speech To Text) can also be viewed. In addition, by positioning a variety of positioning methods (GPS, WiFi, base station) in the terminal with a small battery capacity, such as trackers and wearable devices according to the user's actual mobile context (location), positioning accuracy and coverage The maximum coverage and the current consumption can be minimized. In addition, keyword spotting in a sensor hub (eg, a trigger through voices such as clova, saliya, and okodoki) operates only when the screen is on. The standby current can be minimized.

The system or apparatus described above may be implemented as a hardware component or a combination of hardware components and software components. For example, the devices and components described in the embodiments are, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable gate arrays (FPGAs). Can be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and configure the processing device to operate as desired, or process it independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. It can be embodied in. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The medium may be to continue to store a computer executable program, or to temporarily store for execution or download. In addition, the medium may be a variety of recording means or storage means in the form of a single or several hardware combined, not limited to a medium directly connected to any computer system, it may be distributed on the network. Examples of the medium include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And ROM, RAM, flash memory, and the like, configured to store program instructions. In addition, examples of another medium may include a recording medium or a storage medium managed by an app store that distributes an application, a site that supplies or distributes various software, a server, or the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the following claims.

Claims (1)

Steps to Set Focus Mode
Concentration mode setting method comprising a.

Images