KR102011036B1 - Method and system for voice control of notifications - Google Patents

Abstract

Disclosed are a voice manipulation method and system for notification. A notification voice manipulation method of a notification voice manipulation system implemented by a computer may include: outputting a notification screen including notification contents when a notification is received; And when the notification is a notification requiring a user response, activating a voice recognition function for receiving the user response as a voice command while the notification screen is output.

Description

METHOOD AND SYSTEM FOR VOICE CONTROL OF NOTIFICATIONS}

The description below relates to techniques for handling user operations on notifications.

Recently, with the development of data processing speed, the improvement of the wireless data communication speed and the continuous development of the global positioning system (GPS), the navigation system using these technologies intensively is widely used and widely used.

In general, a navigation system digitalizes geographic information or map information for guiding a destination and stores it in a storage means, and GPS, that is, a satellite navigation system that receives signals from a plurality of satellites and calculates a current location of a user. Recognizing the current location through the same location recognition means, and matching the stored geography / map information on the basis of the recognized current location to guide the way to the destination to help find the way.

Navigation systems are typically used in cars to send information, such as location and nearby maps, and to inform users of the route or shortest distance to their destination.

Recently, a navigation system including an MP3 and a video player as well as a terrestrial DMB receiving device has been developed. Furthermore, a navigation system has been implemented in a portable terminal based on devices provided in a portable terminal such as a smartphone.

The navigation system supports various voice guidance functions to ensure the driver's safe driving and convenience. For example, Korean Patent Laid-Open Publication No. 10-1999-0047060 (published July 05, 1999) discloses a vehicle that allows a driver to output a description of an abnormal state of a vehicle by voice when an abnormal state of a vehicle occurs. Disclosed are a problem occurrence voice notification device and a method of controlling the same.

A method and system are provided that can trigger a voice command for a notification requiring a user response.

The present invention provides a method and system for automatically activating a voice recognition capable state during a time when a notification is displayed to operate by voice command on the notification.

The present invention provides a method and system for guiding voice commands that can be input in the voice recognition function activated during the notification display time.

The present invention provides a method and system for recognizing voice commands within a category by defining a voice recognition category using phrases of an option included in the notification.

A notification voice manipulation method of a notification voice manipulation system implemented by a computer, the method comprising: outputting a notification screen including notification contents when a notification is received; And activating a voice recognition function for receiving the user response as a voice command while the notification screen is output when the notification is a notification requiring a user response.

According to an aspect, the outputting may include displaying the notification screen and simultaneously outputting the notification contents through voice to text (TTS).

According to another aspect, the outputting step may output the selection text of the action button included in the notification screen that can be input in response to the user's response while displaying the notification screen.

According to another aspect, the outputting step may be output by dividing the notification type according to the type of the notification.

According to another aspect, the outputting may be performed by dividing the type of the notification into a notification for which the user response is required and the remaining notification, and outputting at least one of a visual element and an audio element according to the type of the notification. Can be.

According to another aspect, in the activating step, the voice command function may recognize a voice command that matches an option phrase of an action button included in the notification screen.

According to another aspect, the activating may include: setting a voice recognition category by using an option phrase of an action button included in the notification screen; And recognizing a voice command corresponding to the voice recognition category through the voice recognition function.

According to another aspect, the setting may include setting a sentence set having semantic similarity to the option phrase as the speech recognition category.

According to another aspect, the notification screen includes at least one action button that can be input in response to the user response, and displaying the action button corresponding to the voice command recognized through the voice recognition function distinguished from the other action buttons It may further include.

According to another aspect, the method may further include canceling a previously recognized voice command when a voice command corresponding to a cancellation command is recognized through the voice recognition function while the notification screen is output.

A computer program recorded on a computer readable recording medium for executing a notification voice manipulation method, the notification voice manipulation method comprising: outputting a notification screen including a notification content when a notification is received; And activating a voice recognition function for receiving the user response as a command in a voice form while the notification screen is output when the notification is a notification requiring a user response. Provide a computer program.

A computer-implemented notification voice manipulation system, comprising: at least one processor configured to execute a computer readable instruction, wherein the at least one processor outputs a notification screen including notification contents when the notification is received. A notification output control unit; And a voice recognition controller for activating a voice recognition function for receiving the user response as a command in the form of a voice while the notification screen is output when the notification is a notification requiring a user response. .

According to an embodiment of the present invention, a voice command may be triggered for a specific notification, for example, a notification requiring a user response.

According to an embodiment of the present invention, the voice recognition capable state is automatically activated during the time when the notification is displayed, and the voice command can be directly manipulated for the notification.

According to an exemplary embodiment of the present invention, the voice command that is activated during the notification display time may be guided so that the voice command may be easily issued even if the user does not recognize the voice command.

According to an exemplary embodiment of the present invention, the voice command may be recognized within the corresponding category by limiting the voice recognition category using the phrase of the option included in the notification, thereby improving the voice recognition rate.

1 is a block diagram illustrating an example of an internal configuration of a computer system according to an embodiment of the present invention.
2 illustrates an example of components that may be included in a processor of a computer system according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating an example of a notification voice manipulation method that may be performed by a computer system according to an exemplary embodiment.
4 is a flowchart illustrating an example of a speech recognition process according to an embodiment of the present invention.
5 to 9 are exemplary views for explaining a notification screen in one embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention relate to a technique for processing a user operation for a notification, and more particularly, a voice command for a notification by automatically activating a voice recognition function for a time when the notification is displayed for a notification requiring a user response. A method and system that can be operated.

Embodiments, including those specifically disclosed herein, may implement techniques that can directly manipulate voice for notifications that require user response, thereby providing significant benefits in terms of convenience, efficiency, accuracy, cost savings, and the like. Achieve the advantages.

1 is a block diagram illustrating an example of an internal configuration of a computer system according to an embodiment of the present invention. For example, the notification voice manipulation system according to embodiments of the present invention may be implemented through the computer system 100 of FIG. 1. As shown in FIG. 1, the computer system 100 is a component for executing a notification voice manipulation method, and includes a processor 110, a memory 120, a persistent storage device 130, a bus 140, and an input / output interface ( 150 and network interface 160.

Processor 110 may include or be part of any device capable of processing a sequence of instructions. Processor 110 may include, for example, a processor within a computer processor, mobile device or other electronic device, and / or a digital processor. The processor 110 may be included in, for example, a server computing device, a server computer, a series of server computers, a server farm, a cloud computer, a content platform, a mobile computing device, a smartphone, a tablet, a set top box, a media player, and the like. The processor 110 may be connected to the memory 120 through the bus 140.

Memory 120 may include volatile memory, permanent, virtual, or other memory for storing information used by or output by computer system 100. The memory 120 may include, for example, random access memory (RAM) and / or dynamic RAM (DRAM). Memory 120 may be used to store any information, such as status information of computer system 100. Memory 120 may also be used to store instructions of computer system 100, including, for example, instructions for controlling notification voice manipulation. Computer system 100 may include one or more processors 110 as needed or where appropriate.

Bus 140 may include a communication infrastructure that enables interaction between various components of computer system 100. Bus 140 may carry data between components of computer system 100, for example, between processor 110 and memory 120. Bus 140 may include wireless and / or wired communication media between components of computer system 100 and may include parallel, serial, or other topology arrangements.

Persistent storage 130 is a component, such as a memory or other persistent storage, such as used by computer system 100 to store data for some extended period of time (eg, relative to memory 120). Can include them. Persistent storage 130 may include non-volatile main memory as used by processor 110 in computer system 100. Persistent storage 130 may include, for example, flash memory, hard disk, optical disk, or other computer readable medium.

The input / output interface 150 may include interfaces for a keyboard, mouse, voice command input, display, or other input or output device. Input relating to configuration commands and / or alert voice manipulation may be received via the input / output interface 150.

Network interface 160 may include one or more interfaces to networks such as a local area network or the Internet. Network interface 160 may include interfaces for wired or wireless connections. Configuration commands may be received via network interface 160. In addition, the information related to the notification may be received or transmitted through the network interface 160.

In addition, in other embodiments, computer system 100 may include more components than the components of FIG. 1. However, it is not necessary to clearly show most of the prior art components. For example, the computer system 100 may be implemented to include at least some of the input / output devices connected to the input / output interface 150 described above, or may include a transceiver, a global positioning system (GPS) module, a camera, various sensors, It may further include other components such as a database. As a more specific example, when the computer system 100 is implemented in the form of a mobile device such as a smartphone, an acceleration sensor, a gyro sensor, a camera, various physical buttons, a button using a touch panel, Various components, such as an input / output port and a vibrator for vibration, may be implemented to be further included in the computer system 100.

In a recent driving environment, a voice agent generally outputs a received notification as a voice and a user inputs a voice command by operating a voice input button (for example, a microphone button) for a subsequent action. However, when all interactions are made by voice, the user is inconvenient to be aware of an inputable command in advance, and in the case of a vehicle model having no microphone button for in-vehicle voice commands, it is difficult to use.

In the present embodiment, only the time when the notification screen is outputted so that the user can immediately perform a voice action on the notification occurring while driving, the voice recognition function is automatically switched and the voice command is displayed on the notification screen so that the voice is not recognized by the user. Encourage them to issue orders easily.

In the present specification, the notification provided to the driving environment is described, but the present invention is not limited thereto, and the present disclosure may be applied to any system or environment that requires notification to the user.

FIG. 2 is a diagram illustrating an example of components that a processor of a computer system according to an embodiment of the present invention may include, and FIG. 3 is a notification voice that may be performed by the computer system according to an embodiment of the present invention. It is a flowchart which shows the example of an operation method.

As shown in FIG. 2, the processor 110 may include a notification output controller 210, a voice recognition controller 220, and a function execution unit 230. The components of such a processor 110 may be representations of different functions performed by the processor 110 in accordance with a control instruction provided by at least one program code. For example, the notification output controller 210 may be used as a functional representation that the processor 110 operates to control the computer system 100 to output the notification. The processor 110 and the components of the processor 110 may perform steps S310 to S340 included in the notification voice manipulation method of FIG. 3. For example, the processor 110 and the components of the processor 110 may be implemented to execute instructions according to the code of the operating system included in the memory 120 and the at least one program code described above. Here, the at least one program code may correspond to a code of a program implemented to process the notification voice manipulation method.

The notification voice manipulation method may not occur in the order shown, and some of the steps may be omitted or an additional process may be further included.

In operation S310, the processor 110 may load the program code stored in the program file for the notification voice manipulation method into the memory 120. For example, the program file for the notification voice manipulation method may be stored in the persistent storage device 130 described with reference to FIG. 1, and the processor 110 may store the program file stored in the persistent storage device 130 through a bus. Computer system 110 may be controlled such that program code is loaded into memory 120. In this case, each of the processor 110 and the notification output controller 210, the voice recognition controller 220, and the function execution unit 230 included in the processor 110 may correspond to a corresponding portion of the program code loaded in the memory 120. It may be different functional representations of the processor 110 for executing the instructions to execute the subsequent steps S320 to S340. In order to execute the steps S320 to S340, the processor 110 and the components of the processor 110 may directly process an operation according to a control command or control the computer system 100.

In operation S320, when the notification is received, the notification output controller 210 may output a notification screen including the notification contents and output the notification contents by voice. For example, the notification output controller 210 may display a notification screen at a time point at which a notification is received and read the notification content as text to speech (TTS). In this case, the notification output control unit 210 may maintain the notification pop-up for a predetermined time. The setting time may include a time required for outputting the notification contents by voice. As another example, the notification pop-up may be maintained for a predetermined time after the end of the process of outputting the notification contents by voice. In addition to the received notification, when an event requiring notification in the computer system 100 is detected, it is also possible to provide a notification screen related to the event.

The notification output control unit 210 may classify and display the notification type according to the type of the notification. For example, the notification output controller 210 may distinguish and display a first notification that requires a user response and a second notification that does not require a user response. In this case, the first notification may refer to a notification including a predetermined action button for interaction with the user, and the second notification may refer to a notification simply displaying the contents of the notification without requiring a response from the user. have. The notification output controller 210 may change display elements such as the color and size of the notification screen according to the type of the notification, or may change the notification sounds such as the type, pattern, and length of the notification sound. The visual and / or audio elements may be used to classify the notifications.

In operation S330, the voice recognition controller 220 may automatically activate the voice recognition function at the time when the notification screen is output according to the type of notification. In particular, the voice recognition controller 220 may activate a voice recognition function for receiving a user response as a command in the form of a voice while the notification screen is output in the case of the notification requiring the user response. In other words, the voice recognition controller 220 may immediately turn on the microphone in the notification reception state and automatically switch to a state in which the voice command can be recognized. In this case, when the voice recognition function is activated, the notification output control unit 210 may display a voice recognition time on the notification screen. As another example, the notification output control unit 210 may express a count of the voice recognition time as a voice. Here, the voice recognition possible time may correspond to a setting time which is a time for maintaining the notification popup.

In operation S340, the function execution unit 230 may perform a function corresponding to the voice command recognized through the voice recognition function. The function execution unit 230 may perform a function of a corresponding command according to a voice command recognized as a user response through a voice recognition function for a notification requiring a user response.

4 is a flowchart illustrating an example of a speech recognition process of step S330 according to an embodiment of the present invention.

The voice recognition controller 220 may recognize the voice command according to the user's speech while the voice recognition function is activated. While providing a user interface (UI) for receiving a user response in a notification reception state, a user may input a selection of a command inputtable on the notification screen as an action button. In this case, the voice recognition control unit 220 may use the phrase selected from the action button as a phrase that can be recognized as a voice command while the voice recognition function is activated. In other words, the voice recognition controller 220 may recognize the recognized voice as a command of the corresponding action button by recognizing a voice that matches or is similar to the phrase of the action button. Furthermore, the voice recognition control unit 220 recognizes the voices of semantically similar sentences even if they do not exactly match the option phrases of the action buttons, so as to improve user convenience and minimize voice recognition rates. Speech recognition category can be set.

Referring to FIG. 4, in operation S401, the voice recognition controller 220 may set a voice recognition category based on a phrase of a choice made up of an action button on a notification screen. The speech recognition category may refer to a set of sentences recognizable as actual commands for an option phrase. For example, for the phrase "Directions", the set of sentences that can be recognized by the command, "Directions", "Directions", "Guide", "Show me", etc. The wad may be set to a speech recognition category. In addition, a group of sentences with semantic similarity such as the sentence set, "Cancel", "Cancel", "Cancel", "Cancel", which can be recognized by the command for the option phrase 'Cancel' are classified as speech recognition categories. Can be set. In order to set the speech recognition category, for example, a corpus related to the phrase may be previously stored in the memory 120 for each option phrase that can be configured as an action button on the notification screen. The speech recognition controller 220 may set a speech recognition category in the notification according to the action button included in the notification screen by using the corpus stored in the database.

In operation S402, the voice recognition controller 220 may determine whether the voice recognized through the voice recognition function is a voice command corresponding to a voice recognition category. When the voice command corresponding to the voice recognition category is recognized, the voice recognition controller 220 may transmit the voice command to the notification output controller 210 and / or the function execution unit 230. In this case, the notification output controller 210 may classify and display the action button corresponding to the voice command recognized through the voice recognition function from the action buttons included in the notification screen and the remaining action buttons. For example, the notification output controller 210 may distinguish from the other action buttons by highlighting and displaying an action button corresponding to the voice command recognized through the voice recognition function.

In operation S403, if the voice recognized by the voice recognition function is not a voice command corresponding to the voice recognition category, the voice recognition controller 220 determines that the voice recognition has failed and initializes the voice recognition result to retry voice recognition. Can be. In other words, if a voice other than the voice recognition category corresponding to the selection phrase of the action button included in the notification screen is recognized, the voice recognition control unit 220 may request the user to speak again. The speech recognition controller 220 may terminate the speech recognition function after the speech recognition function is executed and if the speech recognition is not detected for a predetermined time after the speech recognition result is initialized, and the pop-up of the notification screen disappears.

5 to 9 are exemplary views for explaining a notification screen in one embodiment of the present invention.

When the notification is received or an event requiring the notification is detected, the processor 110 may read the notification content to the TTS along with a pop-up of the notification screen. In this case, the processor 110 may display the notification type according to the type of the notification.

FIG. 5 illustrates an example of a notification screen 500 including a predetermined action button 510 for receiving a user response in association with the notification content as a first notification, and FIG. 6 requests a user response as a second notification. Instead, an example of a notification screen 600 including simple notification contents is shown.

The notification screen 500 of the first notification and the notification screen 600 of the second notification are visual elements such as color or size of the screen, or an auditory such as a type or pattern of a notification sound to indicate different kinds of notifications. Different elements can be distinguished from one another.

The processor 110 automatically outputs the microphone immediately after the notification screen 500 pops up, or immediately after the notification screen 500 pops up and the process of outputting the notification content by voice is terminated. You can turn it on and activate the speech recognition feature to receive user responses as voice commands.

When the voice recognition function is activated, the processor 110 may display the voice recognition waiting state information 501 indicating that the voice recognition is possible through the notification screen 500 as shown in FIG. 5, and the corresponding information 501. ), That is, the voice recognition standby state can be output together.

In addition, the processor 110 outputs a voice message of a choice of the action button 510 included in the notification screen 500 so that the user can easily recognize what voice commands are possible even without the user visually checking the notification screen 500. I can do it. Therefore, by providing a voice command that can be input by the voice recognition function to the notification screen 500, the voice command can be easily issued even if the user does not recognize it.

On the other hand, the processor 110, in the case of a notification that does not require a user response, as shown in Figure 6, only the notification content on the notification screen 600, and includes an action button for receiving a user response with respect to the notification content Because it does not turn on the microphone, it does not activate the voice recognition function.

When the voice recognition function is activated, the processor 110 may display time information capable of voice recognition on the notification screen 500. For example, as illustrated in FIG. 7, the processor 110 may display a progress bar 702 as a time when speech recognition is possible. The progress bar 702 may display the time remaining until the pop-up disappears, that is, the time at which the voice recognition possible time ends, while counting down. In this case, the processor 110 may output a countdown with respect to the voice recognition time as voice.

The progress bar 702 indicating the voice recognition time may be implemented in various shapes in addition to the general bar shape. For example, the progress bar 702 may be implemented in a circle surrounding the microphone icon representing the voice recognition function.

The user may speak a voice command with reference to the action button 510 on the notification screen 500. In this case, when the voice according to the user's speech is recognized through the voice recognition function, the processor 110 temporarily stops the countdown for the voice recognition possible time and recognizes the voice on the notification screen 500 as shown in FIG. 8. Voice recognition status information 803 indicating the presence of a message may be displayed. If the voice input is not detected so that a predetermined time elapses while the voice is being recognized, the notification screen 500 disappears.

When the voice recognition is successful, that is, when the voice command is recognized as a voice command that matches or is similar to the choice phrase corresponding to one of the action buttons 510 of the action button 510 on the notification screen 500 as shown in FIG. 9. The action button 920 of the recognized voice command may be displayed separately from the other action buttons 930. For example, the selection text of the action button 920 corresponding to the recognized voice command may be displayed by highlighting the selection text of the remaining action button 930. As another example, only the action button 920 recognized as a voice, that is, the action button 920 selected by the user, may be displayed on the notification screen 500, and the remaining action buttons 930 may be hidden. In addition, the processor 110 may provide voice guidance of what action button is selected by the user by outputting information on the recognized voice command as a voice.

The processor 110 may guarantee a function of canceling the recognized voice command if the voice recognition is successful, and the cancelable state information 904 indicating that the voice command recognized on the notification screen 500 may be canceled. ) Can be displayed. If a voice of a sentence that matches or is similar to 'Cancel' is recognized from the user within the time that the reversible status information 904 is displayed, the voice command for canceling the previously recognized voice command is canceled and the speech for voice recognition is returned to the user. You can request While maintaining the pop-up of the notification screen 500, it is possible to cancel the recognized voice command at any time.

The processor 110 determines that the voice recognition fails after the voice recognition result according to the user's speech matches or does not match the option phrase corresponding to the action button 510 on the notification screen 500, and / or the notification screen 500 and / or The voice guidance may request the user to speak the voice again for speech recognition. Thereafter, if the voice recognition is not detected for a certain time, the notification screen 500 disappears.

Regarding the notification, the contents of the notification and the display of various information may be selectively or necessarily parallel to a visual output method using a screen, as well as an audio output method through voice.

The notification screen described with reference to FIGS. 5 to 9 is merely an example, and the contents of the notification or the screen configuration may be changed.

As such, according to embodiments of the present disclosure, a voice command may be triggered for a specific notification, for example, a notification requiring a user response. In addition, according to an embodiment of the present invention, the voice recognition possible state is automatically activated during the time when the notification is expressed, and the notification can be directly manipulated by a voice command. In addition, according to an embodiment of the present invention, by providing a voice command that can be input in the voice recognition function activated during the notification display time, the voice command can be easily issued even if the user does not recognize the voice command. Furthermore, according to an exemplary embodiment of the present invention, the voice command may be recognized within the corresponding category by limiting the voice recognition category by using the phrase of the option included in the notification, thereby improving the voice recognition rate.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable PLU (programmable). It can be implemented using one or more general purpose or special purpose computers, such as logic units, microprocessors, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and configure the processing device to operate as desired, or process it independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. It can be embodied in. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable recording media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. In this case, the medium may be to continuously store a program executable by the computer, or to temporarily store for execution or download. In addition, the medium may be a variety of recording means or storage means in the form of a single or several hardware combined, not limited to a medium directly connected to any computer system, it may be distributed on the network. Examples of the medium include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And ROM, RAM, flash memory, and the like, configured to store program instructions. In addition, examples of another medium may include a recording medium or a storage medium managed by an app store that distributes an application, a site that supplies or distributes various software, a server, or the like.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the claims that follow.

Claims (15)

In the notification voice operation system of the computer implemented notification voice operation method,
Outputting a notification screen including the notification contents when the notification is received; And
Activating a voice recognition function for receiving the user response as a voice command while the notification screen is output when the notification is a notification requiring a user response.
Including,
The outputting step,
Simultaneously displaying the notification screen and outputting the notification content through voice to text (TTS);
After the end of the process of outputting the notification content by voice, the output of the notification screen is maintained for a predetermined time,
The activating step,
Only the time at which the notification screen is output is automatically switched to a state in which a voice command can be recognized.
When the voice recognition function is activated, a voice recognition time corresponding to the set time is displayed on the notification screen, and the remaining time is counted down until the time when the notification screen disappears.
If a voice input is not detected for a certain time after the voice recognition function is activated, the voice recognition function ends and the notification screen disappears.
The activating step,
Setting a speech recognition category by using an option phrase of an action button included in the notification screen; And
Recognizing a voice command corresponding to the voice recognition category through the voice recognition function
Including,
A set of sentences recognizable by a real command with respect to the option phrase, wherein a bunch of words having semantic similarity with the option phrase is set to the speech recognition category
Notification voice operation method characterized in that. delete The method of claim 1,
The outputting step,
Displaying the notification screen and simultaneously outputting an option text of an action button included in the notification screen that can be inputted in the user response;
Notification voice operation method characterized in that. The method of claim 1,
The outputting step,
Outputting the classified notification type according to the type of the notification;
Notification voice operation method characterized in that. The method of claim 1,
The outputting step,
Dividing the type of the notification into a notification for which the user response is required and the remaining notification and outputting at least one of a visual element and an audio element according to the type of the notification;
Notification voice operation method characterized in that. delete delete delete The method of claim 1,
The notification screen includes at least one action button that can be input in response to the user,
Displaying an action button corresponding to a voice command recognized through the voice recognition function separately from the other action buttons
Notification voice operation method further comprising. The method of claim 9,
Canceling a previously recognized voice command when a voice command corresponding to a cancellation command is recognized through the voice recognition function while the notification screen is displayed.
Notification voice operation method further comprising. A computer program recorded on a computer readable recording medium for executing a method of operating a voice notification,
The notification voice operation method,
Outputting a notification screen including the notification contents when the notification is received; And
Activating a voice recognition function for receiving the user response as a voice command while the notification screen is output when the notification is a notification requiring a user response.
Including,
The outputting step,
Simultaneously displaying the notification screen and outputting the notification content through voice to text (TTS);
After the end of the process of outputting the notification content by voice, the output of the notification screen is maintained for a predetermined time,
The activating step,
Only the time at which the notification screen is output is automatically switched to a state in which a voice command can be recognized.
When the voice recognition function is activated, a voice recognition time corresponding to the set time is displayed on the notification screen, and the remaining time is counted down until the time when the notification screen disappears.
If a voice input is not detected for a certain time after the voice recognition function is activated, the voice recognition function ends and the notification screen disappears.
The activating step,
Setting a speech recognition category by using an option phrase of an action button included in the notification screen; And
Recognizing a voice command corresponding to the voice recognition category through the voice recognition function
Including,
A set of sentences recognizable by a real command with respect to the option phrase, wherein a bunch of words having semantic similarity with the option phrase is set to the speech recognition category
And a computer program recorded on a computer readable recording medium. In the computer-implemented notification voice manipulation system,
At least one processor implemented to execute computer-readable instructions
Including,
The at least one processor,
A notification output control unit for outputting a notification screen including notification contents when a notification is received; And
When the notification is a notification that requires a user response, a voice recognition control unit for activating a voice recognition function for receiving the user response as a command in the form of a voice while the notification screen is output.
Including,
The notification output control unit,
Simultaneously displaying the notification screen and outputting the notification content through voice to text (TTS);
After the end of the process of outputting the notification content by voice, the output of the notification screen is maintained for a predetermined time,
The voice recognition control unit,
Only the time at which the notification screen is output is automatically switched to a state in which a voice command can be recognized.
The notification output control unit,
When the voice recognition function is activated, a voice recognition time corresponding to the set time is displayed on the notification screen, and the remaining time is counted down until the time when the notification screen disappears.
If a voice input is not detected for a certain time after the voice recognition function is activated, the voice recognition function ends and the notification screen disappears.
The voice recognition control unit,
Set the speech recognition category by using the choice phrase of the action button included in the notification screen,
The voice recognition function recognizes a voice command corresponding to the voice recognition category,
A set of sentences recognizable by a real command with respect to the option phrase, wherein a bunch of words having semantic similarity with the option phrase is set to the speech recognition category
Notification voice operation system, characterized in that. The method of claim 12,
The notification output control unit,
Dividing the type of the notification into a notification for which the user response is required and the remaining notification and outputting at least one of a visual element and an audio element according to the type of the notification;
Notification voice operation system, characterized in that. delete The method of claim 12,
The notification screen includes at least one action button that can be input in response to the user,
The notification output control unit,
Displaying an action button corresponding to a voice command recognized through the voice recognition function separately from the other action buttons
Notification voice operation system, characterized in that.

Images