CN108304434B

CN108304434B - Information feedback method and terminal equipment

Info

Publication number: CN108304434B
Application number: CN201710787521.XA
Authority: CN
Inventors: 崔兰; 樊邵婷
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2017-09-04
Filing date: 2017-09-04
Publication date: 2021-11-05
Anticipated expiration: 2037-09-04
Also published as: CN108304434A

Abstract

The embodiment of the invention discloses an information feedback method and terminal equipment, wherein the information feedback method comprises the following steps: acquiring instruction information input by a user; if the intention keywords and the content characteristic keywords are extracted from the instruction information, determining at least one user feedback mode according to the intention keywords; acquiring corresponding feedback information according to the user feedback mode and the content characteristic keywords; and outputting the feedback information according to the user feedback mode. By adopting the invention, more intelligent and flexible human-computer interaction is brought to the user.

Description

Information feedback method and terminal equipment

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to an information feedback method and a terminal device.

Background

With the development of electronic technology, electronic devices have become more and more popular. In the process of using the electronic device, a user can realize human-computer interaction in various ways, wherein the terminal device can generally feed back information to the user through a display screen or sound. However, in the prior art, the feedback mode of determining the picture or the sound by the terminal device is usually switched by manually selecting the feedback mode by the user, for example, when the user starts the voice feedback mode, the terminal device plays the feedback information to the user by voice, and when the user closes the voice feedback mode, the terminal device only displays the feedback information on the display screen, and the selection between different feedback modes is very inflexible and requires additional operation by the user.

Disclosure of Invention

In view of this, embodiments of the present invention provide an information feedback method and a terminal device, which can bring more intelligent and flexible human-computer interaction to a user.

An aspect of the embodiments of the present invention provides an information feedback method, where the method includes:

acquiring instruction information input by a user;

if the intention keywords and the content characteristic keywords are extracted from the instruction information, determining at least one user feedback mode according to the intention keywords;

acquiring corresponding feedback information according to the user feedback mode and the content characteristic keywords;

and outputting the feedback information according to the user feedback mode.

Optionally, the feedback information includes network resource content;

the obtaining of the corresponding feedback information according to the user feedback mode and the content feature keywords comprises:

submitting the content characteristic keywords and the user feedback mode to the resource server, and requesting the resource server to acquire network resource content matched with the user feedback mode from the network resource content corresponding to the content characteristic keywords;

and receiving the network resource content returned by the resource server.

Optionally, the method further includes:

if the keyword extraction module extracts content characteristic keywords from the instruction information and does not extract intention keywords from the instruction information, submitting the content characteristic keywords to the resource server and requesting the resource server to return network resource content corresponding to the content characteristic keywords;

and determining at least one user feedback mode according to the network resource content corresponding to the content characteristic keywords acquired from the resource server.

Optionally, the determining at least one user feedback mode according to the network resource content corresponding to the content feature keyword acquired from the resource server includes:

and detecting whether the network resource content corresponding to the content feature keywords acquired from the resource server contains resource content data corresponding to a target feedback mode, and if so, determining the target feedback mode as one of the user feedback modes.

Optionally, if the user feedback mode includes voice feedback, and the network resource content corresponding to the content feature keyword is acquired from the resource server according to the instruction information and includes text content data but does not include voice content data, the outputting the feedback information according to the user feedback mode includes:

and converting the text content data into feedback voice data, and playing the feedback voice data.

Optionally, the acquiring instruction information input by the user includes:

and acquiring voice instruction information input by a user.

Optionally, the method further includes:

and if the content characteristic keywords are extracted from the instruction information and the intention keywords are not extracted from the instruction information, determining at least one user feedback mode comprising voice feedback.

Optionally, the instruction information includes M pieces of instruction information, and the acquiring instruction information input by the user includes:

acquiring the (N-1) th instruction information input by a user, wherein N is a positive integer, and the numerical range of N is increased from 2 to a preset positive integer M;

feeding back the (N-1) th instruction guide information to the user according to the (N-1) th instruction information;

and acquiring the Nth instruction information input by the user aiming at the N-1 instruction guide information.

Optionally, the outputting the feedback information according to the user feedback manner includes:

and sending the feedback information to user feedback equipment corresponding to the user feedback mode so that the user feedback equipment feeds back to the user according to the feedback information.

Optionally, the sending the feedback information to the user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to the user according to the feedback information includes:

extracting resource content data corresponding to the user feedback mode from the feedback information;

and sending the resource content data corresponding to the user feedback mode to user feedback equipment corresponding to the user feedback mode so that the user feedback equipment feeds back to the user according to the resource content data.

Optionally, the user feedback device includes:

display device, audio amplifier, multimedia playback equipment, smell analog device, temperature control equipment, humidity control equipment, luminance control device, augmented reality equipment or virtual reality equipment.

Optionally, the user feedback mode includes any one of text feedback, image feedback, sound feedback, video feedback, smell feedback, temperature feedback, humidity feedback, and brightness feedback.

Optionally, the user feedback mode includes augmented reality feedback or virtual reality feedback.

Accordingly, another aspect of the embodiments of the present invention provides a terminal device, where the terminal device includes:

a user interface for interacting with a user;

a storage medium storing program instructions adapted to be loaded by the processor;

a processor for loading the program instructions and performing the following:

acquiring instruction information input by a user through the user interface;

and outputting the feedback information according to the user feedback mode.

Optionally, the terminal device further includes a communication interface, configured to communicate with the user feedback device;

the feedback information comprises network resource content;

the processor loads the program instruction to execute the following operations so as to obtain corresponding feedback information according to the user feedback mode and the content characteristic keywords:

submitting the content characteristic keywords and the user feedback mode to the resource server through the communication interface, and requesting the resource server to acquire network resource content matched with the user feedback mode from the network resource content corresponding to the content characteristic keywords;

and receiving the network resource content returned by the resource server through the communication interface.

Optionally, the processor loads the program instructions to further perform the following operations:

and if the content characteristic keywords are extracted from the instruction information and the intention keywords are not extracted from the instruction information, determining at least one user feedback mode according to the network resource content corresponding to the content characteristic keywords acquired from the resource server.

Optionally, the processor loads the program instruction to perform the following operations to determine at least one user feedback manner according to the network resource content corresponding to the content feature keyword acquired from the resource server:

Optionally, if the user feedback mode includes voice feedback, and the network resource content corresponding to the content feature keyword is acquired from the resource server according to the instruction information and includes text content data but not voice content data, the processor loads the program instruction to perform the following operations to output the feedback information according to the user feedback mode:

and converting the text content data into feedback voice data, and playing the feedback voice data through the user interface.

Optionally, the user interface includes a microphone, and the instruction information input by the user includes voice instruction information input by the user and acquired through the microphone.

Optionally, the instruction information includes M pieces of instruction information, and the processor loads the program instruction to perform the following operations to obtain instruction information input by a user:

Optionally, the terminal device further includes:

a communication interface for communicating with a user feedback device;

the processor loads the program instructions to perform the following operations to output the feedback information according to the user feedback mode:

and sending the feedback information to user feedback equipment corresponding to the user feedback mode through the communication interface so that the user feedback equipment feeds back to a user according to the feedback information.

Optionally, the processor loads the program instruction to execute the following operations to send the feedback information to the user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to the user according to the feedback information:

extracting resource content data corresponding to the user feedback mode from the network resource content;

and sending the resource content data corresponding to the user feedback mode to user feedback equipment corresponding to the user feedback mode through the communication interface so that the user feedback equipment feeds back to the user according to the resource content data.

Accordingly, the embodiment of the present invention further provides a storage medium, in which a plurality of program instructions are stored, and the program instructions are adapted to be loaded by a processor and execute part or all of the flow in the image processing method according to the first aspect of the present invention.

Correspondingly, an embodiment of the present invention further provides a terminal device, where the terminal device includes:

the input module is used for acquiring instruction information input by a user;

the keyword extraction module is used for extracting intention keywords or content characteristic keywords from the instruction information;

a feedback mode determining module, configured to determine at least one user feedback mode according to the intention keyword if the keyword extracting module extracts the intention keyword and the content feature keyword from the instruction information;

the feedback information acquisition module is used for acquiring corresponding feedback information according to the user feedback mode and the content characteristic keywords;

and the output module is used for outputting the feedback information according to the user feedback mode.

Optionally, the feedback information includes network resource content;

the feedback information acquisition module comprises:

a feedback request unit, configured to submit the content feature keyword and the user feedback mode to the resource server, and request the resource server to obtain, from network resource content corresponding to the content feature keyword, network resource content matched with the user feedback mode;

and the feedback receiving unit is used for receiving the network resource content returned by the resource server.

Optionally, the feedback request unit is further configured to:

the feedback mode determination module is further configured to:

Optionally, the determining, by the feedback mode determining module, at least one user feedback mode according to the network resource content corresponding to the content feature keyword acquired from the resource server includes:

Optionally, if the user feedback mode includes voice feedback, and the network resource content corresponding to the content feature keyword is acquired from the resource server according to the instruction information and includes text content data but not voice content data, the output module is configured to:

Optionally, the input module is configured to: and acquiring voice instruction information input by a user.

Optionally, under the condition that the keyword extraction module extracts content feature keywords from the instruction information and does not extract intention keywords from the instruction information, the at least one user feedback mode determined by the feedback mode determination module includes voice feedback.

Optionally, the output module is configured to:

Optionally, the output module includes:

a content data extraction unit, configured to extract resource content data corresponding to the user feedback manner from the feedback information;

and the content data output unit is used for sending the resource content data corresponding to the user feedback mode to the user feedback equipment corresponding to the user feedback mode so that the user feedback equipment feeds back to the user according to the resource content data.

Optionally, the user feedback device includes:

By implementing the embodiment of the invention, the intention of the user can be accurately identified according to the instruction information input by the user, and then the feedback is carried out in a proper feedback mode according to the actual intention of the user, so that more intelligent and flexible man-machine interaction is brought to the user.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flow chart of an information feedback method in an embodiment of the present invention;

fig. 2 is a schematic view of a scene architecture for implementing the information feedback method according to an embodiment of the present invention;

FIG. 3 is a flow chart of an information feedback method according to another embodiment of the present invention;

FIG. 4 is a flow chart illustrating an information feedback method according to another embodiment of the present invention;

fig. 5 is a schematic structural diagram of a terminal device in an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a feedback information obtaining module in the embodiment of the present invention;

FIG. 7 is a schematic structural diagram of an output module according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a terminal device in an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The information feedback method in the embodiment of the invention can be applied to various terminal devices to realize man-machine interaction with users, the terminal devices can comprise personal computers, notebook computers, telephones, smart phones, tablet computers, vehicle-mounted terminals, electronic readers, portable wearable devices, smart sound boxes and the like, the terminal devices can complete the interaction with the users, and the terminal devices can also feed back information to the users through other user feedback devices in wired or wireless connection so as to realize the interaction between the terminal devices and the users.

The terminal equipment in the embodiment of the invention can extract the intention keywords and the content characteristic keywords from the instruction information input by the user, then determines at least one user feedback mode according to the intention keywords, acquires the feedback information corresponding to the user feedback mode and the content characteristic keywords, and then outputs the feedback information according to the user feedback mode, so that the terminal equipment can accurately identify the intention of the user according to the instruction information input by the user, and further feeds back the intention of the user in a proper feedback mode according to the actual intention of the user, thereby bringing more intelligent and flexible man-machine interaction for the user.

Referring to fig. 1, a schematic flow chart of an information feedback method in the embodiment of the present invention is shown, where the information feedback method in the embodiment includes the following flows:

s101, the terminal equipment acquires instruction information input by a user.

Specifically, the instruction information input by the user may be a text instruction, a voice instruction, a gesture instruction, or the like. Accordingly, the terminal device may obtain a text instruction input by the user on the text input interface through a hardware keyboard, a touch screen, a soft keyboard, or the like, obtain a voice instruction of the user through a voice input device such as a microphone, or obtain a gesture instruction of the user through a camera or a motion sensor (such as an acceleration sensor, a gyroscope, or the like). In this embodiment, the terminal device may further obtain instruction information of the user through an external input device, and may be an external touch pad, a keyboard, a sensor, and the like. Further, in an optional embodiment, the terminal device may further perform instruction analysis and conversion according to the acquired voice information or gesture information of the user, so as to obtain a text instruction carried or represented by the voice information or gesture information of the user.

And S102, the terminal equipment extracts intention keywords and content characteristic keywords from the instruction information.

In a specific implementation, the intention keywords are predefined keywords for determining at least one feedback mode desired by the user. In this embodiment, an intention keyword set may be preset in the terminal device in advance, for example, in a form of a keyword library, if the obtained instruction information of the user includes an intention keyword in the intention keyword set, or the obtained instruction information of the user includes voice information or gesture information corresponding to the intention keyword (the voice information or gesture information corresponding to the intention keyword may be preset), the terminal device may extract the intention keyword from the instruction information, and accordingly, the extraction manner may include character recognition, voice recognition, gesture recognition, or the like. The intent keywords may include words such as "hear", "feel", "smell", "experience", and the like, and may also include phrases such as "hear … … sound (or timbre, sound, noise, etc.)", "smell … … scent (or taste, smell, etc.)", "experience (or sensation) … … live (or sensation, atmosphere, environment, temperature, etc.)".

The content feature keywords are keywords used for determining feedback content desired by the user, and similarly, in an optional embodiment, a content feature keyword set may be preset in the terminal device in advance, for example, in a form of a keyword library, if the obtained instruction information of the user includes the content feature keywords in the content feature keyword set, or the obtained instruction information of the user includes voice information or gesture information corresponding to the content feature keywords (voice information or gesture information corresponding to the content feature keywords may be preset), the terminal device may extract the content feature keywords from the instruction information, and accordingly, the extraction manner may include character recognition, voice recognition, gesture recognition, or the like. In other alternative embodiments, the remaining part of the instruction information may be used as the content feature keyword by removing the meaningless words or recognized intention keywords in the instruction information, where the meaningless words are, for example, conjunctions, mood words or auxiliary words.

In this embodiment, if the terminal device extracts the intention keyword and the content feature keyword from the instruction information, S103 is executed, and if the terminal device fails to extract the intention keyword from the instruction information input by the user, the terminal device may only perform feedback to the user according to the extracted content feature keyword.

S103, the terminal equipment determines at least one user feedback mode according to the intention keywords.

The user feedback mode comprises any one of text feedback, image feedback, sound feedback, video feedback, smell feedback, temperature feedback, humidity feedback or brightness feedback, and can also be any one of augmented reality feedback or virtual reality feedback.

Specifically, the terminal device may preset a correspondence between at least one user feedback manner and different intention keywords, so as to determine at least one user feedback manner corresponding to an intention keyword extracted from instruction information input by the user. Illustratively, the feedback mode of the user corresponding to the intention keyword "listen" is voice feedback, the feedback mode of the user corresponding to the intention keyword "hear" is odor feedback, the feedback mode of the user corresponding to the intention keyword "see" is text feedback + image feedback, the feedback mode of the user corresponding to the intention keyword "watch" is voice feedback + video feedback, the feedback mode of the user corresponding to the intention keyword "feel … … temperature (air temperature)" is temperature feedback, the feedback mode of the user corresponding to the intention keyword "feel … … sunlight" is temperature feedback + brightness feedback, and the like. The correspondence between the intention keywords and the user feedback modes may be one-to-one, for example, the intention keyword "VR experience", that is, the only corresponding user feedback mode is virtual reality feedback, the correspondence between the intention keywords and the user feedback modes may also be one-to-many, that is, one intention keyword corresponds to 1 or more user feedback modes at the same time, for example, the intention keyword "seeing" may correspond to the user feedback modes including text feedback, image feedback, sound feedback, and video feedback, and the correspondence between the intention keywords and the user feedback modes may also be many-to-one, that is, a plurality of intention keywords correspond to the same user feedback mode, for example, the intention keywords "smell", "smell … … fragrance", and "smell … … taste" all correspond to "smell feedback", and so on.

The user feedback mode may be a feedback mode that the terminal device itself can provide, for example, display feedback of images and characters is provided through a screen of the terminal device, sound feedback is performed through a sound playing module built in the terminal device, and video feedback is performed through the display screen and the playing module at the same time. In an optional embodiment, the terminal device may further provide feedback information in a corresponding manner by combining with a preset function module, for example, a navigation map function, a social function, an online shopping function, and the like, and further optionally provide corresponding feedback for a target APP that jumps into the terminal device by starting or triggering, where the target APP may be, for example, a map (navigation) APP, a social application APP, an online shopping APP, and the like. In an optional embodiment, the apparatus may further include a user feedback device connected through a communication interface of the terminal device, and the user feedback device provides a corresponding feedback manner, and in an optional embodiment, the user feedback device may include: display device, audio amplifier, multimedia playback equipment, smell analog device, temperature control equipment, humidity control equipment, luminance control device, augmented reality equipment or virtual reality equipment.

And S104, the terminal equipment acquires corresponding feedback information according to the user feedback mode and the content characteristic keywords.

Specifically, the terminal device may locally obtain corresponding feedback information according to the user feedback manner and the content feature keyword, or obtain feedback information corresponding to the user feedback manner and the content feature keyword from a network, for example, as shown in fig. 2, the terminal device communicates with the resource server through the internet to obtain network resource content provided by the resource server. Whether the resource content is obtained locally or obtained through a network, in an optional embodiment, corresponding resource content can be obtained according to the content feature keywords, and then the corresponding resource content is selected as corresponding feedback information according to a determined user feedback mode; or the corresponding selectable resource content is obtained according to the determined user feedback mode, and then the corresponding resource content is selected as the corresponding feedback information according to the content characteristic keywords. Illustratively, the terminal device extracts the content feature keyword as "pet dog" according to S102, according to the fact that the user feedback mode determined in S103 is image feedback plus sound feedback, the terminal device may first search for relevant resource content in the local storage medium according to the "pet dog" as a keyword, where the searched resource content may include a text file, a picture file, a video file, a sound recording file, and the like related to the pet dog, further selecting resource contents which can be fed back by images or sounds from the searched resource contents about the pet dog, for example, the picture file may be fed back through an image, and the sound recording file may be fed back through sound, so that the picture file and the sound recording file may be selected from the found resource content as feedback information, and fed back to the user through image feedback and sound feedback, respectively. And then if the terminal device obtains more than one corresponding resource content according to the user feedback mode and the content feature keywords, the terminal device may prompt the user to select one or more resource contents as feedback information in a mode that the obtained corresponding resource content generates a resource content list or an abstract set, and prompt the resource content list or the abstract set to be displayed on a display screen or in a voice prompt mode, where the operation of obtaining that the user selects one or more resource contents as feedback information may be selection by clicking or selection by a voice instruction (for example, the user inputs a "first three" voice instruction).

Furthermore, in this embodiment, it may also be determined whether resource content data that can be fed back to the user in a determined user feedback manner exists in the resource content file, for example, the video file includes sound data that can be fed back by sound, and then the found video file may also be used as feedback information. The resource content data may be data in a data format required for feedback to the user through a corresponding user feedback manner, such as text data required for text feedback, image data required for image feedback, audio data required for sound feedback, audio data required for video feedback, odor feature data required for odor feedback, temperature value/humidity value/brightness value required for temperature/humidity/brightness feedback, and the like.

In other embodiments, if the terminal device supports TTS (Text To Speech), the Text file may also be used as the resource content that can be fed back by voice.

The feedback information may include network resource content acquired by the terminal device from a resource server, and the resource server may be a network resource server. In the implementation mode, after acquiring the user feedback mode and the content characteristic keyword, the terminal device submits the content characteristic keyword and the user feedback mode to the resource server, requests the resource server to acquire the network resource content matched with the user feedback mode from the network resource content corresponding to the content characteristic keyword, and then receives the network resource content returned by the resource server.

In an optional embodiment, if the content feature keyword is extracted from the instruction information, and the intention keyword is not extracted from the instruction information, the terminal device may submit the content feature keyword only to the resource server, and further determine at least one user feedback mode according to the network resource content corresponding to the content feature keyword, which is acquired from the resource server. The terminal device does not extract the intention keywords from the instruction information, may not extract any matched intention keywords from the instruction information input by the user according to a preset intention keyword set, or may only match preset fuzzy intention keywords, where the fuzzy intention keywords may include "seeing", "enjoying", "experiencing", "feeling", and the like, and according to the fuzzy intention keywords, it may not be determined from which feedback manner the user wishes to obtain the feedback information of the terminal device. In a specific implementation, the terminal device may detect whether the network resource content corresponding to the content feature keyword acquired from the resource server includes resource content data corresponding to a target feedback manner, and if so, determine the target feedback manner as one of the user feedback manners, for example, when the terminal device does not extract an intention keyword from the instruction information, the network resource content downloaded from the resource server according to the content feature keyword includes odor feature data, the determined user feedback manner includes odor feedback, if the network resource content includes temperature data, the determined user feedback manner includes temperature feedback, if the network resource content includes humidity data, the determined user feedback manner includes humidity feedback, and the like.

And S105, the terminal equipment outputs the feedback information according to the user feedback mode.

The terminal device can directly output the feedback information to the user through a feedback mode provided by the terminal device, for example, display feedback of images and characters is provided through a screen of the terminal device, sound feedback can be performed through a sound playing module built in the terminal device, and video feedback is performed through the display screen and the playing module. In an optional embodiment, the terminal device may further include a user feedback device connected through a communication interface of the terminal device, and the user feedback device provides a corresponding feedback manner. Specifically, as shown in fig. 2, the terminal device may send the feedback information to the user feedback device corresponding to the user feedback mode through a communication interface, so that the user feedback device feeds back to the user according to the feedback information. The communication Interface may be a wired Interface, such as a USB (Universal Serial Bus) Interface, a display output Interface (such as a Digital Visual Interface, a Digital Video Interface DVI, a High Definition Multimedia Interface HDMI, a Video Graphics Array VGA, etc.), or a sound output Interface, and a wireless Interface, such as a bluetooth module, a WIFI wireless communication module, an nfc (near Field communication) near Field communication module, etc.

If the user feedback mode comprises voice feedback, and the network resource content corresponding to the content feature keyword is acquired from the resource server according to the instruction information and contains text content data but not voice content data, the outputting the feedback information according to the user feedback mode comprises: converting the text content data into feedback voice data, and playing the feedback voice data

In a specific implementation, the terminal device may extract the resource content data corresponding to the user feedback mode from the feedback information, and further send the resource content data corresponding to the user feedback mode to the user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to the user according to the resource content data. In an alternative embodiment the user feedback device may comprise: display device, audio amplifier, multimedia playback equipment, smell analog device, temperature control equipment, humidity control equipment, luminance control device, augmented reality equipment or virtual reality equipment. The resource content data corresponding to the user feedback device implementing the corresponding user feedback mode may be data in a data format supported by the user feedback device, for example, the data format supported by the display device includes various image data, the sound box supports various audio data, the odor simulation device supports various data files for simulating odor, the resource content data corresponding to the temperature control device is a temperature value, the resource content data corresponding to the humidity control device is a humidity value, and the like.

The terminal device in the embodiment extracts the intention keywords and the content feature keywords from the instruction information input by the user, determines at least one user feedback mode according to the intention keywords, acquires feedback information corresponding to the user feedback mode and the content feature keywords, and outputs the feedback information according to the user feedback mode, so that the terminal device can accurately identify the intention of the user according to the instruction information input by the user, and feeds back the intention in a proper feedback mode according to the actual intention of the user, thereby bringing more intelligent and flexible man-machine interaction for the user.

Fig. 3 is a schematic flow chart of an information feedback method in another embodiment of the present invention, where the information feedback method in this embodiment is implemented by a terminal device, a user feedback device that establishes a communication connection with the terminal device, and a resource server, and as shown in the diagram, the information feedback method includes the following flows:

s301, acquiring instruction information input by a user.

Specifically, the instruction information input by the user may be a text instruction, a voice instruction, a gesture instruction, or the like. Correspondingly, the terminal device may obtain a text instruction input by the user on the text input interface through a hardware keyboard, a touch screen, a soft keyboard, or the like, obtain a voice instruction of the user through a voice input device such as a microphone, and obtain a gesture instruction of the user through a camera or a motion sensor (such as an acceleration sensor, a gyroscope, or the like). In an alternative embodiment, the terminal device may further obtain instruction information of the user through an external input device, for example, the user feedback device shown in fig. 2 may be an external touch pad, a keyboard, a sensor, and the like. Further, in an optional embodiment, the terminal device may further perform instruction analysis and conversion according to the acquired voice information or gesture information of the user, so as to obtain a text instruction carried or represented by the voice information or gesture information of the user.

In alternative embodiments, the instruction information input by the user may be input once or may be input multiple times. In an exemplary and optional embodiment, the instruction information of the user includes instruction information input through an input process of M times, that is, the N-1 st piece of instruction information input by the user is obtained, where N is a positive integer, and a numerical range of N is from 2 to a preset positive integer M; feeding back the (N-1) th instruction guide information to the user according to the (N-1) th instruction information; and acquiring the Nth instruction information input by the user aiming at the N-1 instruction guide information, thereby acquiring the M instruction information input by the user from the process, wherein the M instruction information can be used as the basis for feeding back the user in the subsequent steps.

In a specific implementation, the process of acquiring the instruction information input by the user may include the following cases:

the user inputs 1 st instruction information through voice: "I want to listen to today's news";

the terminal equipment feeds back 1 st instruction guide information to the user through voice according to the first instruction information: "ask what news you want to listen to? Is sports, politics, entertainment, science and technology, or life? Meanwhile, news classification picture prompts can be synchronously displayed on a display screen;

then the user inputs 2 nd instruction information according to the first instruction guide information: "sports news";

the terminal equipment feeds back 2 nd instruction guide information to the user according to the 2 nd instruction information: "ask you about which area of sports news you are interested? Basketball or football or Olympic? "

And repeating the steps until the user determines that the input is finished (the user can execute the corresponding gesture after the input is finished by clicking the input finishing key, inputting the finished voice or characters, and the like), or the terminal equipment judges that enough instruction information is acquired.

The instruction guide information fed back to the user may be a feedback text generated by the terminal device according to the instruction information currently input by the user, or a voice or picture prompt converted according to the feedback text, and in an optional embodiment, the feedback guide information is a natural feedback language generated by performing semantic analysis on the instruction information input by the user with a natural language understanding module in the terminal device, and may be generated by combining at least one preset feedback dialogue template, that is, by combining semantic and content feature keywords obtained by performing voice analysis on the instruction information with the corresponding feedback dialogue template.

S302, extracting intention keywords and content characteristic keywords from the instruction information, and determining at least one user feedback mode according to the intention keywords.

In a specific implementation, the intention keyword is a predefined keyword for determining at least one feedback manner desired by a user, and may be an intention keyword set preset in the terminal device in advance, for example, in a form of a keyword library, if the obtained instruction information of the user includes the intention keyword in the intention keyword set, or the obtained instruction information of the user includes voice information or gesture information corresponding to the intention keyword, the terminal device may extract the intention keyword from the instruction information, and accordingly, the extraction manner may include character recognition, voice recognition, gesture recognition, or the like. The intent keywords may include words such as "hear", "feel", "smell", "experience", and the like, and may also include phrases such as "hear … … sound (or timbre, sound, noise, etc.)", "smell … … scent (or taste, smell, etc.)", "experience (or sensation) … … live (or sensation, atmosphere, environment, temperature, etc.)". The user feedback mode comprises any one of text feedback, image feedback, sound feedback, video feedback, smell feedback, temperature feedback, humidity feedback or brightness feedback, and can also be any one of augmented reality feedback or virtual reality feedback. Specifically, the terminal device may preset a correspondence between at least one user feedback manner and different intention keywords, so as to determine at least one user feedback manner corresponding to an intention keyword extracted from instruction information input by the user. Illustratively, the feedback mode of the user corresponding to the intention keyword "listen" is voice feedback, the feedback mode of the user corresponding to the intention keyword "hear" is odor feedback, the feedback mode of the user corresponding to the intention keyword "see" is text feedback + image feedback, the feedback mode of the user corresponding to the intention keyword "watch" is voice feedback + video feedback, the feedback mode of the user corresponding to the intention keyword "feel … … temperature (air temperature)" is temperature feedback, the feedback mode of the user corresponding to the intention keyword "feel … … sunlight" is temperature feedback + brightness feedback, and the like. The correspondence between the intention keywords and the user feedback modes may be one-to-one, for example, the intention keyword "VR experience", that is, the only corresponding user feedback mode is virtual reality feedback, the correspondence between the intention keywords and the user feedback modes may also be one-to-many, that is, one intention keyword corresponds to 1 or more user feedback modes at the same time, for example, the intention keyword "see" may correspond to a user feedback mode including text feedback, image feedback, sound feedback, and video feedback, and the correspondence between the intention keywords and the user feedback modes may also be many-to-one, that is, a plurality of intention keywords correspond to the same user feedback mode, for example, the intention keywords "smell", "smell … … fragrance", and "smell … … taste" all correspond to "smell feedback", and so on.

Further, in an optional embodiment, if the voice instruction information input by the user is acquired in S301, the content feature keyword is extracted from the instruction information, and the intention keyword is not extracted from the instruction information, then it may be determined that the at least one user feedback manner including voice feedback is a feedback manner that the corresponding user most likely wants to acquire according to the manner in which the user inputs the instruction information, and besides that the user feedback manner corresponding to the voice instruction includes voice feedback, if the instruction information input by the user is a text instruction, the corresponding user feedback manner may include text feedback.

S303, submitting the content feature keywords and the user feedback mode to the resource server.

S304, the resource server obtains the network resource content matched with the user feedback mode from the network resource content corresponding to the content characteristic key words.

The resource server can obtain corresponding network resource contents according to the content feature keywords, and then further screen the corresponding network resource contents according to the determined user feedback mode; or obtaining corresponding optional network resource contents according to the determined user feedback mode, and further screening the corresponding network resource contents according to the content characteristic keywords. For example, the content feature keyword received by the resource server is a "pet dog", the user feedback mode is image feedback and sound feedback, the resource server may first search for related network resource content in the resource database according to the "pet dog" as a keyword, the searched network resource content may include a text file, a picture file, a video file, a sound recording file, and the like related to the pet dog, and further select network resource content that can be subjected to image feedback or sound feedback from the searched network resource content related to the pet dog, for example, the picture file may be subjected to image feedback, the sound recording file may be subjected to sound feedback, and then the picture file and the sound recording file may be selected from the searched resource content as network resource content matched with the user feedback mode. And then if the resource server acquires more than one corresponding resource content according to the user feedback mode and the content feature keywords, the resource server can send the acquired all or part of the network resource content to the terminal device in a mode of generating a resource content list or an abstract set, so as to prompt the user to select one or more resource contents as feedback information, and the terminal device prompts the resource content list or the abstract set to be displayed on a display screen or in a voice prompt mode, so that the operation of acquiring one or more resource contents selected by the user as the feedback information can be selection by clicking or selection by a voice instruction (for example, the user inputs three voice instructions).

Further, in an optional embodiment, it may be determined whether resource content data that can be fed back to the user in a determined user feedback manner exists in the resource content file, for example, the video file includes sound data that can be fed back by sound, and then the found video file may also be used as feedback information. The resource content data may be data in a data format required for feedback to the user through a corresponding user feedback manner, such as text data required for text feedback, image data required for image feedback, audio data required for sound feedback, audio data required for video feedback, odor feature data required for odor feedback, temperature value/humidity value/brightness value required for temperature/humidity/brightness feedback, and the like.

In an alternative embodiment, if the terminal device supports TTS (Text To Speech), the Text file may also be used as the resource content that can be fed back by voice.

S305, the terminal equipment receives the network resource content returned by the resource server.

S306, the terminal equipment extracts the resource content data corresponding to the user feedback mode.

S307, the terminal equipment sends the resource content data corresponding to the user feedback mode to the user feedback equipment corresponding to the user feedback mode.

S308, the user feedback equipment feeds back to the user according to the resource content data.

The terminal device in the embodiment extracts the intention keywords and the content feature keywords from the instruction information input by the user, determines at least one user feedback mode according to the intention keywords, acquires feedback information corresponding to the user feedback mode and the content feature keywords, and outputs the feedback information through the user feedback device according to the user feedback mode, so that the terminal device can accurately identify the intention of the user according to the instruction information input by the user, and feeds back the intention of the user in a proper feedback mode according to the actual intention of the user, thereby bringing more intelligent and flexible man-machine interaction for the user.

Fig. 4 is a schematic flow chart of an information feedback method in another embodiment of the present invention, where the information feedback method in this embodiment is implemented by a terminal device, a user feedback device that establishes a communication connection with the terminal device, and a resource server, and as shown in the drawing, the method includes the following flows:

s401, the terminal equipment acquires instruction information input by a user.

S402, the terminal device extracts content feature keywords from the instruction information, but does not extract intention keywords.

The terminal device does not extract the intention keywords from the instruction information, may not extract any matched intention keywords from the instruction information input by the user according to a preset intention keyword set, or may only match preset fuzzy intention keywords, where the fuzzy intention keywords may include "seeing", "enjoying", "experiencing", "feeling", and the like, and according to the fuzzy intention keywords, it may not be determined from which feedback manner the user wishes to obtain the feedback information of the terminal device.

S403, submitting the content feature keywords to the resource server.

S404, the resource server obtains the network resource content corresponding to the content feature keywords.

S405, the terminal equipment receives the network resource content returned by the resource server.

S406, the terminal equipment determines at least one user feedback mode according to the network resource content corresponding to the content feature keywords acquired from the resource server.

The user feedback mode comprises any one of text feedback, image feedback, sound feedback, video feedback, smell feedback, temperature feedback, humidity feedback or brightness feedback, and can also be any one of augmented reality feedback or virtual reality feedback. In a specific implementation, the terminal device may detect whether the network resource content corresponding to the content feature keyword acquired from the resource server includes resource content data corresponding to a target feedback mode, and if so, determine the target feedback mode as one of the user feedback modes. The resource content data may be data in a data format required for feedback to the user through a corresponding user feedback manner, such as text data required for text feedback, image data required for image feedback, audio data required for sound feedback, audio data required for video feedback, odor feature data required for odor feedback, temperature value/humidity value/brightness value required for temperature/humidity/brightness feedback, and the like. For example, in a case where the terminal device does not extract the intention keyword from the instruction information, if the network resource content downloaded from the resource server according to the content feature keyword includes smell feature data, the determined user feedback manner includes smell feedback, if the network resource content includes temperature data, the determined user feedback manner includes temperature feedback, if the network resource content includes humidity data, the determined user feedback manner includes humidity feedback, and the like.

Further, in an optional embodiment, if the voice instruction information input by the user is acquired in S401, the content feature keyword is extracted from the instruction information, and the intention keyword is not extracted from the instruction information, then it may be determined that the at least one user feedback manner including voice feedback is one of the at least one user feedback manner including voice feedback, that is, according to the manner in which the user inputs the instruction information, a feedback manner that the corresponding user most likely wants to acquire is determined as one of the at least one user feedback manner, except that the user feedback manner corresponding to the voice instruction includes voice feedback, and if the instruction information input by the user is a text instruction, the corresponding user feedback manner may include text feedback. In this embodiment, when the content feature keyword is submitted to the resource server in S403, the user feedback mode determined in this mode may be carried, that is, the resource server is requested to preferentially return network resource content that can be used for voice feedback, or preferentially return network resource content of resource content data including voice audio data.

S407, the terminal device sends the resource content data corresponding to the user feedback mode to the user feedback device corresponding to the user feedback mode.

In a specific implementation, the terminal device may extract the resource content data corresponding to the user feedback mode from the feedback information, and further send the resource content data corresponding to the user feedback mode to the user feedback device corresponding to the user feedback mode. In an alternative embodiment the user feedback device may comprise: display device, audio amplifier, multimedia playback equipment, smell analog device, temperature control equipment, humidity control equipment, luminance control device, augmented reality equipment or virtual reality equipment. The resource content data corresponding to the user feedback device implementing the corresponding user feedback mode may be data in a data format supported by the user feedback device, for example, the data format supported by the display device includes various image data, the sound box supports various audio data, the odor simulation device supports various data files for simulating odor, the resource content data corresponding to the temperature control device is a temperature value, the resource content data corresponding to the humidity control device is a humidity value, and the like.

S408, the user feedback equipment feeds back to the user according to the resource content data.

The terminal device in this embodiment extracts a content feature keyword from instruction information input by a user, then obtains network resource content corresponding to the content from a resource server according to the content feature keyword, further determines at least one user feedback mode according to resource content data included in the obtained network resource content, and further outputs the network resource content through the user feedback device according to the user feedback mode, so that the terminal device can perform feedback of the corresponding feedback mode according to the input mode of the user instruction information or the resource content data carried by the obtained network resource content under the condition that the intention of the user cannot be accurately identified, and more intelligent and flexible human-computer interaction is brought to the user.

For ease of understanding, an example of human-computer interaction in a particular usage scenario is given below:

the user speaks "i want to listen to news" near the microphone of the mobile phone;

the mobile phone extracts an intention keyword 'listen', determines that a user feedback mode is voice feedback, and plays the voice feedback according to a content characteristic keyword 'news': "what types of news need to be listened to? The optional types include: sports, politics, entertainment, science or life? Meanwhile, news classification picture prompts can be synchronously displayed on a display screen;

the user continues to speak into the microphone of the mobile phone: "entertainment news";

the mobile phone extracts a content characteristic keyword 'entertainment news', and sends a voice feedback identifier and the content characteristic keyword 'entertainment news' to the resource server;

the mobile phone resource charging server obtains the entertainment news list of the same day, obtains the voice feedback information after conversion, and plays voice feedback to the user: "entertainment news today includes: if a certain object is out of track, the object is yellow. "

The user says: "the next strip"

The mobile phone identifies to obtain a user instruction, obtains a voice feedback message according to the next conversion of the entertainment news list, and plays voice feedback: seafood large meal eaten by Ara and Ab in CC restaurant "

The user says: 'what is good for eating in CC restaurant'

The mobile phone identifies and obtains content characteristic keywords 'CC restaurant' and 'tasty', and the mobile phone sends the content characteristic keywords 'CC restaurant' and 'tasty' to the resource server;

the mobile phone receives the menu information and the dish introduction information of the CC restaurant from the resource server, and plays voice feedback to the user: "popular dishes for CC restaurant include: braised prawn, characteristic … … "

User says that the braised prawn is good "

The mobile phone identifies an intention keyword 'good eating' and determines that a user feedback mode is image feedback plus smell feedback, a content characteristic keyword 'braised prawn', the mobile phone sends an image feedback plus smell feedback identification and the content characteristic keyword 'CC restaurant plus braised prawn' to a resource server, wherein the CC restaurant is obtained according to context;

the mobile phone receives dish information of the braised prawn in the CC restaurant from the resource server, the dish information comprises image data and smell characteristic data, the mobile phone displays the image data on a display screen and sends the smell characteristic data to an external smell simulating device, and the smell simulating device simulates the smell of the braised prawn according to the smell characteristic data.

The user says "where the CC restaurant is"

The mobile phone identifies and obtains an intention keyword 'where', a content characteristic keyword 'CC restaurant', the mobile phone opens a map APP, the geographic position of the CC restaurant is searched and obtained from a built-in electronic map according to the 'CC restaurant', a corresponding geographic position voice introduction is generated, and the geographic position voice introduction of the CC restaurant is played to a user: "CC restaurant is located on left side of XXX beach entrance of XX street 00X of Mitsui city, Hainan province, China"

User says "how the air temperature and humidity of today XXX beach"

Identifying the intention keywords 'air temperature' and 'humidity' by the mobile phone, determining that a user feedback mode comprises temperature feedback and humidity feedback, and sending the temperature feedback and humidity feedback identification and the content characteristic keyword 'XXX beach' to the resource server by the mobile phone;

the cell-phone acquires XXX beach's temperature data and humidity data from resource server, sends temperature data and humidity data to the intelligent air conditioner who is connected in same LAN with the cell-phone, and the intelligent air conditioner is according to the temperature data and the humidity data simulation XXX beach's temperature and humidity received.

Referring to fig. 5, fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present invention, where the terminal device may be configured to execute the information feedback method according to the embodiment of the present invention, and as shown in fig. 5, the terminal device may include:

an input module 510, configured to obtain instruction information input by a user;

a keyword extraction module 520, configured to extract an intention keyword or a content feature keyword from the instruction information;

a feedback mode determining module 530, configured to determine at least one user feedback mode according to the intention keyword if the keyword extracting module extracts the intention keyword and the content feature keyword from the instruction information;

a feedback information obtaining module 540, configured to obtain corresponding feedback information according to the user feedback manner and the content feature keyword;

an output module 550, configured to output the feedback information according to the user feedback manner.

In an alternative embodiment, the feedback information comprises network resource content;

the feedback information obtaining module 540 further includes, as shown in fig. 6:

a feedback request unit 541, configured to submit the content feature keyword and the user feedback manner to the resource server, and request the resource server to obtain, from network resource contents corresponding to the content feature keyword, network resource contents matched with the user feedback manner;

a feedback receiving unit 542, configured to receive network resource content returned by the resource server.

Further optionally, the feedback request unit 541 is further configured to:

the feedback manner determining module 530 is further configured to:

In a specific implementation, the feedback mode determining module 530 may detect whether the network resource content corresponding to the content feature keyword acquired from the resource server includes resource content data corresponding to a target feedback mode, and if so, determine the target feedback mode as one of the user feedback modes.

In an optional embodiment, if the user feedback mode includes voice feedback, and the network resource content corresponding to the content feature keyword is acquired from the resource server according to the instruction information and includes text content data but does not include voice content data, the output module 550 is configured to:

In an alternative embodiment, the input module 510 is configured to: and acquiring voice instruction information input by a user.

In this embodiment, and in the case where the keyword extraction module 520 extracts a content feature keyword from the instruction information and does not extract an intention keyword from the instruction information, the feedback manner determination module 530 determines at least one user feedback manner including voice feedback.

In an alternative embodiment, the output module 550 is configured to:

Further optionally, as shown in fig. 7, the output module 550 further includes:

a content data extraction unit 551 configured to extract resource content data corresponding to the user feedback manner from the feedback information;

a content data output unit 552, configured to send resource content data corresponding to the user feedback mode to a user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to a user according to the resource content data.

The user feedback device may include: display device, audio amplifier, multimedia playback equipment, smell analog device, temperature control equipment, humidity control equipment, luminance control device, augmented reality equipment or virtual reality equipment.

The user feedback mode comprises any one of text feedback, image feedback, sound feedback, video feedback, smell feedback, temperature feedback, humidity feedback and brightness feedback.

The user feedback mode may further include augmented reality feedback or virtual reality feedback.

In a specific implementation, each module and unit in the terminal device described in the embodiment of the present invention may implement a related function executed by the terminal device in the information feedback method described in the embodiment of the present invention in combination with fig. 1, fig. 3, or fig. 4, and details are not repeated here.

It should be noted that, for the functions of each functional module in the terminal device, reference may be made to the related description of the corresponding information feedback method in the embodiments shown in fig. 1, 3 and 4, and details are not repeated here. In the several embodiments provided in the present application, it should be understood that the disclosed terminal device may be implemented in other manners, that is, the above-described terminal device embodiments are only illustrative, for example, the division of the modules is only one logical division, and in actual implementation, there may be another division, for example, a plurality of modules or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.

Fig. 8 is a schematic structural diagram of a terminal device according to another embodiment of the present invention, where the terminal device in this embodiment includes a processor 802, a storage medium 801, and a user interface 804, and the processor 802, the storage medium 801, and the user interface 804 are all connected by a bus 806.

The user interface 804 is used for interacting with a user, and may include a display screen, a touch screen, a physical keyboard, a camera, a mouse, a microphone, a sound amplifier, and the like.

The storage medium 801 may be a storage medium built in the terminal device or a storage medium provided separately. The processor 802 for data Processing may be a microprocessor, a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or a Programmable logic Array (FPGA).

The storage medium 801 may store a plurality of instructions, where the instructions are adapted to be loaded by the processor 802 and execute all or part of the processes executed by the terminal device in the information feedback method shown in fig. 1, fig. 3, or fig. 4 in the foregoing embodiments, where the processes at least include:

acquiring instruction information input by a user through the user interface 804;

and outputting the feedback information according to the user feedback mode.

In an alternative embodiment, the terminal device further comprises a communication interface 805 for communicating with the user feedback device;

the feedback information comprises network resource content;

the processor 802 loads the program instructions to perform the following operations to obtain corresponding feedback information according to the user feedback mode and the content feature keywords:

submitting the content characteristic keywords and the user feedback mode to the resource server through the communication interface 805, and requesting the resource server to acquire network resource content matched with the user feedback mode from the network resource content corresponding to the content characteristic keywords;

and receiving the network resource content returned by the resource server through the communication interface 805.

In an alternative embodiment, the processor 802 loads the program instructions to perform the following operations:

In an alternative embodiment, the processor 802 loads the program instructions to determine at least one user feedback manner according to the network resource content corresponding to the content feature keyword acquired from the resource server:

In an optional embodiment, if the user feedback mode includes voice feedback, and the network resource content corresponding to the content feature keyword is acquired from the resource server according to the instruction information and includes text content data but does not include voice content data, the processor 802 loads the program instruction to perform the following operations to output the feedback information according to the user feedback mode:

In an alternative embodiment, the user interface 804 includes a microphone, and the instruction information input by the user includes voice instruction information input by the user acquired through the microphone.

and if the content characteristic keywords are extracted from the instruction information and the intention keywords are not extracted from the instruction information, determining at least one user feedback mode including voice feedback.

In an alternative embodiment, the instruction information includes M instruction information, and the processor 802 loads the program instructions to perform the following operations to obtain the instruction information input by the user:

setting a positive integer N, wherein the N is increased from 2 to a preset positive integer M, and acquiring the N-1 instruction information input by a user through the user interface;

feeding back the N-1 instruction guide information to the user through the user interface according to the N-1 instruction information;

and acquiring the Nth instruction information input by the user aiming at the N-1 instruction guide information through the user interface.

In an optional embodiment, the terminal device further includes: a communication interface 805 for communicating with a user feedback device;

the processor 802 loads the program instructions to perform the following operations to output the feedback information according to the user feedback manner:

and sending the feedback information to user feedback equipment corresponding to the user feedback mode through the communication interface 805, so that the user feedback equipment feeds back to a user according to the feedback information.

The processor 802 loads the program instruction to perform the following operations to send the feedback information to the user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to the user according to the feedback information:

and sending the resource content data corresponding to the user feedback mode to the user feedback equipment corresponding to the user feedback mode through the communication interface 805, so that the user feedback equipment feeds back to the user according to the resource content data.

It should be understood that the storage medium carrying the specific program instructions described above should not be understood as being present or implemented only in the terminal device in the present embodiment, but may be implemented in any terminal, storage device or network device.

In another embodiment of the present invention, a storage medium is provided, the storage medium storing a plurality of program instructions adapted to be loaded by a processor to implement: acquiring instruction information input by a user through the user interface; if the intention keywords and the content characteristic keywords are extracted from the instruction information, determining at least one user feedback mode according to the intention keywords; acquiring corresponding feedback information according to the user feedback mode and the content characteristic keywords; and outputting the feedback information according to the user feedback mode.

The storage medium may be an internal storage unit, such as a hard disk or a memory, of the terminal device according to any of the foregoing embodiments. The storage medium may be an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like, provided in the image processing apparatus. Further, the storage medium may include both an internal storage unit and an external storage device of the terminal device. The storage medium is used for storing the program instructions and other programs and data required by the terminal device. The storage medium described above may also be used to temporarily store data that has been output or is to be output.

It should be understood by those of ordinary skill in the art that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of the processes should be determined by their functions and inherent logic, and should not limit the implementation process of the embodiments of the present application.

The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims

1. An information feedback method, characterized in that the method comprises:

acquiring instruction information input by a user; the instruction information comprises M pieces of instruction information, the Nth piece of instruction information is input according to the N-1 th piece of instruction guide information input by the user, the N-1 th piece of instruction guide information is obtained according to the N-1 th piece of instruction input by the user, wherein N is a positive integer, and the numerical range of N is from 2 to a preset positive integer M in an increasing mode;

if the intention keywords and the content characteristic keywords are extracted from the instruction information, determining at least one user feedback mode according to the intention keywords; the content feature keywords comprise content feature keywords extracted from each piece of instruction information belonging to the M pieces of instruction information, and the category to which the content feature keywords obtained from the Nth piece of instruction information belong is a sub-category of the category to which the content feature keywords obtained from the (N-1) th piece of instruction information belong;

acquiring corresponding feedback information according to the user feedback mode and the content characteristic keywords; and

and outputting the feedback information according to the user feedback mode.

2. The information feedback method of claim 1, wherein the feedback information includes network resource content;

submitting the content characteristic keywords and the user feedback mode to a resource server, and requesting the resource server to acquire network resource content matched with the user feedback mode from network resource content corresponding to the content characteristic keywords;

and receiving the network resource content returned by the resource server.

3. The information feedback method according to claim 2, wherein if the user feedback mode includes voice feedback and the network resource content corresponding to the content feature keyword obtained from the resource server includes text content data but does not include voice content data, the outputting the feedback information according to the user feedback mode includes:

4. The information feedback method of claim 1, wherein the method further comprises:

if the content characteristic keywords are extracted from the instruction information and the intention keywords are not extracted from the instruction information, submitting the content characteristic keywords to a resource server and requesting the resource server to return network resource content corresponding to the content characteristic keywords;

5. The information feedback method according to claim 4, wherein the determining at least one user feedback mode according to the network resource content corresponding to the content feature keyword acquired from the resource server comprises:

6. The information feedback method according to claim 1, wherein the acquiring instruction information input by the user comprises:

and acquiring voice instruction information input by a user.

7. The information feedback method of claim 6, wherein the method further comprises:

8. The information feedback method of claim 1, wherein the outputting the feedback information according to the user feedback manner comprises:

9. The information feedback method of claim 8, wherein the sending the feedback information to the user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to the user according to the feedback information, comprises:

10. An information feedback method according to any one of claims 1 to 9, wherein the user feedback means includes any one of text feedback, image feedback, sound feedback, video feedback, smell feedback, temperature feedback, humidity feedback, and brightness feedback.

11. A terminal device, characterized in that the terminal device comprises:

a user interface for interacting with a user;

a processor for loading the program instructions and performing the following:

acquiring instruction information input by a user through the user interface; the instruction information comprises M pieces of instruction information, the Nth piece of instruction information is input according to the N-1 th piece of instruction guide information input by the user, the N-1 th piece of instruction guide information is obtained according to the N-1 th piece of instruction input by the user, wherein N is a positive integer, and the numerical range of N is from 2 to a preset positive integer M in an increasing mode;

extracting intention keywords and content characteristic keywords from the instruction information;

determining at least one user feedback mode according to the intention keywords; the content feature keywords comprise content feature keywords extracted from each piece of instruction information belonging to the M pieces of instruction information, and the category to which the content feature keywords obtained from the Nth piece of instruction information belong is a sub-category of the category to which the content feature keywords obtained from the (N-1) th piece of instruction information belong;

and outputting the feedback information according to the user feedback mode.

12. The terminal device of claim 11, further comprising a communication interface for communicating with a resource server;

the feedback information comprises network resource content;

13. The terminal device according to claim 12, wherein if the user feedback mode includes voice feedback, and the network resource content corresponding to the content feature keyword is obtained from the resource server according to the instruction information and contains text content data but not voice content data, the processor loads the program instruction to perform the following operations to output the feedback information according to the user feedback mode:

14. The terminal device of claim 11, wherein the processor loading the program instructions further performs the following:

and if the content characteristic keywords are extracted from the instruction information and the intention keywords are not extracted from the instruction information, submitting the content characteristic keywords to the resource server through the communication interface, receiving network resource content corresponding to the content characteristic keywords returned by the resource server through the communication interface, and determining at least one user feedback mode according to the network resource content corresponding to the content characteristic keywords acquired from the resource server.

15. The terminal device of claim 14, wherein the program instructions loaded by the processor perform the following operations to determine at least one user feedback mode according to the network resource content corresponding to the content feature keyword acquired from the resource server:

16. The terminal device according to claim 11, wherein the user interface includes a microphone, and the instruction information input by the user includes voice instruction information input by the user acquired through the microphone.

17. The terminal device of claim 16, wherein the program instructions loaded by the processor further perform the following:

18. The terminal device of claim 11, further comprising:

a communication interface for communicating with a user feedback device;

19. The terminal device of claim 18, wherein the program instructions loaded by the processor perform the following operations to send the feedback information to the user feedback device corresponding to the user feedback mode, so that the user feedback device feeds back to a user according to the feedback information:

20. A storage medium having stored therein a plurality of program instructions adapted to be loaded by a processor and to execute the information processing method according to any one of claims 1 to 10.