CN114679614B - Voice query method, intelligent television and computer readable storage medium - Google Patents
Voice query method, intelligent television and computer readable storage medium Download PDFInfo
- Publication number
- CN114679614B CN114679614B CN202011565632.4A CN202011565632A CN114679614B CN 114679614 B CN114679614 B CN 114679614B CN 202011565632 A CN202011565632 A CN 202011565632A CN 114679614 B CN114679614 B CN 114679614B
- Authority
- CN
- China
- Prior art keywords
- user
- voice
- course
- building
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000012790 confirmation Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 claims description 9
- 238000012549 training Methods 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 5
- 230000003993 interaction Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 210000001015 abdomen Anatomy 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Abstract
The invention discloses a voice query method, an intelligent television and a computer readable storage medium, wherein the method comprises the following steps: receiving voice of inquiring a body-building course sent by a user, and carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire; searching a local body-building course matched with the user demand in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course; and if the body-building course matched with the user requirement is not matched in the local resource library, acquiring an online body-building course matched with the user requirement, and switching to a starting interface of the online body-building course. According to the invention, the voice instruction sent by the user is identified, the local body-building course is matched or the online body-building course is recommended according to the voice instruction, and the teaching interface of the body-building course is jumped to for the user to perform body-building learning and exercise, so that the operation is simple, the body-building requirement of the user can be met, and convenience is brought to the user.
Description
Technical Field
The present invention relates to the field of voice interaction technologies, and in particular, to a voice query method, an intelligent television, and a computer readable storage medium.
Background
With the development of artificial intelligence technology, intelligent voice interaction is considered to be the most natural interaction mode because it is most consistent with human communication habits. The user can input a request through voice, the equipment loaded with the voice recognition function firstly converts voice input signals of the user into characters, then analyzes the intention of the user through a subsequent series of natural language processing flows, and finally responds to the corresponding function according to the understood intention of the user. The intelligent large screen is gradually developed to the multi-mode intelligent large screen with voice interaction as a core. Unlike the conventional televisions, the smart television has the biggest characteristic that a user can search for content on demand to watch on the television in VOD (video on demand) mode.
The exercise program is played in a way of decomposing courses, so that a user can imitate the exercise program, but because of various exercise video categories and diversity, the retrieval process is complex and complicated, and different exercise program videos are often provided by different teams or APP, for example: running warm-up, rope skipping and the like, users often need to operate a remote controller to select and click for several times by using a traditional interaction mode on a television, sometimes, a specific APP needs to be downloaded to enter a watching page of a specific event (and the users may not know the watching page), and when the users want to search for a certain team or a teaching course of a specific coach, the operation of controlling keyboard input by using the remote controller is more complicated, so that inconvenience is brought to the users.
Accordingly, the prior art is still in need of improvement and development.
Disclosure of Invention
The invention mainly aims to provide a voice query method, an intelligent television and a computer readable storage medium, and aims to solve the problems that in the prior art, a user needs to operate for many times to acquire a body-building course from the television, so that the operation is complex and the operation is inconvenient.
In order to achieve the above object, the present invention provides a voice query method, including the steps of:
receiving voice of inquiring a body-building course sent by a user, and carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire;
searching a local body-building course matched with the user demand in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course;
and if the body-building course matched with the user requirement is not matched in the local resource library, acquiring an online body-building course matched with the user requirement, and switching to a starting interface of the online body-building course.
Optionally, the voice query method, wherein the receiving the voice of the body-building course query sent by the user, performing voice recognition on the voice, and obtaining the voice instruction of the body-building course required to be queried by the user specifically includes:
starting a body-building mode and a recording mode according to the operation instruction or the voice control instruction of the user, and receiving the voice of inquiring the body-building course sent by the user in real time;
after the recording is finished, the voice is subjected to voice recognition through an ASR function, and a voice instruction of the exercise course which the user needs to inquire is generated according to semantic analysis.
Optionally, the voice query method, wherein the searching the local exercise course matching the user requirement in the local resource library according to the voice command, and switching to a start interface of the local exercise course specifically includes:
traversing the local resource library according to the voice command of the user, searching the local body-building course matched with the user requirement, and displaying the searching result on a screen;
if the search result is that a local body-building course is found according to the voice instruction, automatically switching to a starting interface of the local body-building course;
and if the searching result is that a plurality of local body-building courses are searched according to the voice instruction, prompting the user to select the local body-building courses to be watched, and automatically switching to a starting interface of the selected local body-building courses after confirmation.
Optionally, in the voice query method, if the exercise course matching the user requirement is not matched in the local resource library, acquiring an online exercise course matching the user requirement, and switching to a start interface of the online exercise course, including:
if the search result is that the exercise course matched with the user requirement is not matched in the local resource library according to the voice command, sending the voice command and a request for acquiring the exercise course to a recommendation server;
receiving an online body-building course which is fed back by the recommendation server according to the voice command and the request and matched with the user requirement, and displaying a recommendation result of the recommendation server on a screen;
if the recommendation result is that an online fitness course is recommended according to the voice instruction, automatically switching to a starting interface of the online fitness course;
and if the recommendation result is that a plurality of local body-building courses are recommended according to the voice instruction, prompting the user to select an online body-building course to be watched, and automatically switching to a starting interface of the selected online body-building course after confirmation.
Optionally, the voice query method, wherein the acquiring the online fitness course matching the user requirement further includes:
and if the recommended result is that the related exercise course cannot be matched, prompting the user to change the voice information of the inquiry exercise course.
Optionally, the voice query method, wherein the voice query method further includes:
when the screen is detected to be switched to the local body-building course or the starting interface of the online body-building course, starting a camera to acquire the current whole-body image of the user;
inputting the whole body image into a pre-trained classifier training model, and outputting a user clothing classification judgment result by the classifier training model according to the whole body image;
wherein, the user clothing classification judgment result comprises body-building clothing and non-body-building clothing;
if the user clothing classification judgment result is non-body-building clothing, the local body-building course or the online body-building course is paused in preset time, and a voice prompt is sent out to prompt the user to replace the body-building clothing.
Optionally, the voice query method, wherein the pausing the playing of the local exercise course or the online exercise course within a preset time, and sending a voice prompt to the user to replace the exercise garment, further includes:
and detecting the current whole body image of the user through the camera again after the preset time, and if the user clothing classification judgment result is that the body-building clothing is body-building clothing, continuing to play the local body-building course or the online body-building course.
Optionally, the voice query method, wherein the voice query method further includes:
acquiring historical data of the user watching the exercise course for preset times, and analyzing habits of the user watching the exercise course according to the historical data to obtain preference types of the user about the exercise course;
when the body-building course query is re-entered, automatically recommending the body-building course with the matching degree higher than the preset threshold value to the user according to the preference type, and prompting the user to select the currently recommended body-building course or selecting the body-building course to be watched through voice.
In addition, in order to achieve the above object, the present invention further provides a smart television, where the smart television includes: the system comprises a memory, a processor and a voice query program stored on the memory and capable of running on the processor, wherein the voice query program realizes the steps of the voice query method when being executed by the processor.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium storing a voice query program which, when executed by a processor, implements the steps of the voice query method described above.
According to the invention, the voice of the body-building course to be inquired is received and is subjected to voice recognition, so that the voice instruction of the body-building course to be inquired by the user is obtained; searching a local body-building course matched with the user demand in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course; and if the body-building course matched with the user requirement is not matched in the local resource library, acquiring an online body-building course matched with the user requirement, and switching to a starting interface of the online body-building course. According to the invention, the voice instruction sent by the user is identified, the local body-building course is matched or the online body-building course is recommended according to the voice instruction, and the teaching interface of the body-building course is jumped to for the user to perform body-building learning and exercise, so that the operation is simple, the body-building requirement of the user can be met, and convenience is brought to the user.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of the voice query method of the present invention;
FIG. 2 is a flowchart of step S10 in a preferred embodiment of the voice query method of the present invention;
FIG. 3 is a flowchart of step S20 in a preferred embodiment of the voice query method of the present invention;
FIG. 4 is a flowchart of step S30 in a preferred embodiment of the voice query method of the present invention;
fig. 5 is a schematic diagram of an operation environment of a preferred embodiment of the smart tv of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clear and clear, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in FIG. 1, the voice query method according to the preferred embodiment of the present invention comprises the following steps:
and step S10, receiving voice of inquiring the body-building course sent by the user, and carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire.
The voice query method is applied to the intelligent television and used for acquiring the relevant body-building course according to the voice requirement of the user, and can be applied to other intelligent watching devices, such as a tablet personal computer, a smart mobile phone, an intelligent outdoor large screen and the like.
Fig. 2 is a flowchart of step S10 in the voice query method according to the present invention.
As shown in fig. 2, the step S10 includes:
s11, starting a body-building mode and a recording mode according to the operation instruction or the voice control instruction of the user, and receiving voice of inquiring the body-building course sent by the user in real time;
and S12, after the recording is finished, performing voice recognition on the voice through an ASR function, and generating a voice instruction of the exercise course which the user needs to inquire according to semantic analysis.
Specifically, after the smart television is started, the user can send the operation instruction to control the smart television to start the body-building mode through the remote controller, the smart television has the function of having the body-building mode, the user can select whether to enter the body-building mode according to the self requirement after the smart television is started, and meanwhile, after the smart television is started, the voice control instruction of the user can be received through the microphone to start the body-building mode of the smart television, and the operation of starting the body-building mode through the voice control mode is more convenient because the user does not need to control the remote controller manually; and starting the sound recording mode while the intelligent television starts the body-building mode so as to receive the voice of inquiring the body-building course sent by the user in real time.
The exercise course refers to exercise learning or exercise performed by a user according to the exercise video, the exercise clip, the exercise classroom, and other forms played on the smart television, for example, "jogging exercise course", "running course", "yoga course", "slimming action", "value-reducing course", and the like.
After the intelligent television starts the body-building mode and the recording mode, the intelligent television records the voice of the user through the microphone (for example, an array microphone), for example, the voice sent by the user at the moment is a body-building video of how the user wants to see the thin bellybutton, after the recording is finished, the voice is subjected to voice recognition through an ASR (Automatic Speech Recognition, an automatic voice recognition technology is a technology for converting the voice of a person into text) function, namely, voice information is firstly converted into text information, then a voice instruction of a body-building course which the user needs to inquire is generated according to semantic analysis, for example, the voice of the body-building video of how the user wants to see the thin bellybutton is converted into a text form through an ASR function, and then the voice instruction which can be understood by the intelligent television is the body-building video for acquiring the thin bellybutton according to the meaning of the text.
Further, after the smart television recognizes the voice command, the text information represented by the voice command may be displayed on the screen of the smart television, so that the user confirms whether the text information is the meaning that the user wants to express, for example, the "i want to watch the course of peter" and the "i want to watch the course of fire team" are displayed on the screen of the smart television, so that the user knows at a glance whether the text information is the meaning that the user wants to express, and if the text information does not accord with the meaning of the user, the user may make relevant adjustment.
And step S20, searching a local body-building course matched with the user requirement in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course.
Fig. 3 is a flowchart of step S20 in the voice query method according to the present invention.
As shown in fig. 3, the step S20 includes:
s21, traversing the local resource library according to the voice command of the user, searching the local body-building course matched with the user requirement, and displaying a searching result on a screen;
s22, if the search result is that a local body-building course is found according to the voice instruction, automatically switching to a starting interface of the local body-building course;
and S23, if the searching result is that a plurality of local body-building courses are searched according to the voice instruction, prompting a user to select the local body-building courses to be watched, and automatically switching to a starting interface of the selected local body-building courses after confirmation.
Specifically, the smart television has one local resource library, where various local resources, such as video of related body-building courses, are stored, but the local database generally stores less or less comprehensive resources, but the resource acquisition speed is faster if the resources meet the requirements. Therefore, after the intelligent television obtains the voice command, the intelligent television traverses the resources in the local resource library according to the voice command to search the local body-building course matched with the user demand, and displays the search result on a screen, wherein the search result can be that the matched body-building course exists or that the matched body-building course does not exist.
If the search result is that there are matched exercise courses, one or more of the exercise courses can be matched, and when the search result is that one local exercise course is found according to the voice instruction, the one exercise course is naturally selected directly, namely the intelligent television automatically switches to a starting interface of the local exercise course, such as a playing starting interface of a exercise video of a 'lean belly'. When the search result is that a plurality of local exercise courses are found according to the voice instruction, that is, a plurality of exercise courses meeting requirements exist, the intelligent television can prompt a user to select the local exercise courses needing to be watched, for example, the plurality of exercise courses meeting requirements are displayed on a screen of the intelligent television according to the matching degree sequence to prompt the user to select, the selection mode can be selected through a remote controller or voice, the selection mode is preferably selected through voice, when the user confirms that the intelligent television is automatically switched to a starting interface of the selected local exercise courses, for example, the screen is sequentially provided with a 'lean video 1', 'lean exercise video 2', 'lean exercise video 3', the user confirms to select the 'lean exercise video 1' through voice, and then the intelligent television is automatically switched to the starting interface of the 'lean exercise video 1'.
And step S30, if the body-building tutorial matched with the user requirement is not matched in the local resource library, acquiring the online body-building tutorial matched with the user requirement, and switching to a starting interface of the online body-building tutorial.
Fig. 4 is a flowchart of step S30 in the voice query method according to the present invention.
As shown in fig. 4, the step S30 includes:
s31, if the search result is that the body-building course matched with the user requirement is not matched in the local resource library according to the voice command, sending the voice command and a request for acquiring the body-building course to a recommendation server;
s32, receiving an online body-building course which is fed back by the recommendation server according to the voice instruction and the request and matched with the user requirement, and displaying a recommendation result of the recommendation server on a screen;
s33, if the recommendation result is that an online fitness course is recommended according to the voice instruction, automatically switching to a starting interface of the online fitness course;
and S34, if the recommendation result is that a plurality of local body-building courses are recommended according to the voice instruction, prompting the user to select an online body-building course to be watched, and automatically switching to a starting interface of the selected online body-building course after confirmation.
Specifically, when the intelligent terminal does not match a fitness course matching with the user requirement in the local resource library according to the voice command, that is, the local resource library does not have the fitness course required by the user as the search result of the intelligent television, in order to avoid the situation that the matched fitness course cannot be provided for the user, the intelligent terminal can send the voice command to the recommendation server through the intelligent television, and simultaneously send a request for acquiring the fitness course to the recommendation server to request to acquire the matched fitness course; the recommendation server is used for recommending related resources according to voice instructions of users, and after receiving the voice instructions and acquiring the request of the body-building tutorials, the recommendation server acquires the matched online body-building tutorials according to the voice instructions and sends the matched online body-building tutorials to the intelligent television, and the intelligent television receives recommendation results sent by the recommendation server and displays the recommendation results of the recommendation server on a screen.
The online fitness courses in the recommended results can be one or more, when the recommended results are that one online fitness course is recommended according to the voice instruction, the online fitness course is automatically switched to a starting interface of the online fitness course, and as only one online fitness course is recommended, the one fitness course is naturally and directly selected, namely the intelligent television is automatically switched to the starting interface of the online fitness course, for example, a playing starting interface of yoga online fitness video is entered; when the recommendation result is that a plurality of online body-building courses are recommended according to the voice instruction, prompting a user to select the online body-building courses to be watched, for example, displaying the plurality of online body-building courses meeting the requirements on a screen of the intelligent television according to the matching degree sequence to prompt the user to select, wherein the selection mode can be selected through a remote controller or voice, the selection is preferably performed through voice, and the method is automatically switched to a starting interface of the selected online body-building courses after confirmation; for example, "yoga online fitness video 1", "yoga online fitness video 2" and "yoga online fitness video 3" are recommended on the screen according to the sequencing, and the user selects "yoga online fitness video 2" through voice confirmation, so that the intelligent television automatically switches to a starting interface of "yoga online fitness video 2".
Further, if the recommended result obtained by the recommendation server is that the relevant exercise course cannot be matched, the current exercise course which the user wants to watch does not exist, or the relevant resources cannot be matched, or the user expression is incorrect, the intelligent television can prompt the user to change the voice information of the query exercise course, and the exercise course meeting the requirements is searched again.
Further, in order to enable the user to standardize the exercise operation, that is, to ensure that the user wears exercise clothing to perform exercise, when the smart television detects that the screen is switched to the local exercise course or the starting interface of the online exercise course, the smart television starts a camera to collect the current whole body image of the user, inputs the whole body image into a pre-trained classifier training model (the classifier training model is trained in advance according to a large amount of image data), and outputs a user clothing classification judgment result according to the whole body image, wherein the user clothing classification judgment result comprises exercise clothing and non-exercise clothing, if the user clothing classification judgment result is non-exercise clothing, the user pauses playing the local exercise course or the online exercise course within a preset time (for example, 3 minutes), and gives a voice prompt to replace exercise clothing, so that the risk of injury caused by improper clothing of the user performing exercise can be further standardized.
In addition, after the preset time (for example, the user completes the clothes replacement within 3 minutes), detecting the current whole body image of the user again through the camera, and if the user clothing classification judgment result is that the body-building clothing, continuing to play the local body-building course or the online body-building course.
Further, the smart tv may further obtain historical data of the user watching the exercise course for a preset number of times (for example, 10 times, or so in a period), analyze habits of the user watching the exercise course according to the historical data, obtain a preference type of the user about the exercise course (i.e., analyze a preference degree of the user about the exercise course type through big data), automatically recommend the exercise course with a matching degree higher than a preset threshold to the user according to the preference type when entering the exercise course query again, and prompt the user to select the currently recommended exercise course or select the exercise course to be watched through voice.
According to the invention, the voice instruction sent by the user is identified, the local body-building course is matched or the online body-building course is recommended according to the voice instruction, and the user jumps to the teaching interface of the body-building course for body-building learning and exercise (directly jumps to the corresponding body-building course page or performs other operations), so that the operation is simple, the body-building requirement of the user can be met, the intelligent degree of the product is improved, and convenience is brought to the user.
Further, as shown in fig. 5, based on the above voice query method, the present invention further provides a smart television, which includes a processor 10, a memory 20, and a display 30. Fig. 5 shows only some of the components of the intelligent television, but it should be understood that not all of the illustrated components are required to be implemented, and more or fewer components may alternatively be implemented.
The memory 20 may be an internal storage unit of the smart tv, such as a hard disk or a memory of the smart tv, in some embodiments. The memory 20 may also be an external storage device of the Smart tv in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like. Further, the memory 20 may also include both an internal storage unit and an external storage device of the smart tv. The memory 20 is used for storing application software and various data installed on the smart tv, for example, program codes for installing the smart tv. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, the memory 20 stores a voice query program 40, and the voice query program 40 is executable by the processor 10 to implement the voice query method of the present application.
The processor 10 may in some embodiments be a central processing unit (Central Processing Unit, CPU), microprocessor or other data processing chip for executing program code or processing data stored in the memory 20, for example for performing the voice query method or the like.
The display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like in some embodiments. The display 30 is used for displaying information on the smart television and for displaying a visual user interface. The components 10-30 of the smart television communicate with each other via a system bus.
In one embodiment, the following steps are implemented when the processor 10 executes the voice query 40 in the memory 20:
receiving voice of inquiring a body-building course sent by a user, and carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire;
searching a local body-building course matched with the user demand in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course;
and if the body-building course matched with the user requirement is not matched in the local resource library, acquiring an online body-building course matched with the user requirement, and switching to a starting interface of the online body-building course.
The method specifically comprises the steps of receiving voice of a body-building course inquired by a user, carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire, and specifically comprises the following steps:
starting a body-building mode and a recording mode according to the operation instruction or the voice control instruction of the user, and receiving the voice of inquiring the body-building course sent by the user in real time;
after the recording is finished, the voice is subjected to voice recognition through an ASR function, and a voice instruction of the exercise course which the user needs to inquire is generated according to semantic analysis.
The method comprises the steps of searching a local body-building course matched with the user requirement in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course, wherein the specific steps include:
traversing the local resource library according to the voice command of the user, searching the local body-building course matched with the user requirement, and displaying the searching result on a screen;
if the search result is that a local body-building course is found according to the voice instruction, automatically switching to a starting interface of the local body-building course;
and if the searching result is that a plurality of local body-building courses are searched according to the voice instruction, prompting the user to select the local body-building courses to be watched, and automatically switching to a starting interface of the selected local body-building courses after confirmation.
If the exercise course matched with the user requirement is not matched in the local resource library, acquiring an online exercise course matched with the user requirement, and switching to a starting interface of the online exercise course, wherein the method specifically comprises the following steps:
if the search result is that the exercise course matched with the user requirement is not matched in the local resource library according to the voice command, sending the voice command and a request for acquiring the exercise course to a recommendation server;
receiving an online body-building course which is fed back by the recommendation server according to the voice command and the request and matched with the user requirement, and displaying a recommendation result of the recommendation server on a screen;
if the recommendation result is that an online fitness course is recommended according to the voice instruction, automatically switching to a starting interface of the online fitness course;
and if the recommendation result is that a plurality of local body-building courses are recommended according to the voice instruction, prompting the user to select an online body-building course to be watched, and automatically switching to a starting interface of the selected online body-building course after confirmation.
Wherein, the acquiring the online fitness course matched with the user requirement further comprises:
and if the recommended result is that the related exercise course cannot be matched, prompting the user to change the voice information of the inquiry exercise course.
The voice query method further comprises the following steps:
when the screen is detected to be switched to the local body-building course or the starting interface of the online body-building course, starting a camera to acquire the current whole-body image of the user;
inputting the whole body image into a pre-trained classifier training model, and outputting a user clothing classification judgment result by the classifier training model according to the whole body image;
wherein, the user clothing classification judgment result comprises body-building clothing and non-body-building clothing;
if the user clothing classification judgment result is non-body-building clothing, the local body-building course or the online body-building course is paused in preset time, and a voice prompt is sent out to prompt the user to replace the body-building clothing.
Wherein, pause playing the local exercise course or the online exercise course in a preset time, and send out voice prompt to the user to replace the exercise garment, and then further comprise:
and detecting the current whole body image of the user through the camera again after the preset time, and if the user clothing classification judgment result is that the body-building clothing is body-building clothing, continuing to play the local body-building course or the online body-building course.
The voice query method further comprises the following steps:
acquiring historical data of the user watching the exercise course for preset times, and analyzing habits of the user watching the exercise course according to the historical data to obtain preference types of the user about the exercise course;
when the body-building course query is re-entered, automatically recommending the body-building course with the matching degree higher than the preset threshold value to the user according to the preference type, and prompting the user to select the currently recommended body-building course or selecting the body-building course to be watched through voice.
The present invention also provides a computer-readable storage medium storing a voice query program which, when executed by a processor, implements the steps of the voice query method as described above.
In summary, the present invention provides a voice query method, an intelligent television, and a computer-readable storage medium, where the method includes: receiving voice of inquiring a body-building course sent by a user, and carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire; searching a local body-building course matched with the user demand in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course; and if the body-building course matched with the user requirement is not matched in the local resource library, acquiring an online body-building course matched with the user requirement, and switching to a starting interface of the online body-building course. According to the invention, the voice instruction sent by the user is identified, the local body-building course is matched or the online body-building course is recommended according to the voice instruction, and the teaching interface of the body-building course is jumped to for the user to perform body-building learning and exercise, so that the operation is simple, the body-building requirement of the user can be met, and convenience is brought to the user.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Of course, those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by a computer program for instructing relevant hardware (e.g., processor, controller, etc.), the program may be stored on a computer readable storage medium, and the program may include the above described methods when executed. The computer readable storage medium may be a memory, a magnetic disk, an optical disk, etc.
It is to be understood that the invention is not limited in its application to the examples described above, but is capable of modification and variation in light of the above teachings by those skilled in the art, and that all such modifications and variations are intended to be included within the scope of the appended claims.
Claims (8)
1. A voice query method, the voice query method comprising:
receiving voice of inquiring a body-building course sent by a user, and carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire;
searching a local body-building course matched with the user demand in a local resource library according to the voice instruction, and switching to a starting interface of the local body-building course;
if the body-building course matched with the user requirement is not matched in the local resource library, acquiring an online body-building course matched with the user requirement, and switching to a starting interface of the online body-building course;
the method for inquiring the body-building course comprises the steps of receiving the voice of the body-building course sent by a user, carrying out voice recognition on the voice to obtain a voice instruction of the body-building course which the user needs to inquire, and specifically comprises the following steps:
starting a body-building mode and a recording mode according to the operation instruction or the voice control instruction of the user, and receiving the voice of inquiring the body-building course sent by the user in real time;
after the recording is finished, performing voice recognition on the voice through an ASR function, and generating a voice instruction of the exercise course which the user needs to query according to semantic analysis; the voice query method further comprises the following steps:
when the screen is detected to be switched to the local body-building course or the starting interface of the online body-building course, starting a camera to acquire the current whole-body image of the user;
inputting the whole body image into a pre-trained classifier training model, and outputting a user clothing classification judgment result by the classifier training model according to the whole body image;
wherein, the user clothing classification judgment result comprises body-building clothing and non-body-building clothing;
if the user clothing classification judgment result is non-body-building clothing, the local body-building course or the online body-building course is paused in preset time, and a voice prompt is sent out to prompt the user to replace the body-building clothing.
2. The voice query method of claim 1, wherein the searching a local exercise course matching the user's needs in a local resource library according to the voice command, and switching to a start interface of the local exercise course, specifically comprises:
traversing the local resource library according to the voice command of the user, searching the local body-building course matched with the user requirement, and displaying the searching result on a screen;
if the search result is that a local body-building course is found according to the voice instruction, automatically switching to a starting interface of the local body-building course;
and if the searching result is that a plurality of local body-building courses are searched according to the voice instruction, prompting the user to select the local body-building courses to be watched, and automatically switching to a starting interface of the selected local body-building courses after confirmation.
3. The voice query method of claim 2, wherein if the exercise tutorial matching the user requirement is not matched in the local repository, acquiring an online exercise tutorial matching the user requirement, and switching to a start interface of the online exercise tutorial, specifically comprising:
if the search result is that the exercise course matched with the user requirement is not matched in the local resource library according to the voice command, sending the voice command and a request for acquiring the exercise course to a recommendation server;
receiving an online body-building course which is fed back by the recommendation server according to the voice command and the request and matched with the user requirement, and displaying a recommendation result of the recommendation server on a screen;
if the recommendation result is that an online fitness course is recommended according to the voice instruction, automatically switching to a starting interface of the online fitness course;
and if the recommendation result is that a plurality of local body-building courses are recommended according to the voice instruction, prompting the user to select an online body-building course to be watched, and automatically switching to a starting interface of the selected online body-building course after confirmation.
4. The voice query method of claim 3, wherein said retrieving an online fitness tutorial that matches said user's needs further comprises, thereafter:
and if the recommended result is that the related exercise course cannot be matched, prompting the user to change the voice information of the inquiry exercise course.
5. The voice query method of claim 1, wherein the pausing the playing of the local or online fitness course for a preset time and the voice prompting the user to change the fitness garment further comprises:
and detecting the current whole body image of the user through the camera again after the preset time, and if the user clothing classification judgment result is that the body-building clothing is body-building clothing, continuing to play the local body-building course or the online body-building course.
6. The voice query method of claim 1, further comprising:
acquiring historical data of the user watching the exercise course for preset times, and analyzing habits of the user watching the exercise course according to the historical data to obtain preference types of the user about the exercise course;
when the body-building course query is re-entered, automatically recommending the body-building course with the matching degree higher than the preset threshold value to the user according to the preference type, and prompting the user to select the currently recommended body-building course or selecting the body-building course to be watched through voice.
7. An intelligent television, characterized in that, the intelligent television includes: memory, a processor and a voice query program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the voice query method of any of claims 1-6.
8. A computer readable storage medium, characterized in that the computer readable storage medium stores a speech query program, which when executed by a processor implements the steps of the speech query method according to any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011565632.4A CN114679614B (en) | 2020-12-25 | 2020-12-25 | Voice query method, intelligent television and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011565632.4A CN114679614B (en) | 2020-12-25 | 2020-12-25 | Voice query method, intelligent television and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114679614A CN114679614A (en) | 2022-06-28 |
| CN114679614B true CN114679614B (en) | 2024-02-06 |
Family
ID=82070268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011565632.4A Active CN114679614B (en) | 2020-12-25 | 2020-12-25 | Voice query method, intelligent television and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114679614B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103634644A (en) * | 2013-12-09 | 2014-03-12 | 乐视致新电子科技（天津）有限公司 | Method and system for switching channels of smart television through voices |
| CN105025200A (en) * | 2015-08-06 | 2015-11-04 | 成都市斯达鑫辉视讯科技有限公司 | Method for supervising user by set top box |
| CN105306972A (en) * | 2014-06-26 | 2016-02-03 | 中兴通讯股份有限公司 | Television program recommending method and server |
| CN106412673A (en) * | 2015-07-31 | 2017-02-15 | 中国移动通信集团公司 | Streaming media playing method and apparatus |
| CN107169048A (en) * | 2017-04-25 | 2017-09-15 | 北京威动科技有限公司 | A kind of film assets extension, film demand information sending method and device |
| CN107551521A (en) * | 2017-08-17 | 2018-01-09 | 广州视源电子科技股份有限公司 | Exercise guide method and device, smart machine and storage medium |
| WO2018043895A1 (en) * | 2016-08-31 | 2018-03-08 | 삼성전자 주식회사 | Display device and method for controlling display device |
| CN108334606A (en) * | 2018-02-01 | 2018-07-27 | 百度在线网络技术（北京）有限公司 | Voice interactive method, device and server for smart home |
| CN109036417A (en) * | 2018-07-03 | 2018-12-18 | 百度在线网络技术（北京）有限公司 | Method and apparatus for handling voice request |
| CN109741810A (en) * | 2018-12-27 | 2019-05-10 | 深圳创维－Rgb电子有限公司 | Body-building management method, device and computer readable storage medium |
| CN109947993A (en) * | 2019-03-14 | 2019-06-28 | 百度国际科技（深圳）有限公司 | Plot jump method, device and computer equipment based on speech recognition |
| CN110188701A (en) * | 2019-05-31 | 2019-08-30 | 上海媒智科技有限公司 | Dress ornament recognition methods, system and terminal based on the prediction of human body key node |
| CN110191365A (en) * | 2019-05-30 | 2019-08-30 | 深圳创维－Rgb电子有限公司 | It is a kind of for the method for action imitation, storage medium and system |
| CN110633319A (en) * | 2019-09-28 | 2019-12-31 | 绍兴柯桥浙工大创新研究院发展有限公司 | Big data analysis system for industrial design |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070055520A1 (en) * | 2005-08-31 | 2007-03-08 | Microsoft Corporation | Incorporation of speech engine training into interactive user tutorial |
| US9338493B2 (en) * | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
| US20160364397A1 (en) * | 2015-06-11 | 2016-12-15 | Qualcomm Incorporated | System and Methods for Locally Customizing Media Content for Rendering |
| CN108683937B (en) * | 2018-03-09 | 2020-01-21 | 百度在线网络技术（北京）有限公司 | Voice interaction feedback method and system for smart television and computer readable medium |
-
2020
- 2020-12-25 CN CN202011565632.4A patent/CN114679614B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103634644A (en) * | 2013-12-09 | 2014-03-12 | 乐视致新电子科技（天津）有限公司 | Method and system for switching channels of smart television through voices |
| CN105306972A (en) * | 2014-06-26 | 2016-02-03 | 中兴通讯股份有限公司 | Television program recommending method and server |
| CN106412673A (en) * | 2015-07-31 | 2017-02-15 | 中国移动通信集团公司 | Streaming media playing method and apparatus |
| CN105025200A (en) * | 2015-08-06 | 2015-11-04 | 成都市斯达鑫辉视讯科技有限公司 | Method for supervising user by set top box |
| WO2018043895A1 (en) * | 2016-08-31 | 2018-03-08 | 삼성전자 주식회사 | Display device and method for controlling display device |
| CN107169048A (en) * | 2017-04-25 | 2017-09-15 | 北京威动科技有限公司 | A kind of film assets extension, film demand information sending method and device |
| CN107551521A (en) * | 2017-08-17 | 2018-01-09 | 广州视源电子科技股份有限公司 | Exercise guide method and device, smart machine and storage medium |
| CN108334606A (en) * | 2018-02-01 | 2018-07-27 | 百度在线网络技术（北京）有限公司 | Voice interactive method, device and server for smart home |
| CN109036417A (en) * | 2018-07-03 | 2018-12-18 | 百度在线网络技术（北京）有限公司 | Method and apparatus for handling voice request |
| CN109741810A (en) * | 2018-12-27 | 2019-05-10 | 深圳创维－Rgb电子有限公司 | Body-building management method, device and computer readable storage medium |
| CN109947993A (en) * | 2019-03-14 | 2019-06-28 | 百度国际科技（深圳）有限公司 | Plot jump method, device and computer equipment based on speech recognition |
| CN110191365A (en) * | 2019-05-30 | 2019-08-30 | 深圳创维－Rgb电子有限公司 | It is a kind of for the method for action imitation, storage medium and system |
| CN110188701A (en) * | 2019-05-31 | 2019-08-30 | 上海媒智科技有限公司 | Dress ornament recognition methods, system and terminal based on the prediction of human body key node |
| CN110633319A (en) * | 2019-09-28 | 2019-12-31 | 绍兴柯桥浙工大创新研究院发展有限公司 | Big data analysis system for industrial design |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114679614A (en) | 2022-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105957530B (en) | Voice control method and device and terminal equipment | |
| CN110113646B (en) | AI voice-based intelligent interactive processing method, system and storage medium | |
| CN113596552B (en) | Display device and information display method | |
| CN106098063B (en) | Voice control method, terminal device and server | |
| CN103686344B (en) | Strengthen video system and method | |
| CN111683263A (en) | Live broadcast guiding method, device, equipment and computer readable storage medium | |
| CN108848419B (en) | Television interaction method based on biological characteristic recognition, smart television and storage medium | |
| CN109275047A (en) | Video information processing method and device, electronic equipment, storage medium | |
| CN112135170A (en) | Display device, server and video recommendation method | |
| CN109471954A (en) | Content recommendation method, device, equipment and storage medium based on mobile unit | |
| CN114679614B (en) | Voice query method, intelligent television and computer readable storage medium | |
| EP3790005A1 (en) | Electronic apparatus and control method thereof | |
| CN111327935B (en) | Information interaction platform based on artificial intelligence TV set | |
| CN113542797A (en) | Interaction method and device in video playing and computer readable storage medium | |
| CN115866339A (en) | Television program recommendation method and device, intelligent device and readable storage medium | |
| CN111225250B (en) | Video extended information processing method and device | |
| CN114297425A (en) | Recognition interaction method, device, medium and intelligent terminal | |
| CN115689642A (en) | Media content recommendation method and device, electronic equipment and storage medium | |
| CN112380871A (en) | Semantic recognition method, apparatus, and medium | |
| CN111552794A (en) | Prompt language generation method, device, equipment and storage medium | |
| CN111414883A (en) | Program recommendation method, terminal and storage medium based on face emotion | |
| CN111901552B (en) | Multimedia data transmission method and device and electronic equipment | |
| CN113596602A (en) | Intelligent matching method, television and computer readable storage medium | |
| CN113741770A (en) | Control method and system based on image recognition, vehicle and storage medium | |
| CN114168765A (en) | Server and media asset tag acquisition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |