CN113465281A - Screen device control method, refrigerator, and computer-readable storage medium - Google Patents

Screen device control method, refrigerator, and computer-readable storage medium Download PDF

Info

Publication number
CN113465281A
CN113465281A CN202010234536.5A CN202010234536A CN113465281A CN 113465281 A CN113465281 A CN 113465281A CN 202010234536 A CN202010234536 A CN 202010234536A CN 113465281 A CN113465281 A CN 113465281A
Authority
CN
China
Prior art keywords
interface
word
information
control method
confirming
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010234536.5A
Other languages
Chinese (zh)
Inventor
王广武
孔令磊
张景瑞
李桂玺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Refrigerator Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Refrigerator Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Refrigerator Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Refrigerator Co Ltd
Priority to CN202010234536.5A priority Critical patent/CN113465281A/en
Priority to PCT/CN2021/075146 priority patent/WO2021196883A1/en
Publication of CN113465281A publication Critical patent/CN113465281A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/003Arrangement or mounting of control or safety devices for movable devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/005Mounting of control devices
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2400/00General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
    • F25D2400/36Visual displays
    • F25D2400/361Interactive visual displays
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Thermal Sciences (AREA)
  • Mechanical Engineering (AREA)
  • Combustion & Propulsion (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention provides a screen device control method, a refrigerator and a computer readable storage medium, wherein the control method comprises the following steps: receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface; receiving and recognizing voice information, and confirming interface word information included in the voice information; if an interface word matched with the interface word information exists in the functional interface, displaying instruction operation related to the interface word; receiving and confirming the selected instruction operation; and executing the corresponding operation of the interface word. Therefore, if the voice information comprises interface word information related to the function interface, the screen can display instruction operation related to the interface word for the user to select, and after the user selects and confirms the instruction operation, the screen can start to execute the instruction operation related to the interface word. Therefore, the screen can identify and store the interface words of the functional interface in advance, and can quickly identify the content related to the interface words and execute the related operation, so that the time is saved, the error is reduced, and the intellectualization of the refrigerator is improved.

Description

Screen device control method, refrigerator, and computer-readable storage medium
Technical Field
The invention relates to the field of intelligent control of refrigerators, in particular to a screen device control method, a refrigerator and a computer readable storage medium.
Background
With the further improvement of the living standard of people and the further development of science and technology, the requirements of users on household appliances are further improved, and intelligent, personalized and humanized home experience is required.
On the current intelligent refrigerator, a large screen is generally arranged to display different refrigerator function scenes and also support voice conversation with a user. However, in the practical application of voice, the semantics of the user are more generalized, and the user requirements cannot be accurately matched. Therefore, the interaction with the refrigerator is caused to be problematic, the interaction time is prolonged, and the intelligent experience is reduced.
Therefore, it is necessary to design a new screen device control method, a refrigerator, and a computer-readable storage medium that can better recognize the user's voice semantics.
Disclosure of Invention
In order to solve the above problem, the present invention provides a screen device control method, including:
receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface;
receiving and recognizing voice information, and confirming interface word information included in the voice information;
if an interface word matched with the interface word information exists in the functional interface, displaying instruction operation related to the interface word;
receiving and confirming the selected instruction operation;
and executing the corresponding operation of the interface word.
As a further refinement of the invention, the step of "receiving and identifying input information" comprises: voice input information or screen contact information of a user is received and recognized.
As a further improvement of the present invention, the "functional interface" includes: video interface, menu interface.
As a further improvement of the present invention, the step "identifying all interface words within the functional interface" includes:
distinguishing each functional unit in the functional interface;
and respectively identifying the interface words of the functional units.
As a further improvement of the invention, the step of confirming the interface word information in the voice information comprises the following steps:
confirming the function unit to which the interface word corresponding to the interface word information belongs;
the step of displaying the instruction operation related to the interface word comprises the following steps:
displaying instruction operation related to the functional unit;
the step of executing the operation corresponding to the interface word comprises the following steps:
instruction operations are performed on the functional unit.
As a further improvement of the present invention, the step of "confirming the function unit to which the interface word corresponding to the interface word information belongs" and "displaying the instruction operation related to the function unit" includes:
outputting at least one functional unit related to the interface word;
receiving selection information of a user;
and confirming the functional unit selected by the user.
As a further improvement of the present invention, the step of "receiving and confirming the selected instruction operation" includes:
receiving and confirming voice selection information or screen contact selection information of a user.
In order to solve the problems, the invention provides a refrigerator which comprises a refrigerator body, wherein a screen and a pickup device are arranged on the refrigerator body; the refrigerator further comprises a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor executes the program to realize the steps of the screen device control method.
In order to solve the above-mentioned problems, the present invention proposes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps in the screen device control method as described above.
The invention has the beneficial effects that: initially, input information input by a user is received and recognized, and the screen enters a function interface requested by the user. Then, the background starts to recognize all interface words in the function interface, so that when the user sends voice information again, if the voice information comprises the interface words related to the function interface, the screen can display the instruction operation related to the interface words for the user to select, and after the user selects and confirms the instruction operation, the screen can start to execute the instruction operation related to the interface words. Therefore, after entering a certain function interface, the screen can identify and store the interface words of the function interface in advance, so that when a user sends voice information, the screen can quickly identify the content related to the interface words and execute the related operation, the time is saved, the error is reduced, and the intellectualization of the refrigerator is improved.
Drawings
FIG. 1 is a flow chart of a method for controlling a screen device according to the present invention;
fig. 2 is a schematic structural view of a refrigerator according to the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the present invention provides a screen device control method, including:
receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface;
receiving and recognizing voice information, and confirming interface word information included in the voice information;
if an interface word matched with the interface word information exists in the functional interface, displaying instruction operation related to the interface word;
receiving and confirming the selected instruction operation;
executing the operation corresponding to the interface word
Initially, input information input by the user is received and recognized, and the screen 11 enters a function interface requested by the user. Then, the background immediately starts to recognize all interface words in the function interface, so that when the user sends out the voice information again, if the voice information includes the interface words related to the function interface, the screen 11 can display the instruction operation related to the interface words for the user to select, and after the user selects and confirms the instruction operation, the screen 11 can start to execute the instruction operation related to the interface words. Therefore, after entering a certain function interface, the screen 11 can recognize and store the interface words of the function interface in advance, so that when the user sends out voice information, the screen 11 can quickly recognize the content related to the interface words and execute the related operation, thereby saving time, reducing the occurrence of errors and improving the intelligence of the refrigerator 100.
For example, the function interface may include a video interface and a menu interface, and of course, other interfaces may be included in the function interface within the scope of the present invention. In the present embodiment, a video interface is taken as an example for detailed description.
After the screen 11 enters the video interface, each video and the topic names related to each video are displayed on the screen 11, and the topic names are interface words in the function interface. Then, the user sends out voice information for recognition, if the voice information sent out by the user contains a topic name of a certain video, the interface word in the voice information can be regarded as corresponding to the interface word of the functional interface, and the screen 11 further pops up the relevant instruction operation of the interface word, such as playing, deleting, collecting and the like, for the user to select. And after the instruction is selected and confirmed by the user, the instruction operation is started to be executed.
In addition, the step of "receiving and recognizing input information" includes: voice input information or screen contact information of a user is received and recognized. Initially, the user may output information through voice input or screen 11 contact to enter the corresponding function interface. When entering the corresponding function interface, the input may not be limited to only voice input, and of course, a method of touch input on the screen 11 may also be adopted.
Likewise, the step of "receiving and confirming the selected command operation" includes:
voice selection information of the user or screen 11 contact selection information is received and confirmed. Of course, other ways of allowing the user to select and confirm are also within the scope of the present invention.
Further, the step of "identifying all interface words within the functional interface" includes:
distinguishing each functional unit in the functional interface;
and respectively identifying the interface words of the functional units.
The function interface usually has a plurality of function units, and each function unit has a corresponding interface word. For example, in a video interface, each video corresponds to a corresponding functional unit. Therefore, the functional units in the functional interface are distinguished firstly, and then the interface words of each functional unit are identified respectively, so that the interface words can be distinguished in different categories, and the matching with the voice information is easier and more convenient in the subsequent process.
Thus, the step "confirming interface word information in voice information" includes:
confirming the function unit to which the interface word corresponding to the interface word information belongs;
the step of displaying the instruction operation related to the interface word comprises the following steps:
displaying instruction operation related to the functional unit;
the step of executing the operation corresponding to the interface word comprises the following steps:
instruction operations are performed on the functional unit.
After the functional unit is confirmed, the functional unit is matched with the corresponding interface word, and then the instruction operation related to the interface word is displayed, namely the instruction operation related to the functional unit is displayed; executing the instruction operation related to the interface word is also the execution of the instruction operation on the functional unit. For example, in the video interface, each video corresponds to a corresponding function unit, each function unit corresponds to an interface word, and each function unit corresponds to a corresponding topic name, and after the interface word is confirmed, the instruction operations related to the topic names, such as the above-mentioned playing, deleting, collecting, etc., can be displayed on the screen 11. The user further selects the above instruction operation, and after the user selection is confirmed, for example, the user selects the instruction operation of "play", the video can be played on the screen 11.
In addition, the voice information output by the user comprises a plurality of interface words, or one interface word can correspond to a plurality of functional units. Therefore, the steps of "confirming the function unit to which the interface word corresponding to the interface word information belongs" and "displaying the instruction operation related to the function unit" include:
outputting at least one functional unit related to the interface word;
receiving selection information of a user;
and confirming the functional unit selected by the user.
That is, at least one function unit related to the interface word is displayed on the screen 11 for the user to select. Also, the user's selection information may be made through a voice output or a screen 11 touch input. And after confirming the functional unit selected by the user, executing relevant operation on the functional unit.
The control method of the screen device in the present invention is applied to the refrigerator 100, and thus, as shown in fig. 2, the present invention also provides a refrigerator 100, which includes a cabinet, on which a screen 11 and a sound pickup device are provided; the refrigerator 100 further comprises a memory storing a computer program operable on the processor, and a processor implementing the steps in the screen device control method as described above when executing the program. That is to say, the steps in any one of the above-mentioned screen device control methods are implemented.
The present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps in the screen device control method described above. That is, the steps in any one of the above-described screen device control methods are implemented.
Therefore, in summary, the input information input by the user is received and recognized, and the screen 11 enters the functional interface requested by the user. Then, the background immediately starts to recognize all interface words in the function interface, so that when the user sends out the voice information again, if the voice information includes the interface words related to the function interface, the screen 11 can display the instruction operation related to the interface words for the user to select, and after the user selects and confirms the instruction operation, the screen 11 can start to execute the instruction operation related to the interface words. Therefore, after entering a certain function interface, the screen 11 can recognize and store the interface words of the function interface in advance, so that when the user sends out voice information, the screen 11 can quickly recognize the content related to the interface words and execute the related operation, thereby saving time, reducing the occurrence of errors and further improving the intelligence of the refrigerator 100.
It should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art will be able to make the description as a whole, and the embodiments may be appropriately combined to form other embodiments as will be appreciated by those skilled in the art.
The above detailed description is merely illustrative of possible embodiments of the present invention and is not intended to limit the scope of the invention, which is intended to include all equivalent embodiments or modifications within the scope of the present invention without departing from the technical spirit of the present invention.

Claims (9)

1. A screen device control method, characterized in that the control method comprises:
receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface;
receiving and recognizing voice information, and confirming interface word information included in the voice information;
if an interface word matched with the interface word information exists in the functional interface, displaying instruction operation related to the interface word;
receiving and confirming the selected instruction operation;
and executing the corresponding operation of the interface word.
2. The control method of claim 1, wherein the step of "receiving and identifying input information" comprises: voice input information or screen contact information of a user is received and recognized.
3. The control method according to claim 1, wherein the "function interface" includes: video interface, menu interface.
4. The control method of claim 1, wherein the step of "identifying all interface words within a functional interface" comprises:
distinguishing each functional unit in the functional interface;
and respectively identifying the interface words of the functional units.
5. The control method according to claim 4, wherein the step of confirming the interface word information in the voice message comprises:
confirming the function unit to which the interface word corresponding to the interface word information belongs;
the step of displaying the instruction operation related to the interface word comprises the following steps:
displaying instruction operation related to the functional unit;
the step of executing the operation corresponding to the interface word comprises the following steps:
instruction operations are performed on the functional unit.
6. The control method according to claim 5, wherein the step between "confirming the function unit to which the interface word corresponding to the interface word information belongs" and "displaying the instruction operation related to the function unit" comprises:
outputting at least one functional unit related to the interface word;
receiving selection information of a user;
and confirming the functional unit selected by the user.
7. The control method of claim 1, wherein the step of receiving and confirming the selected command operation comprises:
receiving and confirming voice selection information or screen contact selection information of a user.
8. A refrigerator is characterized by comprising a box body, wherein a screen and a pickup device are arranged on the box body; the refrigerator further comprises a memory storing a computer program executable on the processor and a processor implementing the steps in the screen device control method of any one of claims 1-7 when executing the program.
9. A computer-readable storage medium on which a computer program is stored, the computer program, when being executed by a processor, implementing the steps in the screen device control method according to any one of claims 1 to 7.
CN202010234536.5A 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium Pending CN113465281A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010234536.5A CN113465281A (en) 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium
PCT/CN2021/075146 WO2021196883A1 (en) 2020-03-30 2021-02-04 Screen device control method, refrigerator, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010234536.5A CN113465281A (en) 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium

Publications (1)

Publication Number Publication Date
CN113465281A true CN113465281A (en) 2021-10-01

Family

ID=77865965

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010234536.5A Pending CN113465281A (en) 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN113465281A (en)
WO (1) WO2021196883A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219388A (en) * 2014-08-28 2014-12-17 小米科技有限责任公司 Voice control method and device
CN109324516A (en) * 2018-09-26 2019-02-12 珠海格力电器股份有限公司 A kind of method, apparatus, control equipment and the storage medium at switching interface
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN110782886A (en) * 2018-07-30 2020-02-11 阿里巴巴集团控股有限公司 System, method, television, device and medium for speech processing
CN110865755A (en) * 2019-11-11 2020-03-06 珠海格力电器股份有限公司 Voice control method and device of terminal, storage medium and terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103542687B (en) * 2013-09-29 2015-09-30 澳柯玛股份有限公司 A kind of intelligence control system for refrigerator and operation method thereof
CN109493856A (en) * 2017-09-12 2019-03-19 合肥美的智能科技有限公司 Identify method and apparatus, household electrical appliance and the machine readable storage medium of voice
CN109269209A (en) * 2018-08-10 2019-01-25 南京熊猫电子制造有限公司 A kind of intelligent refrigerator based on touch control display terminal
CN109595857A (en) * 2018-11-08 2019-04-09 上海优悦信息科技有限公司 A kind of method and refrigerator for being interacted based on refrigerator

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219388A (en) * 2014-08-28 2014-12-17 小米科技有限责任公司 Voice control method and device
CN110782886A (en) * 2018-07-30 2020-02-11 阿里巴巴集团控股有限公司 System, method, television, device and medium for speech processing
CN109324516A (en) * 2018-09-26 2019-02-12 珠海格力电器股份有限公司 A kind of method, apparatus, control equipment and the storage medium at switching interface
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN110865755A (en) * 2019-11-11 2020-03-06 珠海格力电器股份有限公司 Voice control method and device of terminal, storage medium and terminal

Also Published As

Publication number Publication date
WO2021196883A1 (en) 2021-10-07

Similar Documents

Publication Publication Date Title
US10489112B1 (en) Method for user training of information dialogue system
US10692504B2 (en) User profiling for voice input processing
US20210397309A1 (en) Interface display method and apparatus, and storage medium
US8788269B2 (en) Satisfying specified intent(s) based on multimodal request(s)
US9454964B2 (en) Interfacing device and method for supporting speech dialogue service
CN109634501B (en) Electronic book annotation adding method, electronic equipment and computer storage medium
WO2013102892A1 (en) A system and method for generating personalized sensor-based activation of software
JP2013143151A (en) Method and device for performing user function by using voice recognition
US20140028780A1 (en) Producing content to provide a conversational video experience
CN111949240A (en) Interaction method, storage medium, service program, and device
CN112286485B (en) Method and device for controlling application through voice, electronic equipment and storage medium
WO2017156983A1 (en) List callup method and device
CN112231021A (en) Method and device for guiding new software function
CN111899859A (en) Surgical instrument counting method and device
CN109364477A (en) Play Mah-Jong the method and device of game based on voice control
US10664522B2 (en) Interactive voice based assistant for object assistance
CN108062952B (en) Voice control method, device and system
CN109889921A (en) A kind of audio-video creation, playback method and device having interactive function
CN109525899A (en) The method and device that subtitle and audio video synchronization are presented
CN109658924B (en) Session message processing method and device and intelligent equipment
CN113465281A (en) Screen device control method, refrigerator, and computer-readable storage medium
CN113465282A (en) Screen device control method, refrigerator, and computer-readable storage medium
WO2017092322A1 (en) Method for operating browser on smart television and smart television
CN113223510B (en) Refrigerator and equipment voice interaction method and computer readable storage medium thereof
CN113282268B (en) Sound effect configuration method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20211001