CN113465282A - Screen device control method, refrigerator, and computer-readable storage medium - Google Patents

Screen device control method, refrigerator, and computer-readable storage medium Download PDF

Info

Publication number
CN113465282A
CN113465282A CN202010234538.4A CN202010234538A CN113465282A CN 113465282 A CN113465282 A CN 113465282A CN 202010234538 A CN202010234538 A CN 202010234538A CN 113465282 A CN113465282 A CN 113465282A
Authority
CN
China
Prior art keywords
interface
information
control method
word
words
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010234538.4A
Other languages
Chinese (zh)
Inventor
王广武
孔令磊
张景瑞
李桂玺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Refrigerator Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Refrigerator Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Refrigerator Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Refrigerator Co Ltd
Priority to CN202010234538.4A priority Critical patent/CN113465282A/en
Publication of CN113465282A publication Critical patent/CN113465282A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/003Arrangement or mounting of control or safety devices for movable devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/005Mounting of control devices
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2400/00General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
    • F25D2400/36Visual displays
    • F25D2400/361Interactive visual displays
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a screen device control method, a refrigerator and a computer readable storage medium, wherein the control method comprises the following steps: receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface; receiving and recognizing voice information and confirming interface word information included in the voice information; and if the interface words matched with the interface word information exist in the functional interface, executing corresponding operations of the interface words. Therefore, the screen can identify and store the interface words of the functional interface in advance, quickly identify the content related to the interface words and execute the related operation, so that the time is saved, the error is reduced, and the intellectualization of the refrigerator is improved.

Description

Screen device control method, refrigerator, and computer-readable storage medium
Technical Field
The invention relates to the field of intelligent control of refrigerators, in particular to a screen device control method, a refrigerator and a computer readable storage medium.
Background
With the further improvement of the living standard of people and the further development of science and technology, the requirements of users on household appliances are further improved, and intelligent, personalized and humanized home experience is required.
On the current intelligent refrigerator, a large screen is generally arranged to display different refrigerator function scenes and also support voice conversation with a user. However, in the practical application of voice, the semantics of the user are more generalized, and the user requirements cannot be accurately matched. Therefore, the interaction with the refrigerator is caused to be problematic, the interaction time is prolonged, and the intelligent experience is reduced.
Therefore, it is necessary to design a new screen device control method, a refrigerator, and a computer-readable storage medium that can better recognize the user's voice semantics.
Disclosure of Invention
In order to solve the above problem, the present invention provides a screen device control method, including:
receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface;
receiving and recognizing voice information and confirming interface word information included in the voice information;
and if the interface words matched with the interface word information exist in the functional interface, executing corresponding operations of the interface words.
As a further refinement of the invention, the step of "receiving and identifying input information" comprises: voice input information or screen contact information of a user is received and recognized.
As a further improvement of the present invention, the "functional interface" includes: video interface, menu interface.
As a further improvement of the present invention, the step of "identifying all interface words within said functional interface" comprises:
distinguishing each functional unit in the functional interface;
and respectively identifying the interface words of the functional units.
As a further improvement of the present invention, the step of "confirming the interface word information in the voice information" includes:
confirming the function unit to which the interface word corresponding to the interface word information belongs;
the step of executing the operation corresponding to the interface word comprises the following steps:
and executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs.
As a further improvement of the invention, the step of entering the corresponding function interface comprises the following steps:
presetting default operation of the functional interface;
the step of executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs includes:
a default operation is performed on the functional unit.
As a further improvement of the present invention, the step of "receiving and recognizing voice information" comprises:
receiving and identifying operation information in the voice information and recording the operation information as instruction operation;
the step of executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs includes:
instruction operations are performed on the functional unit.
As a further improvement of the present invention, the step of "confirming the interface word information included in the voice information" and "performing the operation related to the function unit to which the interface word corresponding to the interface word information belongs" includes:
outputting at least one functional unit related to the interface word;
receiving selection information of a user;
and confirming the functional unit selected by the user.
In order to solve the problems, the invention provides a refrigerator which comprises a refrigerator body, wherein a screen and a pickup device are arranged on the refrigerator body; the refrigerator further comprises a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor executes the program to realize the steps of the screen device control method.
In order to solve the above-mentioned problems, the present invention proposes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps in the screen device control method as described above.
The invention has the beneficial effects that: initially, input information input by a user is received and recognized, and the screen enters a function interface requested by the user. Then, the background starts to recognize all interface words in the function interface, so that when the user sends out the voice information again, if the voice information comprises the interface words related to the function interface, the screen can start to execute the operations related to the interface words. Therefore, after entering a certain function interface, the screen can identify and store the interface words of the function interface in advance, so that when a user sends voice information, the screen can quickly identify the content related to the interface words and execute the related operation, the time is saved, the error is reduced, and the intellectualization of the refrigerator is improved.
Drawings
FIG. 1 is a flow chart of a method for controlling a screen device according to the present invention;
fig. 2 is a schematic structural view of a refrigerator according to the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the present invention provides a screen device control method, including:
receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface;
receiving and recognizing voice information and confirming interface word information included in the voice information;
and if the interface words matched with the interface word information exist in the functional interface, executing corresponding operations of the interface words.
Initially, input information input by the user is received and recognized, and the screen 11 enters a function interface requested by the user. Then, the background starts to recognize all interface words in the function interface, so that when the user sends out the voice message again, if the voice message includes the interface word related to the function interface, the screen 11 may start to execute the operation related to the interface word. Therefore, after entering a certain function interface, the screen 11 can recognize and store the interface words of the function interface in advance, so that when the user sends out voice information, the screen 11 can quickly recognize the content related to the interface words and execute the related operation, thereby saving time, reducing the occurrence of errors and improving the intelligence of the refrigerator 100.
For example, the function interface may include a video interface and a menu interface, and of course, other interfaces may be included in the function interface within the scope of the present invention. In the present embodiment, a video interface is taken as an example for detailed description.
The interface words refer to words, sentences and the like displayed in the functional interface. For example, after the screen 11 enters the video interface, the screen 11 displays each video and the topic names related to each video, and these topic names are interface words in the function interface. Then, the user sends out voice information for recognition, if the voice information sent out by the user contains the theme name of a certain video, the interface word information in the voice information can be regarded as corresponding to the interface word of the functional interface, and then the relevant operation of the video, such as playing, deleting, collecting and the like, can be executed.
In addition, the step of "receiving and recognizing input information" includes: voice input information or screen contact information of a user is received and recognized. Initially, the user may output information through voice input or screen 11 contact to enter the corresponding function interface. When entering the corresponding function interface, the input may not be limited to only voice input, and of course, a method of touch input on the screen 11 may also be adopted.
Further, the step of "identifying all interface words within said functional interface" comprises:
distinguishing each functional unit in the functional interface;
and respectively identifying the interface words of the functional units.
The function interface usually has a plurality of function units, and each function unit has a corresponding interface word. For example, in a video interface, each video corresponds to a corresponding functional unit. Therefore, the functional units in the functional interface are distinguished firstly, and then the interface words of each functional unit are identified respectively, so that the interface words can be distinguished in different categories, and the matching with the voice information is easier and more convenient in the subsequent process.
Thus, the step of "confirming the interface word information in the voice information" includes:
confirming the function unit to which the interface word corresponding to the interface word information belongs;
the step of executing the operation corresponding to the interface word comprises the following steps:
and executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs.
After the functional unit is confirmed, the functional unit is matched with the corresponding interface word, and when the operation related to the interface word is executed, the operation related to the functional unit can be executed equivalently. For example, in a video interface, each video corresponds to a corresponding functional unit, each functional unit corresponds to an interface word, and thus corresponds to a corresponding topic name for each video, and when an operation related to the interface word, i.e., the topic name, is performed, i.e., the operation related to the corresponding video is performed.
Further, the related operation is performed on the functional unit or the interface word, and the "related operation" may be obtained in various ways. Two specific embodiments are provided in the present invention.
In one embodiment, the step "enter corresponding function interface" includes:
presetting default operation of the functional interface;
the step of executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs includes:
a default operation is performed on the functional unit.
That is, after entering the function interface and before executing the operation related to the function unit, a default operation is preset, and then the "related operation" is executed, that is, the default operation is executed. Or taking a video interface as an example, if the default operation of the functional interface, i.e. the video is played when the functional unit is opened, after the video interface is entered, the user only needs to output the interface word, i.e. the topic name, of a certain video by voice, and then the video can be directly played without outputting other voice information by the user, so that the fault tolerance rate is improved, and the intelligent efficiency is further improved.
In the second embodiment, the step of "receiving and recognizing the voice information" includes:
receiving and identifying operation information in the voice information and recording the operation information as instruction operation;
the step of executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs includes:
instruction operations are performed on the functional unit.
In this embodiment, when outputting the voice information, the user not only outputs the interface word, but actually also outputs the operation information, and the operation information is received, recognized and recorded as the instruction operation. The "related operation" is executed, that is, the instruction operation in the user voice information is executed on the functional unit. Taking the video interface as an example, when the user outputs the voice information, the user also outputs similar instruction operations such as "play", "delete", "collect", and the like, that is, the user can perform operations such as "play", "delete", "collect", and the like on the corresponding video. Therefore, the functional units are operated more accurately, and diversified requirements of users are met.
In addition, the voice information output by the user comprises a plurality of interface words, or one interface word can correspond to a plurality of functional units. Therefore, the steps of "confirming the interface word information included in the voice information" and "performing the operation related to the function unit to which the interface word corresponding to the interface word information belongs" include:
outputting at least one functional unit related to the interface word;
receiving selection information of a user;
and confirming the functional unit selected by the user.
That is, at least one function unit related to the interface word is displayed on the screen 11 for the user to select. Also, the user's selection information may be made through a voice output or a screen 11 touch input. And after confirming the functional unit selected by the user, executing relevant operation on the functional unit.
The control method of the screen device in the present invention is applied to the refrigerator 100, and thus, as shown in fig. 2, the present invention also provides a refrigerator 100, which includes a cabinet, on which a screen 11 and a sound pickup device 12 are provided; the refrigerator 100 further comprises a memory storing a computer program operable on the processor, and a processor implementing the steps in the screen device control method as described above when executing the program. That is to say, the steps in any one of the above-mentioned screen device control methods are implemented.
The present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps in the screen device control method described above. That is, the steps in any one of the above-described screen device control methods are implemented.
Therefore, in summary, the input information input by the user is received and recognized, the screen 11 enters the function interface requested by the user, and the background starts to recognize all interface words in the function interface, so that when the user utters the voice information again, if the voice information includes the interface word related to the function interface, the screen 11 may start to execute the operation related to the interface word. Therefore, after entering a certain function interface, the screen 11 can recognize and store the interface words of the function interface in advance, so that when the user sends out voice information, the screen 11 can quickly recognize the content related to the interface words and execute the related operation, thereby saving time, reducing the occurrence of errors and improving the intelligence of the refrigerator 100.
It should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art will be able to make the description as a whole, and the embodiments may be appropriately combined to form other embodiments as will be appreciated by those skilled in the art.
The above detailed description is merely illustrative of possible embodiments of the present invention and is not intended to limit the scope of the invention, which is intended to include all equivalent embodiments or modifications within the scope of the present invention without departing from the technical spirit of the present invention.

Claims (10)

1. A screen device control method, characterized in that the control method comprises:
receiving and identifying input information, entering a corresponding function interface, and identifying all interface words in the function interface;
receiving and recognizing voice information and confirming interface word information included in the voice information;
and if the interface words matched with the interface word information exist in the functional interface, executing corresponding operations of the interface words.
2. The control method of claim 1, wherein the step of "receiving and identifying input information" comprises: voice input information or screen contact information of a user is received and recognized.
3. The control method according to claim 1, wherein the "function interface" includes: video interface, menu interface.
4. The control method of claim 1, wherein the step of identifying all interface words within the functional interface comprises:
distinguishing each functional unit in the functional interface;
and respectively identifying the interface words of the functional units.
5. The control method according to claim 4, wherein the step of "confirming interface word information in the voice information" includes:
confirming the function unit to which the interface word corresponding to the interface word information belongs;
the step of executing the operation corresponding to the interface word comprises the following steps:
and executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs.
6. The control method according to claim 5, wherein the step of entering the corresponding function interface comprises, after:
presetting default operation of the functional interface;
the step of executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs includes:
a default operation is performed on the functional unit.
7. The control method of claim 5, wherein the step of "receiving and recognizing voice information" comprises:
receiving and identifying operation information in the voice information and recording the operation information as instruction operation;
the step of executing the operation related to the function unit to which the interface word corresponding to the interface word information belongs includes:
instruction operations are performed on the functional unit.
8. The control method according to claim 5, wherein the step of "confirming interface word information included in the voice information" and "performing an operation related to a functional unit to which an interface word corresponding to the interface word information belongs" includes:
outputting at least one functional unit related to the interface word;
receiving selection information of a user;
and confirming the functional unit selected by the user.
9. A refrigerator is characterized by comprising a box body, wherein a screen and a pickup device are arranged on the box body; the refrigerator further comprises a memory storing a computer program executable on the processor and a processor implementing the steps in the screen device control method of any one of claims 1-8 when executing the program.
10. A computer-readable storage medium on which a computer program is stored, the computer program, when being executed by a processor, implementing the steps in the screen device control method according to any one of claims 1 to 8.
CN202010234538.4A 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium Pending CN113465282A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010234538.4A CN113465282A (en) 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010234538.4A CN113465282A (en) 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium

Publications (1)

Publication Number Publication Date
CN113465282A true CN113465282A (en) 2021-10-01

Family

ID=77865938

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010234538.4A Pending CN113465282A (en) 2020-03-30 2020-03-30 Screen device control method, refrigerator, and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN113465282A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219388A (en) * 2014-08-28 2014-12-17 小米科技有限责任公司 Voice control method and device
CN107146622A (en) * 2017-06-16 2017-09-08 合肥美的智能科技有限公司 Refrigerator, voice interactive system, method, computer equipment, readable storage medium storing program for executing
CN109741738A (en) * 2018-12-10 2019-05-10 平安科技(深圳)有限公司 Sound control method, device, computer equipment and storage medium
CN110060679A (en) * 2019-04-23 2019-07-26 诚迈科技(南京)股份有限公司 A kind of exchange method and system of whole process voice control
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN110782886A (en) * 2018-07-30 2020-02-11 阿里巴巴集团控股有限公司 System, method, television, device and medium for speech processing

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219388A (en) * 2014-08-28 2014-12-17 小米科技有限责任公司 Voice control method and device
CN107146622A (en) * 2017-06-16 2017-09-08 合肥美的智能科技有限公司 Refrigerator, voice interactive system, method, computer equipment, readable storage medium storing program for executing
CN110782886A (en) * 2018-07-30 2020-02-11 阿里巴巴集团控股有限公司 System, method, television, device and medium for speech processing
CN109741738A (en) * 2018-12-10 2019-05-10 平安科技(深圳)有限公司 Sound control method, device, computer equipment and storage medium
CN110060679A (en) * 2019-04-23 2019-07-26 诚迈科技(南京)股份有限公司 A kind of exchange method and system of whole process voice control
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile

Similar Documents

Publication Publication Date Title
US10489112B1 (en) Method for user training of information dialogue system
US10692504B2 (en) User profiling for voice input processing
CN105446146B (en) Intelligent terminal control method, system and intelligent terminal based on semantic analysis
CN102842306B (en) Sound control method and device, voice response method and device
US20140028780A1 (en) Producing content to provide a conversational video experience
JP2011209786A (en) Information processor, information processing method, and program
CN109634501B (en) Electronic book annotation adding method, electronic equipment and computer storage medium
JP2003263188A (en) Voice command interpreter with dialog focus tracking function, its method and computer readable recording medium with the method recorded
CN111899859A (en) Surgical instrument counting method and device
CN109445879A (en) Method, storage medium and the equipment of monitor video are shown with suspended window
WO2018094852A1 (en) Virtual reality device and input control method for virtual reality device
US20210335357A1 (en) Method for controlling intelligent speech apparatus, electronic device and storage medium
WO2022026010A1 (en) Intelligent captioning
CN118020100A (en) Voice data processing method and device
CN108492826B (en) Audio processing method and device, intelligent equipment and medium
CN109658924B (en) Session message processing method and device and intelligent equipment
KR20170005590A (en) Voice Call Recording Method And Terminal Threof
JP4223832B2 (en) Adaptive spoken dialogue system and method
CN113465282A (en) Screen device control method, refrigerator, and computer-readable storage medium
WO2017092322A1 (en) Method for operating browser on smart television and smart television
CN113465281A (en) Screen device control method, refrigerator, and computer-readable storage medium
CN110910879A (en) Voice control method, system and device based on intelligent laser pen and readable storage medium
CN117319340A (en) Voice message playing method, device, terminal and storage medium
CN113868445A (en) Continuous playing position determining method and continuous playing system
CN113223510A (en) Refrigerator and equipment voice interaction method and computer readable storage medium thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20211001