CN110096211B - Control method of household appliance and household appliance - Google Patents

Control method of household appliance and household appliance Download PDF

Info

Publication number
CN110096211B
CN110096211B CN201910363983.8A CN201910363983A CN110096211B CN 110096211 B CN110096211 B CN 110096211B CN 201910363983 A CN201910363983 A CN 201910363983A CN 110096211 B CN110096211 B CN 110096211B
Authority
CN
China
Prior art keywords
voice
display screen
touch
touch display
gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910363983.8A
Other languages
Chinese (zh)
Other versions
CN110096211A (en
Inventor
万金
皮尔斯·詹姆斯·巴纳德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Midea Group Co Ltd
Guangdong Midea Kitchen Appliances Manufacturing Co Ltd
Original Assignee
Midea Group Co Ltd
Guangdong Midea Kitchen Appliances Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Midea Group Co Ltd, Guangdong Midea Kitchen Appliances Manufacturing Co Ltd filed Critical Midea Group Co Ltd
Priority to CN201910363983.8A priority Critical patent/CN110096211B/en
Publication of CN110096211A publication Critical patent/CN110096211A/en
Application granted granted Critical
Publication of CN110096211B publication Critical patent/CN110096211B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

The invention discloses a control method of a household appliance and the household appliance. The household appliance comprises a door body, a cavity and a voice acquisition unit, the voice acquisition unit is arranged on the door body and/or the cavity, the door body is rotatably connected with the cavity, the door body is provided with a touch display screen which can be in a transparent state, and the control method of the household appliance comprises the following steps: the method comprises the steps of acquiring a touch gesture on the surface of a touch display screen, controlling the touch display screen to display a voice interaction interface according to the voice trigger gesture under the condition that the touch gesture is a voice trigger gesture, controlling a voice acquisition unit to receive voice input, and displaying a corresponding dynamic picture on the voice interaction interface according to the voice input. According to the control method of the household appliance, the voice interaction interface is displayed according to the voice trigger gesture, and the corresponding dynamic picture is displayed on the voice interaction interface according to the voice input, so that a user can visually communicate and interact with the household appliance according to the dynamic picture, the user experience is good, and more requirements of the user are met.

Description

Control method of household appliance and household appliance
Technical Field
The invention relates to the technical field of household appliance interaction, in particular to a control method of a household appliance and the household appliance.
Background
With the continuous development of display technology, the head and corner of the transparent display screen are completely exposed, and compared with the traditional display screen, the transparent display screen can bring unprecedented visual experience and brand-new experience for users. The interactive display of the transparent display screen is a novel display means based on the transparent display screen, and the display means is matched with touch and software videos. The screen of the transparent display screen is transparent like glass, and the color richness and the display details of the dynamic picture can be guaranteed while the transparency is kept, so that the interactive display of the transparent display screen can enable a user to see an exhibit behind the screen through the screen in a short distance and can enable the user to interact with the dynamic information of the transparent display screen. However, in the related art, when the transparent display screen is applied to the household appliance, the interaction mode of the transparent display screen is single, and the household appliance and the user cannot realize effective communication and interaction.
Disclosure of Invention
The embodiment of the invention provides a control method of a household appliance and the household appliance. The household appliance comprises a door body, a cavity and a voice acquisition unit, the voice acquisition unit is arranged on the door body and/or the cavity, the door body is rotatably connected with the cavity, the door body is provided with a touch display screen which can be in a transparent state, and the control method comprises the following steps:
acquiring a touch gesture on the surface of the touch display screen;
under the condition that the touch gesture is a voice trigger gesture, controlling the touch display screen to display a voice interaction interface according to the voice trigger gesture;
controlling the voice acquisition unit to receive voice input;
and displaying a corresponding dynamic picture on the voice interaction interface according to the voice input.
According to the control method of the household appliance, the touch display screen is controlled to display the voice interaction interface according to the voice trigger gesture, and the corresponding dynamic picture is displayed on the voice interaction interface according to the voice input, so that a user can visually communicate and interact with the household appliance according to the dynamic picture, the user experience is good, and more requirements of the user are met.
In some embodiments, displaying a corresponding dynamic picture on the voice interactive interface according to the voice input includes:
and controlling the touch display screen to display a dynamic wave line on the voice interaction interface according to the signal intensity of the voice input, wherein the signal intensity of the voice input is positively correlated with the fluctuation amplitude of the wave line.
In certain embodiments, the control method comprises:
and converting the voice input into characters and/or pictures to be displayed on the voice interaction interface.
In some embodiments, the household appliance comprises a speaker, the speaker is arranged in the door body and/or the cavity, and the control method comprises at least one of the following steps:
generating a prompt signal for responding to the voice input according to the voice input, and controlling the loudspeaker to play voice for responding to the voice input according to the prompt signal;
and generating a prompt signal for responding to the voice input according to the voice input, and controlling the touch display screen to display the content for responding to the voice input on the voice interaction interface according to the prompt signal.
In certain embodiments, the control method comprises:
under the condition that the touch gesture is a non-voice trigger gesture, controlling the touch display screen to display a function interaction interface according to the non-voice trigger gesture;
and controlling the working state of the household appliance according to the input instruction on the function interaction interface.
In certain embodiments, the control method comprises:
and controlling the part of the touch display screen for displaying the functional interaction interface to be in a transparent state according to the touch position of the touch gesture on the touch display screen.
The embodiment of the invention provides a household appliance, which comprises a controller, a door body, a cavity and a voice acquisition unit, wherein the controller is connected with the voice acquisition unit, the voice acquisition unit is arranged on the door body and/or the cavity, the door body is rotatably connected with the cavity, the door body is provided with a touch display screen which can be in a transparent state, the controller is used for acquiring a touch gesture on the surface of the touch display screen, controlling the touch display screen to display a voice interaction interface according to the voice trigger gesture under the condition that the touch gesture is a voice trigger gesture, controlling the voice acquisition unit to receive voice input, and displaying a corresponding dynamic picture on the voice interaction interface according to the voice input.
In the household appliance provided by the embodiment of the invention, the touch display screen is controlled to display the voice interaction interface according to the voice trigger gesture, and the corresponding dynamic picture is displayed on the voice interaction interface according to the voice input, so that a user can visually communicate and interact with the household appliance according to the dynamic picture, the user experience is good, and more requirements of the user are met.
In some embodiments, the controller is configured to control the touch display screen to display a dynamic wave line on the voice interaction interface according to the signal strength of the voice input, where the signal strength of the voice input is positively correlated to the fluctuation amplitude of the wave line.
In some embodiments, the controller is configured to convert the voice input into text and/or pictures for display on the voice interactive interface.
In some embodiments, the household appliance includes a speaker, the speaker is disposed on the door body and/or the cavity, and the controller is configured to generate a prompt signal for responding to the voice input according to the voice input, control the speaker to play voice for responding to the voice input according to the prompt signal, and/or generate a prompt signal for responding to the voice input according to the voice input, and control the touch display screen to display content for responding to the voice input on the voice interaction interface according to the prompt signal.
In some embodiments, the controller is configured to control the touch display screen to display a functional interaction interface according to the non-voice trigger gesture if the touch gesture is a non-voice trigger gesture, and control an operating state of the home appliance according to an input instruction at the functional interaction interface.
In some embodiments, the controller is configured to control a portion of the touch display screen displaying the functional interaction interface to be in a transparent state at a touch position of the touch display screen according to the touch gesture.
Additional aspects and advantages of embodiments of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart of a control method of a home appliance according to an embodiment of the present invention.
Fig. 2 is a schematic block diagram of a home appliance according to an embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a home appliance according to an embodiment of the present invention.
Fig. 4 is another flowchart of a control method of a home appliance according to an embodiment of the present invention.
Fig. 5 is a schematic view of an interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 6 is still another flowchart of a control method of a home appliance according to an embodiment of the present invention.
Fig. 7 is a schematic view of another interactive interface of the touch display screen of the home appliance according to the embodiment of the present invention.
Fig. 8 is a schematic view of still another interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 9 is still another flowchart of a control method of a home appliance according to an embodiment of the present invention.
Fig. 10 is a schematic view of still another interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 11 is a schematic view of still another interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 12 is a schematic view of still another interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 13 is a schematic view of still another interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 14 is a schematic view of still another interactive interface of a touch display screen of a home appliance according to an embodiment of the present invention.
Fig. 15 is a schematic sectional view of a home appliance according to an embodiment of the present invention.
Fig. 16 is another schematic sectional view of a home appliance according to an embodiment of the present invention.
Fig. 17 is another block diagram of the home appliance according to the embodiment of the present invention.
Description of the main element symbols:
the household appliance comprises a household appliance 100, a door body 10, a door frame 12, a touch display screen 14, a cavity 20, a first light-emitting module 30, a plate 40, a first light shield 50, a second light-emitting module 60, a second light shield 70, a third light-emitting module 80, a third light shield 90, a voice acquisition unit 110, a loudspeaker 120, a camera 130, a wavy line 140, a controller 150 and an article 200.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
In the description of the embodiments of the present invention, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
In the description of the embodiments of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as being fixedly connected, detachably connected, or integrally connected; either directly or indirectly through intervening media, either internally or in any other relationship. Specific meanings of the above terms in the embodiments of the present invention can be understood by those of ordinary skill in the art according to specific situations.
The following disclosure provides many different embodiments or examples for implementing different configurations of embodiments of the invention. In order to simplify the disclosure of embodiments of the invention, the components and arrangements of specific examples are described below. Of course, they are merely examples and are not intended to limit the present invention. Furthermore, embodiments of the invention may repeat reference numerals and/or reference letters in the various examples, which have been repeated for purposes of simplicity and clarity and do not in themselves dictate a relationship between the various embodiments and/or arrangements discussed. In addition, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art may recognize applications of other processes and/or use of other materials.
Referring to fig. 1, fig. 2 and fig. 3, the method for controlling the household appliance 100 according to the embodiment of the present invention can be applied to the household appliance 100 according to the embodiment of the present invention. The household appliance 100 comprises a door body 10, a cavity 20 and a voice acquisition unit 110, the voice acquisition unit 110 is arranged on the door body 10 and/or the cavity 20, the door body 10 is rotatably connected with the cavity 20, the door body 10 is provided with a touch display screen 14 which can be in a transparent state, and the control method comprises the following steps:
step S10, acquiring a touch gesture on the surface of the touch display screen 14;
step S20, in a case that the touch gesture is a voice trigger gesture, controlling the touch display screen 14 to display a voice interaction interface according to the voice trigger gesture;
step S30, controlling the voice acquisition unit 110 to receive voice input;
and step S40, displaying a corresponding dynamic picture on the voice interaction interface according to the voice input.
The control method of the home appliance 100 implemented by the present invention may be implemented by the home appliance 100 of the embodiment of the present invention. The household appliance 100 includes a controller 150, the controller 150 may be mounted on the panel 40, and the controller 150 is connected to the touch display 14. The board 40 may be a computer board, a main control board or an electronic control board, and is installed at the bottom of the cavity 20. The controller 150 may include an MCU (micro controller).
In the present embodiment, the step S10, the step S20, the step S30 and the step S40 can be implemented by the controller 150. That is, the controller 150 is configured to acquire a touch gesture on the surface of the touch display screen 14, and, in a case that the touch gesture is a voice trigger gesture, control the touch display screen 14 to display a voice interaction interface according to the voice trigger gesture, control the voice capture unit 110 to receive a voice input, and display a corresponding dynamic picture on the voice interaction interface according to the voice input.
In the control method of the household appliance 100 and the household appliance 100 according to the embodiments of the present invention, the touch display screen 14 is controlled to display the voice interaction interface according to the voice trigger gesture and the corresponding dynamic picture is displayed on the voice interaction interface according to the voice input, so that the user can perform intuitive communication and interaction with the household appliance 100 according to the dynamic picture, the user experience is good, and more requirements of the user are satisfied.
Specifically, the household appliance 100 includes, but is not limited to, an oven, a microwave oven, a refrigerator, an electric steamer, and the like. Referring to fig. 3, the door 10 includes a doorframe 12, and the doorframe 12 may be a glass doorframe 12. The door frame 12 is provided with a front panel 122, and the touch display screen 14 is attached to the front panel 122. The touch display screen 14 is substantially the same size as the doorframe 12. In the present embodiment, the door 10 is a lower door 10. The voice collecting unit 110 may include two microphones, and the two microphones are disposed at the door portion above the touch display screen 14. It should be noted that the number of microphones may be set according to practical situations, and is not limited herein. The microphone can also be arranged in the cavity 20, or the cavity 20 and the door body 10.
In this embodiment, a touch gesture may be understood as an action in which a user touches the touch display screen 14 with different combinations of fingers. When the household appliance 100 leaves a factory, a corresponding touch gesture may be preset or a user may customize the touch gesture on the household appliance 100, and after the controller 150 recognizes the touch gesture on the surface of the touch display screen 14, the controller 150 matches the preset gesture template according to the touch gesture, and controls the touch display screen 14 to display an interactive interface corresponding to the touch gesture according to a matching result.
The voice trigger gesture of the present embodiment may be set already when the home appliance 100 leaves the factory or the user may customize the voice trigger gesture on the home appliance 100. In one embodiment, a touch gesture that sets a double finger to slide laterally across touch screen display 14 to the left is a voice-triggered gesture. That is, when the user's fingers slide laterally on the touch screen 14 to the left, the touch screen 14 displays the voice interaction interface. It should be noted that the voice trigger gesture is not limited herein, and may be set according to actual requirements.
On this basis, the controller 150 may control the voice capturing unit 110 to receive the voice input, and the controller 150 may also recognize the voice content, the signal strength, the tone, and the like of the voice input, which is not limited herein. The household appliance 100 can preset different dynamic pictures corresponding to different voice inputs, and the dynamic pictures can be continuously and dynamically changed and adjusted according to the voice content, the signal intensity, the tone and the like of the voice inputs, so that a user can directly observe the working state of the household appliance 100 according to the dynamic pictures, and the interaction interestingness of the household appliance 100 is improved.
It is understood that in other embodiments, step S20 and step S30 may be performed simultaneously.
In some embodiments, referring to fig. 4 and 5, step S40 includes:
and step S42, controlling the touch display screen 14 to display the dynamic wavy line 140 on the voice interaction interface according to the signal intensity of the voice input.
The control method of the above embodiment may be implemented by the home appliance 100 of the embodiment of the present invention. Wherein step S42 can be implemented by the controller 150. The controller 150 is used for controlling the touch display screen 14 to display the dynamic wavy line 140 on the voice interaction interface according to the signal strength of the voice input. The signal strength of the voice input is positively correlated with the fluctuation amplitude of the wavy line 140.
In this way, the user can visually see the signal intensity of the voice input through the dynamic wave line 140, so that the interest of interaction with the home appliance 100 can be increased.
In particular, a dynamic wavy line 140 may be understood as a wavy line 140 whose amplitude of fluctuation changes with changes in signal strength. The signal intensity of the voice input is positively correlated with the fluctuation amplitude of the wavy line 140, and it can be understood that the larger the signal intensity of the voice input is, the larger the fluctuation amplitude of the wavy line 140 is. The smaller the signal strength of the speech input, the smaller the fluctuation amplitude of the wavy line 140.
In some embodiments, referring to fig. 6, the control method includes:
and step S50, converting the voice input into characters and/or pictures to be displayed on the voice interaction interface.
The control method of the above embodiment may be implemented by the home appliance 100 of the embodiment of the present invention. Wherein step S50 can be implemented by the controller 150. The controller 150 is used for converting the voice input into text and/or pictures to be displayed on the voice interaction interface.
Therefore, the user can quickly select the corresponding function on the voice interaction interface according to the characters and/or the pictures, and the user experience is good.
Specifically, in one embodiment, the controller 150 is configured to convert the voice input into text and pictures for display on the voice interactive interface. In another embodiment, the controller 150 is configured to convert the voice input into text for display on the voice interactive interface. In yet another embodiment, the controller 150 is configured to convert the voice input into a picture for display on the voice interactive interface.
Referring to fig. 7, in one embodiment, the home appliance 100 is an oven, the user slides both fingers laterally to the left on the touch screen 14, the touch screen displays a voice interactive interface, the user utters a voice input of "i want to eat breakfast", the controller 150 recognizes the voice input, and controls the voice interactive interface to display the text of "i want to eat breakfast".
Referring to fig. 8, in some aspects, the household appliance 100 includes a speaker 120, the speaker 120 is disposed on the door 10, and the control method includes:
generates a prompt signal responding to the voice input according to the voice input, and controls the speaker 120 to play the voice responding to the voice input according to the prompt signal.
The control method of the above embodiment may be implemented by the controller 150 of the embodiment of the present invention. The controller 150 is configured to generate a prompt signal for responding to the voice input according to the voice input, and control the speaker 120 to play the voice for responding to the voice input according to the prompt signal.
In some embodiments, a control method comprises:
and generating a prompt signal for responding to the voice input according to the voice input, and controlling the touch display screen 14 to display the content of the responding voice input on the voice interaction interface according to the prompt signal.
The control method of the above embodiment may be implemented by the controller 150 of the embodiment of the present invention. The controller 150 is configured to generate a prompt signal for responding to the voice input according to the voice input, and control the touch display 14 to display the content of the responding voice input on the voice interaction interface according to the prompt signal.
Specifically, in other embodiments, the speaker 120 may be disposed in the cavity 20.
Referring to fig. 8, in one embodiment, the household appliance 100 is an oven, the user slides two fingers laterally on the touch screen 14 to the left, the touch screen 14 displays a voice interactive interface, the user issues a voice input of "i want to eat breakfast", and the controller 150 displays a dynamic wavy line 140 on the voice interactive interface according to the voice input. The controller 150 controls the voice collecting unit 110 to receive the voice input, generates a prompt signal responding to the voice input "i want to eat breakfast" according to the voice input, and controls the touch display 14 to display the content of the responding voice input on the voice interactive interface according to the prompt signal, for example, to display "do you like, ask what breakfast you want to cook? (Hey, there, what about broke. At the same time, speaker 120 plays "do you ask what breakfast you want to cook? (Hey, there, what about broke away. In other embodiments, the user may select the cooking mode of the oven directly by a touch gesture.
In some embodiments, referring to fig. 9, the control method includes:
step S110, under the condition that the touch gesture is a non-voice trigger gesture, controlling the touch display screen 14 to display a function interaction interface according to the non-voice trigger gesture;
and step S120, controlling the working state of the household appliance 100 according to the input instruction on the function interaction interface.
The control method of the above embodiment may be implemented by the home appliance 100 of the embodiment of the present invention. Wherein, the steps S110 and S120 can be implemented by the controller 150. The controller 150 is configured to control the touch display 14 to display the functional interaction interface according to the non-voice trigger gesture and control the operating state of the home appliance 100 according to the input instruction on the functional interaction interface, in case that the touch gesture is the non-voice trigger gesture.
Thus, the interaction function of the household appliance 100 is diversified, good interaction between the user and the household appliance 100 can be realized, the interaction interest is improved, and the interaction operation is simple.
Referring to FIG. 10, in one embodiment, the non-voice trigger gesture includes a parameter debugging gesture. The display function interaction interface comprises a parameter debugging interface. The household appliance 100 is an oven, a parameter debugging touch gesture of clicking the middle position D1 of the touch display screen 14 by using a finger is set, a parameter adjusting interface of the household appliance 100 is displayed according to the parameter debugging touch gesture, and a user can debug the cooking temperature and time of the oven at the parameter debugging interface. For example, the temperature setting curve may be slid with a finger to adjust the cooking temperature or the time setting curve may be slid with a finger to adjust the cooking time. In other embodiments, the parameter adjustment interface further includes a cooking mode, a cooking power, and the like, which is not limited herein. It should be noted that the parameter debugging touch gesture can be set by user according to actual requirements.
Referring to FIG. 11, in another embodiment, the non-voice triggered gesture comprises a product view gesture. The display function interaction interface includes a product viewing interface. In one embodiment, the household appliance 100 is an oven, and a product viewing gesture of clicking the lower left position D2 of the touch display screen 14 with a finger is provided, according to which a product viewing interface of the household appliance 100 is displayed, at which a user can view instructions for the oven and/or components of the household appliance 100. For example, a demonstration video of the use of the oven and a component display. In other embodiments, the product viewing interface further includes advertising for the product, and the like, without limitation. It should be noted that the product viewing gesture can be set by user according to actual needs.
Referring to FIG. 12, in yet another embodiment, the non-voice triggered gesture comprises a service item selection gesture. The display function interaction interface comprises a service interface. The household appliance 100 is an oven, a service item selection gesture of clicking a position D3 at the upper left of the touch display screen 14 by using a finger is set, a service interface of the household appliance 100 is displayed according to the service item selection gesture, and a user can check service items such as a maintenance service point of the oven, contact customer service and inquire nearby shops on the service interface on line. In other embodiments, the product viewing interface may include other service items, and is not limited herein. It should be noted that the service item selection gesture can be set by the user according to actual requirements.
Referring to FIG. 13, in yet another embodiment, the non-voice triggered gesture comprises a smart device interaction gesture. The display function interactive interface comprises an intelligent device interactive interface. The household appliance 100 is an oven, a smart device interaction gesture of clicking a position D4 at the lower right of the touch display screen 14 by a finger is set, a smart device interaction interface of the household appliance 100 is displayed according to the smart device interaction gesture, and a user can interact with other smart household appliances 100 in a home environment at the smart device interaction interface to control other smart household appliances 100. It should be noted that the service item selection gesture can be set by the user according to actual requirements.
In some embodiments, referring to fig. 14, the household appliance 100 includes a camera 130, and the camera 130 is located at an upper edge of the door 10. The camera 130 is used for collecting images, and the controller 150 may control the home appliance 100 according to the collected images. In one embodiment, the controller 150 may perform face recognition based on the captured images to determine the legitimate identity of the user.
In the embodiment, the touch gesture and voice interaction mode accords with the current interaction trend, more natural interaction modes are introduced, the operation obstruction is reduced, and the learning cost is reduced. In addition, the household appliance 100 is endowed with the capability of becoming a multimedia display terminal, and in combination with the speaker 120, the voice acquisition unit 110, the camera 130 and the like, the household appliance 100 can perform multi-media input and output, and in addition, the external access network module enables more information to be displayed on the touch display screen 14.
In some embodiments, a control method comprises:
and controlling the position of the function interaction interface on the touch display screen 14 to be in a transparent state according to the touch gesture.
The control method of the above embodiment can be implemented by the controller 150 of the present embodiment. The controller 150 is configured to control the functional interaction interface to be in a transparent state at a position of the touch display 14 according to the touch gesture.
Thus, when the user operates the interactive interface, the user can observe the inside of the cavity 20 through the transparent touch display screen 14 without turning to operate and observe at the same time, so that the interaction degree between the user and the household appliance 100 is greatly improved, and the use convenience of the household appliance 100 is improved.
Referring to fig. 10 and 14, in one embodiment, the household appliance 100 is an oven, and a four-finger open touch gesture is set to touch the middle position D1 of the touch display screen 14 to present a functional interactive interface for a user to view the article 200 inside the cavity 20, where the functional interactive interface may omit elements such as text and graphics, and mainly displays a transparent interface, as shown in fig. 11. In the case of this function interactive interface, a clicked touch gesture is detected at the middle position, a concise interface for parameter adjustment of the home appliance 100 appears, and a user can adjust cooking temperature, cooking time, and the like of the microwave oven on the interactive function interactive interface on the touch display screen 14, as shown in fig. 10. In the present embodiment, the size of the transparent area of the touch display screen 14 can be controlled according to the degree of opening of the four fingers. The greater the degree to which the four fingers are open, the greater the transparent area of the touch sensitive display 14.
Referring to fig. 15, 16 and 17, in some embodiments, a first light emitting module 30 is disposed on a top surface of the cavity 20, and the first light emitting module 30 is used for providing backlight to the touch display 14 and illuminating the inside of the cavity 20, and the control method includes:
the light emitting position of the first light emitting module 30 is controlled at the position of the touch display 14 according to the touch gesture.
The control method of the above embodiment can be implemented by the controller 150 of the present embodiment. The controller 150 is used for controlling the light emitting position of the first light emitting module 30 at the position of the touch display screen 14 according to the touch gesture. The light-emitting position of the first module is related to the display position of the interactive interface. The portion of the touch screen 14 displaying the interactive interface is transparent.
Therefore, the light-emitting position of the first light-emitting module 30 is controlled according to the position of the touch display screen 14, so that the transparent area of the interactive interface of the touch display screen 14 is controlled, a user can observe the condition inside the cavity 20 through the transparent area of the touch display screen 14 where the interactive interface is located, the user can quickly know the cooking state or the storage state of food, and the cooking effect and the storage effect of the food are improved.
Referring to fig. 15, in some embodiments, the first light emitting module 30 includes a plurality of light sources distributed in an array, and the control method includes: and controlling part of the light sources of the plurality of light sources corresponding to the position of the touch gesture on the touch display screen 14 to be turned on or to increase the brightness according to the position of the touch gesture on the touch display screen 14.
The control method of the above embodiment can be implemented by the controller 150 of the present embodiment. The controller 150 is configured to control a portion of the plurality of light sources corresponding to the position of the touch gesture on the touch display 14 to be turned on or to increase the brightness according to the position of the touch gesture on the touch display 14.
Specifically, referring to fig. 15, the touch screen 14 may be a Liquid Crystal Display (LCD). The first light emitting module 30 may provide backlight for the touch display 14. The first light emitting module 30 includes a plurality of light sources distributed in an array. The Light source may comprise a Light Emitting Diode (LED). The light sources may be distributed in longitudinal and transverse arrays. The number of the light sources can be set according to actual conditions, and is not limited herein. In one aspect, light from the light source may be directed to the touch screen display 14 to provide backlighting to the touch screen display 14. On the other hand, the light emitted from the light source irradiates the inside of the cavity 20, and the light is reflected from the inside of the cavity 20 to the touch display screen 14, so as to achieve the purpose of providing backlight for the touch display screen 14.
In the present embodiment, the light-emitting position of the first light-emitting module 30 is controlled at the position of the touch display 14 by the touch gesture, and it can be understood that the position of the touch display 14 by the touch gesture corresponds to the light-emitting position of the first light-emitting module 30. For example, the position a1 of the touch gesture on the touch display screen 14 corresponds to the light-emitting position a2 of the first light-emitting module 30, that is, when the touch display screen 14 detects that the touch gesture is touched at the position a1 of the touch display screen 14, the controller 150 controls the light source of the light-emitting position a2 of the first light-emitting module 30 to be turned on or to intensify the intensity of the light source, so that the region of the touch gesture at the position a1 of the touch display screen 14 is more transparent and more visible than other regions that are not touched.
In some embodiments, referring to fig. 16, the household appliance 100 includes a first light shielding cover 50, and the first light shielding cover 50 covers the first light emitting module 30. In this way, by disposing the first light shielding cover 50, the light emitted from the first light emitting module 30 can be uniformly scattered into the touch display 14 and the cavity 20, so that the display effect of the touch display 14 and the illumination effect of the cavity 20 can be improved.
Specifically, since the light source directly illuminates the touch display 14, the backlight may be too strong, and the touch display 14 may generate light spots, which may affect the display effect of the touch display 14. Therefore, in the embodiment of the present invention, the first light shield 50 may be a plastic translucent light shield with a rough surface, so that the light passing through the first light shield 50 can be uniformly scattered to the touch display 14 and the inside of the cavity 20.
In some embodiments, referring to fig. 16 and 17, the household appliance 100 includes a second light emitting module 60, and the second light emitting module 60 is disposed on the left side surface, the right side surface and the bottom surface of the cavity 20. The control method comprises the following steps:
and controlling the second light-emitting module 60 close to the touch position to emit light according to the touch gesture at the position of the touch display screen 14.
The control method of the above embodiment can be implemented by the controller 150 of the present embodiment. The controller 150 is configured to control the second light-emitting module 60 near the touch gesture at the position of the touch display screen 14 to emit light according to the position of the touch gesture at the touch display screen 14.
In this way, the second light-emitting module 60, which is close to the position of the touch display screen 14 by the touch gesture, emits light, so that the position corresponding to the touch display screen 14 is in a transparent state, so that a user can observe the condition inside the cavity 20 through the position of the touch display screen 14 where the interactive interface is located.
In some embodiments, referring to fig. 16, the household appliance 100 includes a second light shield 70, and the second light shield 70 covers the second light emitting module 60. In this way, by providing the second light shield 70, the light emitted from the second light emitting module 60 can be uniformly scattered into the touch display screen 14 and the cavity 20, so that the display effect of the touch display screen 14 and the illumination effect of the cavity 20 can be improved.
Specifically, the second light shield 70 may be a plastic translucent light shield with a rough surface, so that light passing through the second light shield 70 may be uniformly scattered to the touch display 14 and the inside of the cavity 20.
In some embodiments, referring to fig. 16 and 17, the household appliance 100 includes a third light emitting module 80, the third light emitting module 80 is disposed on an inner side surface of the door frame 12, and the control method includes:
and controlling the third light-emitting module 80 close to the touch gesture at the position of the touch display screen 14 to emit light according to the touch position of the touch gesture on the touch display screen 14.
The control method of the above embodiment can be implemented by the controller 150 of the present embodiment. The controller 150 is configured to control the third light-emitting module 80 close to the touch gesture at the position of the touch display screen 14 to emit light according to the touch position of the touch gesture on the touch display screen 14.
Thus, the third light-emitting module 80, which is close to the position of the touch gesture on the touch display screen 14, is controlled to emit light, so that the position of the touch gesture corresponding to the position of the touch display screen 14 is in a transparent state, and a user can observe the condition inside the cavity 20 through the position of the touch display screen 14 where the interactive interface is located.
In some embodiments, referring to fig. 16, the household appliance 100 includes a third light shielding cover 90, and the third light shielding cover 90 covers the third light emitting module 80. In this way, the third light shield 90 is disposed to uniformly diffuse the light emitted from the third light emitting module 80 to the touch display 14.
Specifically, the third light shield 90 may be a rough-surfaced plastic translucent light shield, such that light passing through the third light shield 90 may be uniformly scattered to the touch display screen 14.
In some embodiments, a control method comprises:
and controlling the light-emitting position and the light-emitting color of the touch display screen 14 according to the touch gesture to display different interactive interfaces.
The control method of the above embodiment may be implemented by the controller 150 of the embodiment of the present invention. The controller 150 is used for controlling the lighting position and the lighting color of the touch display screen 14 according to the touch gesture to display different interactive interfaces.
In this way, the light-emitting position and the light-emitting color of the touch display screen 14 are controlled according to the touch gesture to display different interactive interfaces, so that the interactive modes of the household appliance 100 are various, and a user can flexibly select the interactive interfaces according to actual requirements.
Specifically, the touch display 14 may be an OLED (Organic Light-Emitting Diode). The touch display 14 has a self-luminous characteristic. In this embodiment, the pixels of the red, green, and blue three primary colors of the touch display screen 14 may be adjusted to emit light to combine different light emitting colors, and then the light emitting positions are combined to enable the touch display screen 14 to display different interactive interfaces according to actual requirements.
In one embodiment, a double finger down-slide touch gesture is set to cause the full screen of touch display 14 to appear as a black opaque state. A four-finger open touch gesture is set to cause the full screen of touch display 14 to appear as a bluish transparent state. It should be noted that the light-emitting position and the light-emitting color of the touch display screen 14 corresponding to the touch gesture can be set by user according to actual requirements.
In the description herein, references to the description of the terms "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example" or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processing module-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires (control method), a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of embodiments of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and not to be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made in the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims (10)

1. A control method of a household appliance is characterized in that the household appliance comprises a door body, a cavity and a voice acquisition unit, the voice acquisition unit is arranged on the door body and/or the cavity, the door body is rotatably connected with the cavity, the door body is provided with a touch display screen which can be in a transparent state, the top surface of the cavity is provided with a first light-emitting module, the first light-emitting module is used for providing backlight for the touch display screen and providing illumination for the cavity, the first light-emitting module comprises a plurality of light sources which are distributed in an array manner, and the control method comprises the following steps:
acquiring a touch gesture on the surface of the touch display screen;
under the condition that the touch gesture is a voice trigger gesture, controlling the touch display screen to display a voice interaction interface according to the voice trigger gesture, and setting a touch gesture that two fingers transversely slide leftwards on the touch display screen as the voice trigger gesture;
controlling the voice acquisition unit to receive voice input;
displaying a corresponding dynamic picture on the voice interaction interface according to the voice input;
the control method comprises the following steps:
under the condition that the touch gesture is a non-voice trigger gesture, controlling the touch display screen to display a function interaction interface according to the non-voice trigger gesture;
controlling the part of the touch display screen for displaying the functional interaction interface to be in a transparent state according to the touch position of the touch gesture on the touch display screen;
and controlling partial light sources of the plurality of light sources corresponding to the position of the touch gesture on the touch display screen to be turned on or to increase the brightness according to the position of the touch gesture on the touch display screen.
2. The control method according to claim 1, wherein displaying a corresponding dynamic picture on the voice interactive interface according to the voice input comprises:
and controlling the touch display screen to display a dynamic wave line on the voice interaction interface according to the signal intensity of the voice input, wherein the signal intensity of the voice input is positively correlated with the fluctuation amplitude of the wave line.
3. The control method according to claim 1, characterized by comprising:
and converting the voice input into characters and/or pictures to be displayed on the voice interaction interface.
4. The control method according to claim 1, wherein the household appliance comprises a loudspeaker, the loudspeaker is arranged on the door body and/or the cavity, and the control method comprises at least one of the following steps:
generating a prompt signal for responding to the voice input according to the voice input, and controlling the loudspeaker to play voice for responding to the voice input according to the prompt signal;
and generating a prompt signal for responding to the voice input according to the voice input, and controlling the touch display screen to display the content for responding to the voice input on the voice interaction interface according to the prompt signal.
5. The control method according to claim 1, characterized by comprising:
and controlling the working state of the household appliance according to the input instruction on the function interaction interface.
6. A household appliance is characterized by comprising a controller, a door body, a cavity and a voice acquisition unit, wherein the controller is connected with the voice acquisition unit, the voice acquisition unit is arranged on the door body and/or the cavity, the door body is rotatably connected with the cavity, the door body is provided with a touch display screen which can be in a transparent state, the top surface of the cavity is provided with a first light-emitting module, the first light-emitting module is used for providing backlight for the touch display screen and illumination for the cavity, the first light-emitting module comprises a plurality of light sources which are distributed in an array manner, the controller is used for acquiring touch gestures on the surface of the touch display screen, controlling the touch display screen to display a voice interaction interface according to the voice trigger gestures under the condition that the touch gestures are voice trigger gestures, and controlling the voice acquisition unit to receive voice input, displaying a corresponding dynamic picture on the voice interaction interface according to the voice input, and setting a touch gesture that two fingers transversely slide leftwards on the touch display screen as the voice trigger gesture;
the controller is used for controlling the touch display screen to display a functional interaction interface according to the non-voice trigger gesture under the condition that the touch gesture is the non-voice trigger gesture, controlling the part of the touch display screen displaying the functional interaction interface to be in a transparent state at the touch position of the touch display screen according to the touch gesture, and controlling part of light sources of the plurality of light sources corresponding to the position of the touch gesture on the touch display screen to be turned on or to increase the brightness according to the position of the touch gesture on the touch display screen.
7. The household appliance according to claim 6, wherein the controller is configured to control the touch display screen to display a dynamic wave line on the voice interaction interface according to the signal intensity of the voice input, and the signal intensity of the voice input is positively correlated to the fluctuation amplitude of the wave line.
8. The household appliance of claim 6, wherein the controller is configured to convert the voice input into text and/or pictures for display on the voice interactive interface.
9. The household appliance according to claim 6, wherein the household appliance comprises a speaker, the speaker is disposed on the door body and/or the cavity, and the controller is configured to generate a prompt signal for responding to the voice input according to the voice input, control the speaker to play voice for responding to the voice input according to the prompt signal, and/or generate a prompt signal for responding to the voice input according to the voice input, and control the touch display screen to display content for responding to the voice input on the voice interaction interface according to the prompt signal.
10. The home appliance according to claim 6, wherein the controller is configured to control an operation state of the home appliance according to an input command at the function interaction interface.
CN201910363983.8A 2019-04-30 2019-04-30 Control method of household appliance and household appliance Active CN110096211B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910363983.8A CN110096211B (en) 2019-04-30 2019-04-30 Control method of household appliance and household appliance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910363983.8A CN110096211B (en) 2019-04-30 2019-04-30 Control method of household appliance and household appliance

Publications (2)

Publication Number Publication Date
CN110096211A CN110096211A (en) 2019-08-06
CN110096211B true CN110096211B (en) 2021-03-19

Family

ID=67446765

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910363983.8A Active CN110096211B (en) 2019-04-30 2019-04-30 Control method of household appliance and household appliance

Country Status (1)

Country Link
CN (1) CN110096211B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110647732B (en) * 2019-09-16 2022-02-25 云从科技集团股份有限公司 Voice interaction method, system, medium and device based on biological recognition characteristics
CN112905148B (en) * 2021-03-12 2023-09-22 拉扎斯网络科技(上海)有限公司 Voice broadcasting control method and device, storage medium and electronic equipment

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101843337B1 (en) * 2010-10-28 2018-03-30 삼성전자주식회사 Display module and display system
CN202734418U (en) * 2012-03-16 2013-02-13 海尔集团公司 Refrigerator
CN103423955B (en) * 2012-05-23 2017-09-12 海尔集团公司 Article position input method and system in refrigerator
CN203011036U (en) * 2012-12-20 2013-06-19 Tcl集团股份有限公司 Refrigerator
KR102188268B1 (en) * 2014-10-08 2020-12-08 엘지전자 주식회사 Mobile terminal and method for controlling the same
ITUB20155043A1 (en) * 2015-10-19 2017-04-19 Piron S R L OVEN FOR COOKING FOOD PRODUCTS
KR20170046958A (en) * 2015-10-22 2017-05-04 삼성전자주식회사 Electronic apparatus and Method for executing function using speech recognition thereof
CN205448448U (en) * 2015-12-30 2016-08-10 天津丰尧科技有限公司 Integrated touch intelligent refrigerator
CN205641764U (en) * 2016-04-15 2016-10-12 宁波金格奥电器有限公司 Refrigerator door with LED is shaded
US11170768B2 (en) * 2017-04-17 2021-11-09 Samsung Electronics Co., Ltd Device for performing task corresponding to user utterance
CN108399021A (en) * 2017-08-24 2018-08-14 加热有限公司 Display device and electronic device and system
CN109584879B (en) * 2018-11-23 2021-07-06 华为技术有限公司 Voice control method and electronic equipment

Also Published As

Publication number Publication date
CN110096211A (en) 2019-08-06

Similar Documents

Publication Publication Date Title
RU2701113C1 (en) Household appliance with improved convenience of control of manipulator device made in form of touch screen
US9622326B1 (en) Method and device for determining emitted light intensity level
KR20190097638A (en) Refrigerator
CN110096211B (en) Control method of household appliance and household appliance
US20200117879A1 (en) Fingerprint detection apparatus and terminal device having fingerprint identification function
KR20090006142A (en) Display apparatus with ambient lighting generation using switchable canvas
CN106293479B (en) Screen backlight brightness control method and mobile terminal
US20150334799A1 (en) Multiple backlight keyboard
US20140198084A1 (en) Method and system for display brightness and color optimization
EP1992201B1 (en) Interaction mechanism for light systems
US20130207916A1 (en) Multimedia device for controlling logo type indicator according to power control signal and method of controlling the same
US20170332021A1 (en) Infrared illumination through background lighting source
CN105138234A (en) Operation prompt system for household appliance and operation prompt method for household appliance
CN105807989A (en) Gesture touch method and system
US10133445B2 (en) Method for searching information, display control system and input device
CN110096212B (en) Control method of household appliance and household appliance
US11682275B2 (en) Electronic device with auxiliary lighting function and operation method thereof
CN110083271A (en) The control method and household electrical appliance of household electrical appliance
CN110286518B (en) Display module, control method thereof and display device
KR20180073047A (en) Display apparatus and control method thereof
CN110080661B (en) Household electrical appliance
CN108762487A (en) Electronic device
JP2009531733A (en) Display device with ambient light generation using a switchable canvas
KR102366479B1 (en) Hidden type-operation input device for electric range, operation input control method for electric range, and electric range comprising the same
KR20150106232A (en) A touch recognition device and display applying the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant