CN112233673A - Control method of kitchen system, and computer-readable storage medium - Google Patents
Control method of kitchen system, and computer-readable storage medium Download PDFInfo
- Publication number
- CN112233673A CN112233673A CN202011079194.0A CN202011079194A CN112233673A CN 112233673 A CN112233673 A CN 112233673A CN 202011079194 A CN202011079194 A CN 202011079194A CN 112233673 A CN112233673 A CN 112233673A
- Authority
- CN
- China
- Prior art keywords
- voice recognition
- recognition unit
- kitchen
- kitchen appliance
- noise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0423—Input/output
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention discloses a control method of a kitchen system, the kitchen system and a computer readable storage medium, wherein the kitchen system comprises a voice recognition unit and a kitchen appliance, and the control method comprises the following steps: waking up a voice recognition function of the voice recognition unit; detecting noise information of the kitchen appliance; under the condition that the noise information is in the working range of the voice recognition unit, controlling the voice recognition unit to recognize a voice command; and under the condition that the noise information exceeds the working range of the voice recognition unit, controlling the kitchen appliance to reduce noise so that the noise information is positioned in the working range of the voice recognition unit. The control method of the kitchen system can ensure that the voice recognition unit of the kitchen system can work normally, and effectively avoids the interference of noise generated when kitchen appliances work on the voice recognition unit.
Description
Technical Field
The invention relates to the technical field of household appliances, in particular to a kitchen system control method, a kitchen system and a computer readable storage medium.
Background
In an open kitchen environment, most of the time is quite quiet, but an electric appliance such as a range hood or an exhaust fan which generates a large noise source is usually provided, and the electric appliance has large working noise in the cooking process and can generate serious interference on a voice recognition unit. Such noise is emitted by the non-speech recognition unit itself and cannot be masked using the echo cancellation function. The kitchen space is narrow and small, and partial equipment such as fan during operation noise too big, has surpassed normal human sound size. From an acoustic perspective, the difficulty of recognition increases significantly when the noise exceeds the human voice.
Disclosure of Invention
An object of an embodiment of the present invention is to provide a kitchen system and a control method thereof, which can effectively prevent noise in the kitchen system from interfering with a voice recognition unit.
A second object of an embodiment of the present invention is to provide a computer-readable storage medium.
The embodiment of the invention provides a control method of a kitchen system, wherein the kitchen system comprises a voice recognition unit and a kitchen appliance, and the control method comprises the following steps: waking up a voice recognition function of the voice recognition unit; detecting noise information of the kitchen appliance; under the condition that the noise information is within the working range of the voice recognition unit, controlling the voice recognition unit to perform voice command recognition; and under the condition that the noise information exceeds the working range of the voice recognition unit, controlling the kitchen appliance to reduce noise so that the noise information is positioned in the working range of the voice recognition unit.
According to the control method of the kitchen system, after the noise information of the kitchen appliance is detected to exceed the working range of the voice recognition unit, the kitchen appliance is controlled to reduce the noise, so that the voice recognition unit of the kitchen system can work normally, and the interference of the noise generated when the kitchen appliance works on the voice recognition unit is effectively avoided.
In some embodiments, waking up the speech recognition function of the speech recognition unit comprises at least one of: voice wake-up, gesture wake-up, and button wake-up. Therefore, the voice recognition function is awakened at any time through the awakening instruction, and the power consumption waste caused by the fact that the voice recognition unit is in an open state when not needed is avoided.
In some embodiments, detecting noise information of the kitchen appliance comprises: and detecting the current working power of the kitchen appliance, wherein the working power is positively correlated with the noise information. Therefore, the detection of noise can be conveniently realized, and the cost of the kitchen system can be reduced.
In some embodiments, controlling the kitchen appliance to reduce noise such that the noise information is within an operating range of the speech recognition unit if the noise information is outside the operating range of the speech recognition unit includes: controlling the kitchen appliance to reduce operating power such that the noise information is within an operating range of the voice recognition unit. Thus, noise reduction can be achieved.
In some embodiments, further comprising: receiving the adjustment information of the working power of the kitchen electrical appliance in the process of the voice recognition command by the voice recognition unit; and adjusting the current working power of the kitchen appliance according to the adjustment information. Therefore, after receiving an information instruction for adjusting the working power of the kitchen appliance from a user in the voice recognition command process, the kitchen appliance can be adjusted to a state set by the user so as to ensure that the kitchen appliance can realize a working state meeting the user expectation.
The embodiment of the invention also provides a kitchen system, which comprises a voice recognition unit and a kitchen appliance, and also comprises a wake-up unit, a detection unit and a control unit, wherein the wake-up unit is used for waking up the voice recognition function of the voice recognition unit; the detection unit is used for detecting the noise information of the kitchen appliance; the control unit is used for controlling the voice recognition unit to recognize voice commands under the condition that the noise information is in the working range of the voice recognition unit, and controlling the kitchen appliance to reduce noise under the condition that the noise information exceeds the working range of the voice recognition unit, so that the noise information is located in the working range of the voice recognition unit.
According to the kitchen system, after the detection unit detects that the noise of the kitchen appliance exceeds the working range of the voice recognition unit, the control unit controls the kitchen appliance to reduce the noise, so that the voice recognition unit of the kitchen system can work normally, and the interference of the noise generated when the kitchen appliance works on the voice recognition unit is effectively avoided.
In some embodiments, the wake-up unit is configured to accept at least one of the following wake-up instructions: and the voice recognition function of the voice recognition unit is awakened according to the awakening instruction. Therefore, in the kitchen system, voice awakening is relatively difficult under the condition of high ambient noise, and the voice recognition function of the voice recognition unit can be awakened through a gesture instruction or a key instruction, so that the awakening rate of voice awakening is increased.
In some embodiments, the detection unit is further configured to detect a current working power of the kitchen appliance, and the working power is positively correlated to the noise information. Here, the detection unit can be understood as a power detection unit, and for the additional arrangement of the noise information detection unit, the power detection unit can be realized through a pure software algorithm, so that the cost can be saved, and the control function can be simplified.
In some embodiments, the control unit is configured to control the kitchen appliance to reduce the operating power so that the noise information is within the operating range of the speech recognition unit in case the operating power of the kitchen appliance exceeds the operating range of the speech recognition unit.
In some embodiments, the control module is further configured to receive adjustment information of the operating power of the kitchen appliance during the voice recognition command performed by the voice recognition unit, and adjust the current operating power of the kitchen appliance according to the adjustment information. Therefore, in the voice recognition process, the preset power for operating and adjusting the kitchen electrical appliance can be controlled, so that the purpose of a user is achieved.
In some embodiments, further comprising: and the terminal is connected with the voice recognition unit and the kitchen appliance and is used for setting the voice recognition unit to start a voice recognition function and managing and controlling the running state of the kitchen appliance. Therefore, the voice recognition unit and the kitchen appliance are connected through the terminal, the intellectualization of a kitchen system can be increased, and the kitchen system is convenient to operate and easy to manage.
Embodiments of the present invention also provide a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed, the method for controlling the kitchen system according to any of the foregoing embodiments is implemented.
The computer readable storage medium can realize the control method through the computer program stored on the computer readable storage medium, and after the noise information of the kitchen appliance is detected to exceed the working range of the voice recognition unit, the kitchen appliance is controlled to reduce the noise, so that the normal work of the voice recognition unit of the kitchen system is ensured, and the interference of the noise generated when the kitchen appliance works on the voice recognition unit is effectively avoided.
In addition, advantages brought by additional aspects of the control method of the kitchen system, and the computer-readable storage medium according to the embodiments of the present invention will be set forth, in part, in the detailed description which follows, and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1-4 are flow diagrams illustrating a method of controlling a kitchen system according to an embodiment of the present invention;
fig. 5-6 are block schematic diagrams of a galley system according to an embodiment of the present invention.
Reference numerals:
the system comprises a kitchen system 100, a voice recognition unit 10, a loudspeaker 11, a power amplifier module 12, a kitchen appliance 20, a wake-up unit 30, a detection unit 40, a control unit 50 and a display control panel 60.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
A control method of a kitchen system 100 according to an embodiment of the present invention is described in detail below with reference to fig. 1 to 6, the kitchen system 100 including a voice recognition unit 10 and a kitchen appliance 20, and with reference to fig. 1, the control method includes:
s10: waking up the voice recognition function of the voice recognition unit 10;
s20: detecting noise information of the kitchen appliance 20;
s30: controlling the voice recognition unit 10 to perform voice command recognition in the case that the noise information is within the operating range of the voice recognition unit 10;
s40: in the case where the noise information is out of the operating range of the voice recognition unit 10, the kitchen appliance 20 is controlled to reduce the noise so that the noise information is within the operating range of the voice recognition unit 10.
According to the control method of the kitchen system 100, after the noise information of the kitchen appliance 20 is detected to exceed the working range of the voice recognition unit 10, the kitchen appliance 20 is controlled to reduce the noise, so that the voice recognition unit 10 of the kitchen system 100 can work normally, and the interference of the noise generated when the kitchen appliance 20 works on the voice recognition unit 10 is effectively avoided.
In the above embodiments, the kitchen system 100 may be understood as an intelligent kitchen system, a cloud kitchen system, and the like, and specifically, the kitchen system 100 may be a sum of devices such as a microwave oven, a baking oven, an electric stew, a juice extractor, a wall breaking machine, a dish washer, a dryer, and the like in a kitchen, and may further include a range hood, an exhaust fan, a refrigerator, and the like, and various devices in the kitchen may be connected to each other and controlled by one or more devices, or various devices in the kitchen may be configured and controlled by one or more terminals, and further, or a control program for controlling various devices in the kitchen may be stored in a cloud of the server, and the terminal is connected to the server and obtains the control program to implement function control on various devices in the kitchen, where the control function may include controlling on-off states, and a state of various devices in the kitchen The voice function, the control of the air volume, the control of the power, the control of the heating power, the control of the cooking mode, the control of the timing information, etc. are not limited to the above-mentioned embodiments, and the embodiments according to the present invention are within the scope of the present invention.
In the above embodiments, the kitchen appliance 20 may be understood as one or more of a microwave oven, an electric stew, a juice extractor, a wall breaking machine, an electric pressure cooker, an electric steamer, a refrigerator, a range hood, an exhaust fan, a dish washer, a dryer, and the like. In some embodiments, at least one kitchen appliance 30 is included in the kitchen system 100, the voice recognition unit 10 is disposed in one or more kitchen appliances 20, and in the case that the voice recognition unit 10 is in a wake-up state, noise information of the one or more kitchen appliances 20 is detected and controlled, so that the voice recognition unit 10 of the kitchen system 100 can work normally.
For the purpose of describing and understanding the present invention, in some embodiments, the voice recognition unit 10 is disposed in a microwave oven, and the kitchen appliance 20 may be a range hood, an exhaust fan, a wall breaking machine, a soymilk maker, or the like, which is prone to generate relatively strong noise during operation.
It is understood that, in the above embodiment, when the voice recognition unit 10 enters the voice recognition function, the noise generated when the kitchen appliance 20 operates may affect the normal function of the voice recognition unit 10. The microwave oven recognizes a voice command through the voice recognition unit 10, and the voice command is a voice generally issued by a user, such as "please turn on the voice recognition unit", "turn on the light", "cook with small fire", "heat for 5 minutes", "please turn off the voice recognition unit", and so on. Kitchen appliance 20 works after speech recognition unit 10 opens the speech recognition function, can produce the sound of great decibel volume usually, for example, smoke ventilator can produce great sound, broken wall machine, soybean milk machine etc. also can produce great sound at the during operation, and these sounds cover very easily or disturb the natural sound production of falling the human body to make the speech recognition function of speech recognition unit 10 become difficult.
Referring to fig. 6, the voice recognition unit 10 is connected to a speaker 11 and a power amplifier module 12, wherein the power amplifier module 12 and the speaker 11 amplify the sound signal output by the voice unit so as to clearly interact with the user, the kitchen system 100 may include a control unit 50 and a display control panel 60, the display control panel 60 may be disposed on the voice recognition unit 10, or may be disposed on the kitchen appliance 20, or the display control panel 60 is connected to a terminal, wherein the display control panel 60 may be connected to and interact with the control unit 50, a command for waking up the voice may be input on the display screen, information of the current operation of the voice recognition unit 10 and the kitchen appliance 20 may also be queried, and specifically, the display control panel 60 is touched to wake up the voice module, the voice recognition unit 10 of the voice recognition unit 10 performs voice recognition, the control unit 50 sends the voice recognition command to the kitchen appliance 20 to detect its operating power, after the operating power thereof exceeds the normal operating range of the voice recognition unit 10, the control unit 50 transmits a power-down command to the kitchen appliance 20 to reduce the operating power of the kitchen appliance 20 to ensure the normal operation of the voice recognition unit 10.
The control method of the kitchen system 100 according to the embodiment of the present invention can detect the noise information of the kitchen appliance 20, control the voice recognition unit 10 to continue the voice command recognition when the noise information is within the operating range of the voice recognition unit 10, and control the kitchen appliance 20 to reduce the noise so that the noise information is within the operating range of the voice recognition unit 10 when the noise information exceeds the operating range of the voice recognition unit 10, thereby ensuring that the operating sound of the kitchen appliance 20 does not affect the voice command recognition performed by the voice recognition unit 10.
In one example, the kitchen system 100 includes a wall-mounted microwave oven, the kitchen appliance 20 includes a suction fan, and the suction fan and the voice recognition unit 10 are disposed in the wall-mounted microwave oven, and since the suction fan has a large power, when the suction fan operates, the environmental noise is large, and the noise may interfere with the voice recognition unit 10. Therefore, when the speech recognition unit 10 is woken up, if the exhaust fan is working, it is immediately required to send an instruction to it to work with the lowest power, so as to reduce the environmental noise caused by it, at this time, the speech recognition unit 10 can perform normal speech interaction with the user, and after the interaction is completed, it sends an instruction to recover its original power. And if the user actively adjusts the power of the exhaust fan in the voice interaction process, immediately working according to the power set by the user.
In the above embodiment, the noise information may include sound intensity, sound power, sound pressure, frequency, and the like, and the operating range of the speech recognition unit 10 may be understood as a range of ambient noise corresponding to the speech command when the speech recognition unit 10 performs speech command recognition, and specifically, when the ambient noise is small, the normal operation of the speech recognition unit 10 is not affected, and the ambient noise at this time is within the operating range of the speech recognition unit 10. When the ambient noise is large, the normal operation of the speech recognition unit 10 is affected, the speech recognition unit 10 cannot accurately recognize the speech command, and the ambient noise at this time is outside the operating range of the speech recognition unit 10. The relationship between the ambient noise information and the accuracy of the recognized voice command can be calibrated in advance and stored.
In step S10 of the control method, the voice recognition function of the voice recognition unit 10 is woken up, wherein the voice recognition unit 10 may be disposed on the voice recognition unit 10, or the voice recognition unit 10 is integrated in a place of the kitchen system 100 and is connected to the voice recognition unit 10, or the voice recognition unit 10 may be disposed on a terminal or stored in a server, and the voice recognition unit 10 is woken up to perform voice command interaction on the voice recognition unit 10, so that the voice recognition unit 10 operates according to the voice command.
In step S20, the kitchen appliance 20 may include one or more devices in the kitchen system 100, and after the voice recognition unit 10 turns on the voice recognition function, the noise information of the kitchen appliance 20 located around the voice recognition unit 10 is detected, wherein the noise information mainly includes the noise intensity, and may also include information of sound pressure, sound frequency, noise power, etc.
In step S30, according to the detection result, if the noise information is within the operation range of the voice recognition unit 10, that is, the current noise information does not affect the normal operation of the voice recognition unit 10, the voice recognition unit 10 is controlled to continue the voice command recognition to realize the voice command interaction between the user and the voice recognition unit 10, the user can control the operation state, the operation mode and the power level of the voice recognition unit 10 through the voice command, the user can inquire the operation state of the current voice recognition unit 10 through the voice command, or inquire the cooking parameters, such as the power information and the timing information, set by the voice recognition unit 10.
In step S40, in the case where the noise information is out of the operating range of the voice recognition unit 10, that is, after it is detected that the current noise information affects the normal operation of the voice recognition unit 10, the kitchen appliance 20 is controlled to reduce the noise so that the noise information is within the operating range of the voice recognition unit 10. For example, the kitchen appliance 20 includes a range hood, and the noise generated by the kitchen appliance mainly originates from a fan, and can be reduced by reducing the rotating speed of the fan, reducing the power of the range hood, and the like, so as to finally achieve the purpose of not affecting the voice recognition of the voice recognition unit 10, and thus, the noise can be specifically reduced to the range within which the voice recognition unit 10 of the voice recognition unit 10 normally operates.
The control method of the kitchen system 100 can solve the problem that other devices (the voice recognition unit 10) in a kitchen are difficult to perform voice control and voice instruction recognition due to overlarge working noise in partial cooking, cleaning, storing and sterilizing devices in a kitchen environment, so that the voice recognition unit 10 can accurately recognize the voice instruction of a user, and the control method is convenient and efficient and has good user experience.
In some embodiments, the above-mentioned control method of the kitchen system 100, which wakes up the voice recognition function of the voice recognition unit 10, includes at least one of the following: voice wake-up, gesture wake-up, and button wake-up. Therefore, the voice recognition function is awakened at any time through the awakening instruction, and the power consumption waste caused by the fact that the voice recognition unit is in an open state when not needed is avoided.
Specifically, voice wake-up includes when the user speaks a specific wake-up word, such as "hello, voice recognition unit", etc., the voice recognition unit 10 will wake up to wait for the user's next voice instruction. In the process, the user can directly operate by voice without touching the voice, and meanwhile, by utilizing a voice awakening mechanism, the voice recognition unit 10 is not required to be in a working state in real time, so that the energy consumption is saved.
In addition, in the kitchen system 100, voice wake-up is relatively difficult in the case of large ambient noise, and the voice recognition function of the voice recognition unit 10 may also be woken up by a gesture command, for example, the terminal is connected to the voice recognition unit 10, the terminal has a touch display screen, and when voice control is required to be performed on the voice recognition unit 10 and the ambient noise in the kitchen is large, the voice recognition unit 10 may be woken up by inputting a specific gesture symbol on the touch display screen of the terminal. Alternatively, the voice recognition unit 10 is provided with the voice recognition unit 10, and the voice recognition unit 10 is provided with a touch display screen, and inputting a specific gesture symbol on the touch display screen can wake up the voice recognition unit 10. The specific gesture symbol for waking up the speech recognition unit 10 may be determined according to actual situations, and is not limited herein. Of course, a body gesture may be set to wake up the voice recognition unit 10, and actions such as raising the hand and arm may also be set as instructions to wake up the voice function.
Also, the voice recognition function is awakened by a key operation, for example, the voice recognition unit 10 is provided with a voice recognition unit 10, the voice recognition unit 10 is provided with a key panel for controlling the operation and the shutdown of the voice recognition unit 10, and a user can perform the operation of awakening the voice recognition function by pressing a key corresponding to the awakened voice recognition unit.
The control method of the kitchen system 100 according to the above embodiment can load resources automatically and be in the dormant state by the voice recognition unit 10 when the voice recognition unit 10 is turned on, and clear the dormant flag to enter the awake state after receiving the wake-up instruction, so as to implement voice control on the voice recognition unit 10. The speech recognition unit 10 is in the sleep state, and power consumption can be reduced, thereby realizing the low power consumption function of the speech recognition unit 10.
Referring to fig. 2, detecting noise information of the kitchen appliance 20 includes:
s21: the current working power of the kitchen appliance 20 is detected, and the working power is positively correlated with the noise information. Therefore, the detection of noise can be conveniently realized, and the cost of the kitchen system can be reduced.
In the kitchen system 100, the kitchen appliance 20 may include a range hood, a wall breaking machine, and other kitchen devices with relatively high noise. For the equipment such as smoke ventilator, broken wall machine, its power of work and the operating noise that produces are positive correlation, and to be precise, the power of its work is bigger, and the noise is bigger, and its power of work is smaller, and the noise is smaller. It can be understood that, the detection of the noise information requires an additional noise detection unit, which may result in a more complex structure or functional architecture of the kitchen system 100, and the control method in the above embodiment may be implemented by detecting the current operating power of the kitchen appliance 20 to detect the noise emitted therefrom, and only an algorithm for increasing the detection power in the operation of the internal program is required to implement the detection method, so that the implementation of the control method in the present invention is simpler and more direct, and the purpose of reducing the cost is achieved because the noise detection unit is saved.
Referring to fig. 3, in the case where the noise information exceeds the operating range of the voice recognition unit 10, controlling the kitchen appliance 20 to reduce the noise so that the noise information is within the operating range of the voice recognition unit 10 includes:
s41, the kitchen appliance 20 is controlled to reduce the operating power so that the noise information is within the operating range of the speech recognition unit 10. Thus, noise reduction can be achieved.
Specifically, after detecting that the noise information of the kitchen appliance 20 is out of the range of the normal operation of the voice recognition unit 10, the operating power of the kitchen appliance 20 is reduced so that the noise generated during the operation does not affect the normal voice recognition function. Here, the kitchen appliance 20 may be a single device or may be a plurality of devices. Under the condition that kitchen appliance 20 includes a plurality of, for example, kitchen appliance 20 includes a smoke ventilator, a broken wall machine and a soybean milk machine, currently, the speech function of speech recognition unit 10 is awaken up, smoke ventilator and broken wall machine are working, and the soybean milk machine is not at operating condition, and, it all surpasss the scope that makes the normal work of speech recognition function to detect the operating power of smoke ventilator and the operating power of broken wall machine, then kitchen system 100 can control smoke ventilator and broken wall machine and reduce operating power, make operating power between them reduce to the scope that can make the normal work of speech recognition function.
Alternatively, in the above embodiment, when it is detected that the operating power of the range hood exceeds the range in which the voice recognition function normally operates, but the operating power of the wall breaking machine does not exceed the range in which the voice recognition function normally operates, the operating power of the wall breaking machine is controlled to be unchanged, and the operating power of the range hood is controlled to be reduced until the range in which the voice recognition function normally operates is reached. And if the working power of the smoke exhaust ventilator and the working power of the wall breaking machine are detected to be out of the range enabling the voice recognition function to work normally, and the sum of the power of the smoke exhaust ventilator and the working power of the wall breaking machine is controlled to be reduced according to a certain proportion until the sum of the power of the smoke exhaust ventilator and the working power of the wall breaking machine is within the range enabling the voice recognition function to work normally.
Specifically, it may be further set that the kitchen appliance 20 should be reduced to a specific power gear, and it may also be further set that the mutual matching relationship between the kitchen appliances 20 is adjusted, so as to configure the personalized parameters meeting the actual environment.
With reference to fig. 4, the control method according to the embodiment of the present invention further includes:
s50, receiving the adjusting information of the kitchen electrical appliance 20 working power in the process of the voice recognition unit 10 executing the voice recognition command;
and S60, adjusting the current working power of the kitchen appliance 20 according to the adjustment information. In this way, when receiving an information command for adjusting the operating power of the kitchen appliance 20 from the user while the voice recognition unit 10 is performing the voice recognition command, the kitchen appliance 20 can be adjusted to a state set by the user to ensure that the kitchen appliance 20 can achieve an operating state according to the user's desire.
During the voice recognition command by the voice recognition unit 10, the user feels the power of the kitchen appliance 20 is decreased, and at this time, the user adjusts the operating power of the kitchen appliance 20 to implement the cooking function or the smoke exhausting function of the kitchen appliance 20 desired by the user to achieve the user's purpose.
For example, the voice recognition unit 10 may be a microwave oven, the kitchen appliance 20 may be a range hood, and after waking up the voice recognition function of the microwave oven, the power of the range hood automatically drops to a range that does not interfere with normal voice recognition of the microwave oven, but the user finds that the smoke amount in the kitchen system 100 increases, and the power of the range hood may be adjusted to increase through a control program of a range hood panel or a terminal so as to perform high-power smoke extraction, and then the kitchen system may control the power of the range hood to increase to a user's set value so as to perform better smoke extraction.
More specifically, the voice recognition unit with the voice recognition unit 10 may be a wall-mounted microwave oven installed in an open kitchen with a powerful exhaust fan, which does not work most of the time, but works with a loud noise, which affects the voice interaction experience with the user. When the voice recognition unit 10 is awakened, if the exhaust fan is working, the exhaust fan is immediately issued with an instruction to be operated at the lowest power, so that the environmental noise caused by the exhaust fan is reduced, normal voice interaction can be performed at the moment, and the instruction is issued after the interaction is completed to recover the original power or other powers set by a user. If the user actively adjusts the power of the exhaust fan during the voice interaction process, the exhaust fan can immediately operate at the power set by the user.
With reference to fig. 5, the present invention further provides a kitchen system 100, the kitchen system 100 comprising a speech recognition unit 10 and a kitchen appliance 20, the kitchen system 100 further comprising a wake-up unit 30, a detection unit 40 and a control unit 50. The wake-up unit 30 is used to wake up the voice recognition function of the voice recognition unit 10. The detection unit 40 is used to detect noise information of the kitchen appliance 20. The control unit 50 is used for controlling the voice recognition unit to perform voice command recognition in the case where the noise information is within the operating range of the voice recognition unit 10, and for controlling the kitchen appliance to reduce noise so that the noise information is within the operating range of the voice recognition unit 10 in the case where the noise information is out of the operating range of the voice recognition unit 10.
In the kitchen system 100, after the detection unit 40 detects that the noise of the kitchen appliance 20 exceeds the working range of the voice recognition unit 10, the control unit 50 controls the kitchen appliance 20 to reduce the noise, so that the voice recognition unit 10 of the kitchen system 100 can work normally, and the interference of the noise generated when the kitchen appliance 20 works on the voice recognition unit 10 is effectively avoided.
As described above, the kitchen system 100 may be understood as an intelligent kitchen system, a cloud kitchen common system, and the like, and specifically, the kitchen system 100 may be a sum of devices such as a microwave oven, a baking oven, an electric stew, a juice extractor, a wall breaking machine, a dish washer, a dryer, and the like, and may further include a range hood, an exhaust fan, a refrigerator, and the like, and the various devices in the kitchen may be connected to each other and controlled by one or more devices, or the various devices in the kitchen may be configured and controlled by one or more terminals, and further, or, a control program for controlling the various devices in the kitchen may be stored in a cloud of the server, and the terminal is connected to the server and obtains the control program to implement function control on the various devices in the kitchen, where the control function may include controlling on-off states, and a wall breaking machine of the various devices in the kitchen The voice function, the control of the air volume, the control of the power, the control of the heating power, the control of the cooking mode, the control of the timing information, etc. are not limited to the above-mentioned embodiments, and the embodiments according to the present invention are within the scope of the present invention.
In the above embodiments, the speech recognition unit 10 may be understood as a device or devices in a kitchen, such as one or more of a microwave oven, an electric stewpan, a juice extractor, a wall breaking machine, an electric pressure cooker, an electric steamer, a refrigerator, a range hood, an exhaust fan, a dishwasher, a dryer, etc., the kitchen appliance 20 may also be understood as a device in one or more kitchens, for example, one or more of a microwave oven, an electric stewpan, a juice extractor, a wall breaking machine, an electric pressure cooker, an electric steamer, a refrigerator, a range hood, an exhaust fan, a dish washer, a dryer, etc., the voice recognition unit 10 and the kitchen appliance 20 are different kitchen devices in the same kitchen system 100, the voice recognition unit 10 is connected to the voice recognition unit 10, and after the voice recognition unit 10 is turned on, the voice recognition unit 10 can be controlled through a voice command.
For ease of describing and understanding the present invention, in some embodiments, the speech recognition unit 10 may be a microwave oven and the kitchen appliance 20 may be a range hood, exhaust fan, wall breaking machine, soymilk maker, or the like that is prone to generate relatively loud noise when in operation.
It is understood that, in the above embodiment, when the voice recognition unit 10 enters the voice recognition function, the noise generated when the kitchen appliance 20 operates may affect the normal function of the voice recognition unit 10. The voice recognition unit 10 recognizes a voice instruction, which is typically a sound uttered by a user, such as "please turn on the voice recognition unit", "turn on the light", "cook with small fire", "heat for 5 minutes", "please turn off the voice recognition unit", and so on, through the voice recognition unit 10. Kitchen appliance 20 works after speech recognition unit 10 opens the speech recognition function, can produce the sound of great decibel volume usually, for example, smoke ventilator can produce great sound, broken wall machine, soybean milk machine etc. also can produce great sound at the during operation, and these sounds cover very easily or disturb the natural sound production of falling the human body to make the speech recognition function of speech recognition unit 10 become difficult.
It is understood that in other embodiments, part or all of the functions of the control unit 50 may be implemented by the controller or processor, or control panel, or computer board of the voice recognition unit 10 and/or the kitchen appliance 20 itself, or the control unit 50 may be made as a separate control box or control terminal including the controller, processor, control panel, or computer board, and installed on the kitchen appliance 20 or the voice recognition unit 10, or at another location outside the kitchen appliance 20 or the voice recognition unit.
Referring to fig. 6, the voice recognition unit 10 is connected to a speaker 11 and a power amplifier module 12, wherein the power amplifier module 12 and the speaker 11 amplify the sound signal output by the voice unit so as to clearly interact with the user, the kitchen system 100 may include a display and control panel 60, the display and control panel 60 may be disposed on the voice recognition unit 10 or the kitchen appliance 20, or the display and control panel 60 is connected to a terminal, wherein the display and control panel 60 may be connected to and interact with the control unit 50, a command for waking up voice may be input on the display screen, information of the current operation of the voice recognition unit 10 and the kitchen appliance 20 may also be queried, and specifically, the voice recognition unit 10 of the voice recognition unit 10 wakes up the voice recognition module by touching the display and control panel 60, the control unit 50 sends the voice recognition command to the kitchen appliance 20 to detect the working power thereof, after the operating power thereof exceeds the normal operating range of the voice recognition unit 10, the control unit 50 transmits a power-down command to the kitchen appliance 20 to reduce the operating power of the kitchen appliance 20 to ensure the normal operation of the voice recognition unit 10.
In the kitchen system 100 according to the embodiment of the present invention, the detection unit 40 can detect the noise information of the kitchen appliance 20, and in the case that the noise information is within the working range of the voice recognition unit 10, the control unit 50 controls the voice recognition unit 10 to continue voice command recognition, and in the case that the noise information is beyond the working range of the voice recognition unit 10, the control unit 50 controls the kitchen appliance 20 to reduce noise so that the noise information is within the working range of the voice recognition unit 10, thereby ensuring that the working sound of the kitchen appliance 20 does not affect the voice command recognition performed by the voice recognition unit 10.
The wake-up unit 30 is configured to accept at least one of the following instructions: voice commands, gesture commands, and key commands. In the kitchen system 100, when the ambient noise is large, voice wakeup is relatively difficult, and the voice recognition function of the voice recognition unit 10 may also be awakened by a gesture command or a key command. The waking unit 30 may be configured to receive a voice waking instruction, or may also be configured to receive a gesture waking instruction, or may also be configured to receive a key waking instruction, or one of the three instructions is selected to be performed, or two or three of the three instructions may wake up the voice recognition unit 10. Of course, all the instructions that can be received by the wake-up unit 30 cannot be exhausted here, but other instructions that can be received by the wake-up unit 30 are not limited as long as the voice recognition function can be woken up, such as a light instruction, a vibration instruction, and the like.
The kitchen system 100 of the above embodiment can load resources automatically and be in a sleep state when the voice recognition unit 10 is turned on, and clear the sleep identifier to enter the wake state after the wake unit 30 receives the wake instruction, so as to implement voice control on the voice recognition unit 10. The speech recognition unit 10 is in the sleep state, and power consumption can be reduced, thereby realizing the low power consumption function of the speech recognition unit 10.
In the above embodiment, the detecting unit 40 is further configured to detect the current working power of the kitchen appliance 20, and the working power is positively correlated to the noise information. Here, the detection unit 40 may be understood as a power detection unit, and for the additional arrangement of the noise information detection unit 40, the power detection unit may be implemented by a pure software algorithm, which can save cost and simplify control functions.
In the above embodiment, the control unit 50 is configured to control the kitchen appliance 20 to reduce noise if the noise information exceeds the operating range of the voice recognition unit 10 and if the noise information exceeds the operating range of the voice recognition unit 10. In the present invention, after the detection unit 40 detects that the operating power of the kitchen appliance 20 exceeds the range of the normal operation of the voice recognition unit 10, the control unit 50 sends an instruction to request to reduce the operating power of the kitchen appliance 20, so that the noise generated when the kitchen appliance 20 operates does not affect the normal voice recognition function of the voice recognition unit 10, thereby ensuring that the voice interaction between the user and the voice recognition unit 10 can be smoothly realized.
In some embodiments, the control module is further configured to receive adjustment information of the operating power of the kitchen appliance 20 during the voice recognition command from the voice recognition unit 10, and adjust the operating power of the kitchen appliance 20 according to the adjustment information. During the voice recognition command of the voice recognition unit 10, the user feels the power of the kitchen appliance 20 is decreased, and at this time, the user adjusts the working power of the kitchen appliance 20 to realize the normal cooking function or the smoke exhaust function of the kitchen appliance 20.
The kitchen system 100 according to the above-described embodiment can adjust the kitchen appliance 20 to a state set by the user after receiving an information command for adjusting the operating power of the kitchen appliance 20 from the user during the voice recognition command by the voice recognition unit 10, so as to ensure that the kitchen appliance 20 can achieve an operating state according with the user's desire.
In addition, the kitchen system 100 according to the embodiment of the present invention further includes a terminal for connecting the voice recognition unit 10 and the kitchen appliance 20, the terminal being configured to set the voice recognition unit 10 to turn on the voice recognition function and manage and control the operation state of the kitchen appliance 20. Therefore, the voice recognition unit 10 and the kitchen appliance 20 are connected through the terminal, so that the kitchen system 100 can be more intelligent, and the operation is convenient and easy to manage. The terminal may include but is not limited to a cell phone, a tablet computer, a personal computer, a wearable smart device, a vehicle-mounted terminal device, a home appliance, etc., the terminal is respectively connected with the voice recognition unit 10 and the kitchen appliance 20 in a direct connection mode or an account number binding mode, and the voice recognition unit 10 and the kitchen appliance 20 can be controlled on the application program interface of the terminal, the voice recognition unit 10 can start the voice recognition function through the terminal, or can start the voice recognition function through the panel or the keys on the voice recognition unit 10, etc., the terminal can update the state of the voice recognition unit 10 to be consistent with the actual operation state of the current voice recognition unit 10, and after the terminal acquires that the voice recognition function of the voice recognition unit 10 is awakened, the operation of the kitchen appliance 20 can be automatically controlled, for example, the power of the kitchen appliance 20 is adjusted to be within the range accepted by the normal operation of the voice recognition module of the voice recognition unit 10. The terminal may also be personalized with the operating parameters according to the present invention, such as the gear to which the power of the kitchen appliance 20 is specifically adjusted, and for example, in the case that the kitchen appliance 20 includes a plurality of cooking, dining, washing, and cooking devices, the terminal may be personalized with the power configuration relationship thereof, and the like.
The present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program that, when executed, implements the control method of the kitchen system 100 of any of the above embodiments.
The above-mentioned computer readable storage medium, in the kitchen system 100, can implement the program stored thereon, and after detecting that the noise of the kitchen appliance 20 exceeds the working range of the voice recognition unit 10, control the kitchen appliance 20 to reduce the noise, thereby ensuring that the voice recognition unit 10 of the kitchen system 100 can work normally, and effectively avoiding the interference of the noise generated when the kitchen appliance 20 works on the voice recognition unit 10.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processing module-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
It should be understood that portions of embodiments of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium. The storage medium referred to herein may be a read-only memory, a magnetic or optical disk, or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (12)
1. A control method of a kitchen system including a voice recognition unit and a kitchen appliance, the control method comprising:
waking up a voice recognition function of the voice recognition unit;
detecting noise information of the kitchen appliance;
under the condition that the noise information is within the working range of the voice recognition unit, controlling the voice recognition unit to perform voice command recognition;
and under the condition that the noise information exceeds the working range of the voice recognition unit, controlling the kitchen appliance to reduce noise so that the noise information is positioned in the working range of the voice recognition unit.
2. The kitchen system control method according to claim 1, wherein waking up the voice recognition function of the voice recognition unit comprises at least one of: voice wake-up, gesture wake-up, and button wake-up.
3. The method of claim 1, wherein detecting the noise information of the kitchen appliance comprises:
and detecting the current working power of the kitchen appliance, wherein the working power is positively correlated with the noise information.
4. The kitchen system control method according to claim 3, wherein in the case where the noise information is out of an operating range of the voice recognition unit, controlling the kitchen appliance to reduce noise so that the noise information is within the operating range of the voice recognition unit includes:
controlling the kitchen appliance to reduce operating power such that the noise information is within an operating range of the voice recognition unit.
5. The kitchen system control method according to claim 4, further comprising:
receiving the adjustment information of the working power of the kitchen electrical appliance in the process of the voice recognition command by the voice recognition unit;
and adjusting the current working power of the kitchen appliance according to the adjustment information.
6. A kitchen system comprising a speech recognition unit and a kitchen appliance, characterized in that the kitchen system further comprises:
a wake-up unit for waking up a voice recognition function of the voice recognition unit;
the detection unit is used for detecting the noise information of the kitchen appliance;
and the control unit is used for controlling the voice recognition unit to recognize voice commands under the condition that the noise information is in the working range of the voice recognition unit, and controlling the kitchen appliance to reduce noise so that the noise information is positioned in the working range of the voice recognition unit under the condition that the noise information exceeds the working range of the voice recognition unit.
7. The kitchen system of claim 6, wherein the wake-up unit is configured to accept at least one of the following wake-up instructions: and the voice recognition function of the voice recognition unit is awakened according to the awakening instruction.
8. The kitchen system according to claim 6, wherein the detection unit is further configured to detect a current operating power of the kitchen appliance, and the operating power is positively correlated to the noise information.
9. A kitchen system according to claim 8, characterized in that in case the operating power of the kitchen appliance exceeds the operating range of the speech recognition unit, the control unit is adapted to control the kitchen appliance to reduce the operating power such that the noise information is within the operating range of the speech recognition unit.
10. The kitchen system of claim 6, wherein the control unit is further configured to receive adjustment information of the kitchen appliance operating power during the voice recognition command by the voice recognition unit, and adjust the current operating power of the kitchen appliance according to the adjustment information.
11. The galley system according to claim 6, further comprising:
and the terminal is connected with the voice recognition unit and the kitchen appliance and is used for setting the voice recognition unit to start a voice recognition function and managing and controlling the running state of the kitchen appliance.
12. A non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed, implements the kitchen system control method of any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011079194.0A CN112233673A (en) | 2020-10-10 | 2020-10-10 | Control method of kitchen system, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011079194.0A CN112233673A (en) | 2020-10-10 | 2020-10-10 | Control method of kitchen system, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112233673A true CN112233673A (en) | 2021-01-15 |
Family
ID=74113228
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011079194.0A Pending CN112233673A (en) | 2020-10-10 | 2020-10-10 | Control method of kitchen system, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112233673A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115250208A (en) * | 2021-04-27 | 2022-10-28 | 佛山市顺德区美的电热电器制造有限公司 | Control method and device, storage medium, household appliance and control equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108489001A (en) * | 2018-04-26 | 2018-09-04 | 英飞凌（深圳）智慧科技有限公司 | Improve the clarifier control method and device of phonetic recognization rate |
| CN108604447A (en) * | 2016-02-03 | 2018-09-28 | 索尼公司 | Information processing unit, information processing method and program |
| CN109658936A (en) * | 2019-01-03 | 2019-04-19 | 珠海市黑鲸软件有限公司 | A method of improving kettle phonetic recognization rate |
| CN109671426A (en) * | 2018-12-06 | 2019-04-23 | 珠海格力电器股份有限公司 | A kind of sound control method, device, storage medium and air-conditioning |
| CN110556101A (en) * | 2019-07-30 | 2019-12-10 | 珠海格力电器股份有限公司 | Voice control method, device, computer equipment and storage medium |
| CN111508515A (en) * | 2013-12-18 | 2020-08-07 | 思睿逻辑国际半导体有限公司 | Voice command triggered speech enhancement |
-
2020
- 2020-10-10 CN CN202011079194.0A patent/CN112233673A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111508515A (en) * | 2013-12-18 | 2020-08-07 | 思睿逻辑国际半导体有限公司 | Voice command triggered speech enhancement |
| CN108604447A (en) * | 2016-02-03 | 2018-09-28 | 索尼公司 | Information processing unit, information processing method and program |
| CN108489001A (en) * | 2018-04-26 | 2018-09-04 | 英飞凌（深圳）智慧科技有限公司 | Improve the clarifier control method and device of phonetic recognization rate |
| CN109671426A (en) * | 2018-12-06 | 2019-04-23 | 珠海格力电器股份有限公司 | A kind of sound control method, device, storage medium and air-conditioning |
| CN109658936A (en) * | 2019-01-03 | 2019-04-19 | 珠海市黑鲸软件有限公司 | A method of improving kettle phonetic recognization rate |
| CN110556101A (en) * | 2019-07-30 | 2019-12-10 | 珠海格力电器股份有限公司 | Voice control method, device, computer equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115250208A (en) * | 2021-04-27 | 2022-10-28 | 佛山市顺德区美的电热电器制造有限公司 | Control method and device, storage medium, household appliance and control equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102590047B1 (en) | Multi-modal interaction with intelligent assistants on voice command devices | |
| CN106847298B (en) | Pickup method and device based on diffuse type voice interaction | |
| CN106019993B (en) | Cooking system | |
| CN106175407B (en) | A kind of cooking apparatus and interactive voice control method with interactive voice | |
| CN105223862B (en) | A kind of household electrical appliance and its audio control method and system | |
| CN111965989B (en) | System updating method and device, intelligent home control panel and storage medium | |
| CN110604467B (en) | Cooking utensil and depressurization exhaust method and device thereof | |
| CN112233673A (en) | Control method of kitchen system, and computer-readable storage medium | |
| WO2020044142A1 (en) | Home appliance control system and home appliance | |
| CN106936992A (en) | Quarter-bell control method, device, Intelligent worn device, intelligent audio playback equipment and system | |
| CN109358530B (en) | Control device and household appliance | |
| CN111380097B (en) | Range hood, range hood kitchen range linkage system and control method thereof | |
| CN114120996A (en) | Voice interaction method and device | |
| CN211828111U (en) | Voice interaction system | |
| CN109974229B (en) | Method and device for determining air conditioner state, electronic equipment and storage medium | |
| CN112083669A (en) | Household appliance, storage medium and method for controlling communication module of household appliance | |
| CN112066424A (en) | Ignition control method and device of stove and stove | |
| CN106681131A (en) | Voice timing type household appliance and timing method thereof | |
| CN110164426A (en) | Sound control method and computer storage medium | |
| CN114747951A (en) | Cooking control method and device, storage medium and cooking equipment | |
| CN218269291U (en) | Heating system with foot massage function and heating table | |
| CN111243589A (en) | Control method of household appliance, household appliance and computer readable storage medium | |
| CN216595933U (en) | Electronic equipment and interactive control system and interactive controller thereof | |
| CN103514872A (en) | Pealing device for household appliance prompting | |
| JP7269812B2 (en) | Home appliances |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |