CN111443613A

CN111443613A - Control method and device of electrical equipment, storage medium and electrical equipment

Info

Publication number: CN111443613A
Application number: CN202010231863.5A
Authority: CN
Inventors: 文皓; 韩雪; 刘健军; 王慧君; 李保水
Original assignee: Gree Electric Appliances Inc of Zhuhai
Current assignee: Gree Electric Appliances Inc of Zhuhai
Priority date: 2020-03-27
Filing date: 2020-03-27
Publication date: 2020-07-24

Abstract

The invention discloses a control method and a control device for electrical equipment, a storage medium and the electrical equipment, wherein the method comprises the following steps: acquiring a text image in an environment to which the electrical equipment belongs or an environment to which a control end of the electrical equipment belongs; recognizing text information in a text image in an environment to which the electrical equipment belongs or an environment to which a control terminal of the electrical equipment belongs; and controlling the electrical equipment according to the text information so as to realize the control of the electrical equipment through the text information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs. The scheme of the invention can solve the problem that the control mode of some electrical equipment is inconvenient for users who can only control the electrical equipment by using characters, and achieves the effect that the users who can only control the electrical equipment by using characters can use the electrical equipment by using the character control mode, thereby improving the use convenience.

Description

Control method and device of electrical equipment, storage medium and electrical equipment

Technical Field

The invention belongs to the technical field of electrical equipment such as household appliances, and particularly relates to a control method and device of the electrical equipment, a storage medium and the electrical equipment, in particular to a method and device for controlling the electrical equipment (such as an air conditioner) based on a multi-scale OCR technology, the storage medium and the electrical equipment (such as the air conditioner).

Background

Some voice electrical equipment can control the electrical equipment through a voice technology so as to meet the voice control requirements of most users. However, a small number of users who are inconvenient to make voice can not control the electrical equipment by using voice, and only can control the electrical equipment by using characters, so that the problem of inconvenient use of the voice electrical equipment also exists.

The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.

Disclosure of Invention

The invention aims to solve the defects and provide a control method, a control device, a storage medium and an electrical device of the electrical device, so as to solve the problem that the control mode of some electrical devices is inconvenient for users who can only control the electrical devices by using characters, and achieve the effect that the users who can only control the electrical devices by using characters can use the electrical devices by using the character control mode, thereby improving the use convenience.

The invention provides a control method of electrical equipment, which comprises the following steps: acquiring a text image in an environment to which the electrical equipment belongs or an environment to which a control end of the electrical equipment belongs; recognizing text information in a text image in an environment to which the electrical equipment belongs or an environment to which a control terminal of the electrical equipment belongs; and controlling the electrical equipment according to the text information so as to realize the control of the electrical equipment through the text information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs.

Optionally, the obtaining a text image of an environment to which the electrical device belongs or an environment to which a control end of the electrical device belongs includes: under the condition that the text control function of the electrical equipment is started, identifying whether a text exists in an environment to which the electrical equipment belongs or a set control area in an environment to which a control end of the electrical equipment belongs through an image acquisition module; if the text exists in the set control area in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs, acquiring a text image of the text in the set control area in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs; wherein, set up the control area, include: the area that the image acquisition module can gather in the environment that electrical equipment belongs to or the environment that the control end of electrical equipment belongs to.

Optionally, identifying text information in the text image in an environment to which the electrical device belongs or an environment to which a control terminal of the electrical device belongs includes: recognizing a text picture in the text image through a multi-scale OCR recognition technology, and extracting characteristic information in the text picture; after preprocessing the characteristic information in the text picture, cutting the character picture obtained by preprocessing to obtain characters in the character picture; and analyzing the characters in the character pictures obtained by cutting to obtain the meanings of the characters in the character pictures, and using the meanings as the text information in the text images in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs.

Optionally, the feature information in the text picture is preprocessed, including: and performing at least one of angle correction, denoising, defogging and image enhancement on the characteristic information in the text picture.

Optionally, controlling the electrical device according to the text information includes: generating a control instruction according to the text information so as to control the electrical equipment according to the control instruction; and/or synthesizing voice control information according to the text information, broadcasting the voice control information, and controlling the electrical equipment according to the voice control information; and/or synthesizing voice reading information matched with the age information of the user in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs according to the text information, and broadcasting the voice reading information so as to broadcast the text information in the text image to the user according to the voice reading information.

In accordance with the above method, another aspect of the present invention provides a control device for an electrical apparatus, including: the device comprises an acquisition unit, a processing unit and a display unit, wherein the acquisition unit is used for acquiring a text image in an environment to which the electrical equipment belongs or an environment to which a control end of the electrical equipment belongs; the identification unit is used for identifying text information in the text image in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs; and the control unit is used for controlling the electrical equipment according to the text information so as to realize the control of the electrical equipment through the text information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs.

Optionally, the acquiring unit acquires the text image in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs, and includes: under the condition that the text control function of the electrical equipment is started, identifying whether a text exists in an environment to which the electrical equipment belongs or a set control area in an environment to which a control end of the electrical equipment belongs through an image acquisition module; if the text exists in the set control area in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs, acquiring a text image of the text in the set control area in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs; wherein, set up the control area, include: the area that the image acquisition module can gather in the environment that electrical equipment belongs to or the environment that the control end of electrical equipment belongs to.

Optionally, the recognizing unit recognizes text information in the text image in an environment to which the electrical device belongs or an environment to which a control terminal of the electrical device belongs, and includes: recognizing a text picture in the text image through a multi-scale OCR recognition technology, and extracting characteristic information in the text picture; after preprocessing the characteristic information in the text picture, cutting the character picture obtained by preprocessing to obtain characters in the character picture; and analyzing the characters in the character pictures obtained by cutting to obtain the meanings of the characters in the character pictures, and using the meanings as the text information in the text images in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs.

Optionally, the preprocessing the feature information in the text picture by the identification unit includes: and performing at least one of angle correction, denoising, defogging and image enhancement on the characteristic information in the text picture.

Optionally, the controlling unit controls the electrical device according to the text information, including: generating a control instruction according to the text information so as to control the electrical equipment according to the control instruction; and/or synthesizing voice control information according to the text information, broadcasting the voice control information, and controlling the electrical equipment according to the voice control information; and/or synthesizing voice reading information matched with the age information of the user in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs according to the text information, and broadcasting the voice reading information so as to broadcast the text information in the text image to the user according to the voice reading information.

In accordance with another aspect of the present invention, there is provided an electrical apparatus, including: the control device for electrical equipment described above.

In accordance with the above method, a further aspect of the present invention provides a storage medium comprising: the storage medium has stored therein a plurality of instructions; the instructions are used for loading and executing the control method of the electrical equipment by the processor.

In accordance with the above method, another aspect of the present invention provides an electrical device, including: a processor for executing a plurality of instructions; a memory to store a plurality of instructions; the instructions are stored in the memory, and loaded by the processor and used for executing the control method of the electrical equipment.

According to the scheme, the text control information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs is identified by utilizing the multi-scale technology, and the electrical equipment is controlled by identifying the text, so that special groups can get rid of text control of the remote controller, and convenience in use of users is improved.

Further, the scheme of the invention identifies the text control information in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs by utilizing a multi-scale technology, controls the electrical equipment by identifying the text, can identify the text by multi-scale, and synthesizes voice based on the identification result, such as synthesizing voices of different ages, thereby bringing the voice effect of the voice electrical equipment to special groups (such as groups which can not listen to speech).

Furthermore, the scheme of the invention can identify the text control information in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs by utilizing a multi-scale technology, can identify characters to synthesize voices at different ages to recite the text to correct the pronunciation of the child, and is convenient for the child to learn.

Furthermore, the scheme of the invention can identify the text of the children's text to recite the text by identifying the text control information in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs by utilizing a multi-scale technology, thereby improving the pronunciation capability of the children.

Further, according to the scheme of the invention, the text control information in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs is identified by utilizing a multi-scale technology, so that real-time conversation between text and voice can be carried out when a special user needs to chat with the electrical equipment, and the humanization is better.

Therefore, according to the scheme, the text control information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs is identified by utilizing the multi-scale technology, the electrical equipment is controlled by identifying the text, the problem that the control mode of some electrical equipment is inconvenient to use for users who can only control the electrical equipment by using characters is solved, and the effect that the users who can only control the electrical equipment by using the characters can use the electrical equipment by using the character control mode is achieved, so that the use convenience is improved.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.

Drawings

Fig. 1 is a flowchart illustrating a control method of an air conditioner according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of an embodiment of obtaining a text image in an environment to which an air conditioner belongs or an environment to which a control terminal of an electrical device belongs in the method of the present invention;

FIG. 3 is a flowchart illustrating an embodiment of identifying text information in a text image in an environment to which an air conditioner belongs or an environment to which a control terminal of an electrical device belongs according to the method of the present invention;

FIG. 4 is a schematic structural diagram of a control device of an air conditioner according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of multi-scale transformation of characteristic regions of an embodiment of the air conditioner of the present invention;

fig. 6 is a flow chart illustrating a process of controlling an air conditioner based on a multi-scale OCR technology according to an embodiment of the air conditioner of the present invention.

The reference numbers in the embodiments of the present invention are as follows, in combination with the accompanying drawings:

102-an obtaining unit; 104-an identification unit; 106-control unit.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

According to an embodiment of the present invention, a method for controlling an electrical device (e.g., an air conditioner) is provided, as shown in fig. 1, which is a schematic flow chart of an embodiment of the method of the present invention. The control method of the electrical equipment (such as an air conditioner) can be applied to voice electrical equipment (such as an air conditioner), and the control method of the voice electrical equipment (such as the air conditioner) can comprise the following steps: step S110 to step S130.

In step S110, in the case of starting a text control function of a voice electric appliance (e.g., an air conditioner), a text image in an environment to which the electric appliance (e.g., the air conditioner) belongs or an environment to which a control terminal of the electric appliance belongs is acquired. Text control function, i.e. a function of controlling an electric appliance (e.g. an air conditioner) such as a voice electric appliance (e.g. an air conditioner) using text information.

Optionally, with reference to a flowchart of an embodiment of the method shown in fig. 2, which is used to obtain the text image in the environment to which the electrical device (such as an air conditioner) belongs or the environment to which the control terminal of the electrical device belongs, further describing a specific process of obtaining the text image in the environment to which the electrical device (such as an air conditioner) belongs or the environment to which the control terminal of the electrical device belongs in step S110, the method may include: step S210 and step S220.

Step S210, when the text control function of the electrical equipment (such as an air conditioner) is turned on, identifying whether a text exists in an environment to which the electrical equipment (such as an air conditioner) belongs or a set control region in the environment to which the control terminal of the electrical equipment belongs through the image acquisition module, such as a camera arranged on the electrical equipment (such as an air conditioner) or on the control terminal of the electrical equipment (such as a remote controller of the air conditioner, an APP client of the air conditioner, and the like).

Step S220, if a text exists in the set control region in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control terminal of the electrical equipment belongs, acquiring a text image of the text in the set control region in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control terminal of the electrical equipment belongs. Wherein, setting the control area may include: the environment to which the electrical equipment (such as an air conditioner) belongs or the area which can be acquired by the image acquisition module in the environment to which the control end of the electrical equipment belongs.

For example: and reading the indoor room image in real time through the camera to obtain the picture with text characters.

Specifically, when a user in a special group uses a gesture to control an electrical device (such as an air conditioner), the gesture recognition may be performed in a large error (for example, when the user has inflexible limb movement and the user has not precise gesture movement, the gesture recognition may be performed in a wrong manner), or when the user is out of the remote controller control, when the special group is alone indoors, the text handwritten by the user may be recognized by the camera to control the electrical device (such as the air conditioner), for example, the basic function and the online resource control of the electrical device (such as the air conditioner) may be controlled by recognizing text characters by the camera. That is to say, the voice electrical equipment (such as an air conditioner) not only covers the voice function of the electrical equipment (such as the air conditioner) used by the ordinary user, but also the special group can independently use the text in the recognition image to control the functions of the electrical equipment (such as the air conditioner) such as listening to music and the like.

Therefore, the text image of the text is acquired under the condition that the text exists in the environment where the electrical equipment (such as an air conditioner) belongs or the control area in the environment where the control end of the electrical equipment belongs, so that energy waste caused by processing the text image instead of the text image which is acquired randomly is avoided, and the reliability of controlling the electrical equipment (such as the air conditioner) based on the text image can be improved.

At step S120, text information in the text image in an environment to which an electric device (such as an air conditioner) belongs or an environment to which a control terminal of the electric device belongs is identified.

Alternatively, the specific process of identifying the text information in the text image in the environment to which the electrical device (such as an air conditioner) belongs or the environment to which the control terminal of the electrical device belongs in step S120 may be referred to the following exemplary description.

With reference to the flowchart of fig. 3 showing an embodiment of the method of the present invention for identifying text information in a text image in an environment to which an electrical device (such as an air conditioner) belongs or an environment to which a control terminal of the electrical device belongs, a specific process of identifying text information in a text image in an environment to which an electrical device (such as an air conditioner) belongs or an environment to which a control terminal of the electrical device belongs in step S120 is further described, which may include: step S310 to step S330.

Step S310, recognizing the text picture in the text image through a multi-scale OCR recognition technology, and extracting feature information in the text picture.

For example: when a camera in an electrical device (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical device (such as the air conditioner) can adjust the size of an extraction frame for image extraction through a multi-scale algorithm according to the sizes of texts and image text fonts in images at different distances so as to extract feature information.

Step S320, after preprocessing the feature information in the text picture, cutting the character picture obtained by preprocessing to obtain characters in the character picture.

For example: when a camera in an electrical device (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical device (such as the air conditioner) can frame texts and image text font sizes in images at different distances through a multi-scale algorithm to extract feature information, then the characters in a feature area identified in a block diagram are segmented through image series image preprocessing, each identified text is cut, each segmented text is segmented in a row-column mode, and each character is cut, namely the character corresponding to each column in each line of text.

More optionally, the preprocessing the feature information in the text picture in step S320 may include: and performing at least one of angle correction, denoising, defogging and image enhancement on the characteristic information in the text picture.

For example: when a camera in an electrical device (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical device (such as the air conditioner) can frame texts and image text font sizes in images at different distances through a multi-scale algorithm to extract characteristic information, and then a series of image preprocessing such as angle correction and denoising, defogging processing and image enhancement are performed through the image.

Therefore, the characteristic information in the text picture is preprocessed in various forms, so that the accuracy of the characteristic information can be improved, and the accuracy and the reliability of controlling electrical equipment (such as an air conditioner) based on the text image can be improved.

Step S330, analyzing the characters in the character pictures obtained by cutting to obtain the meanings of the characters in the character pictures, and using the meanings as the text information in the text images in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control end of the electrical equipment belongs.

For example: when a camera in electrical equipment (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical equipment (such as the air conditioner) can adjust the size of an extraction frame for extracting image by a multi-scale algorithm according to the sizes of texts and image text fonts in images at different distances so as to extract feature information, then, through a series of image preprocessing of the image, the characters in a feature area identified in a block diagram are segmented, and each identified character is cut; finally, performing line-row segmentation on each line of text cut off, and cutting out each character, namely cutting out the character corresponding to each column in each line of text. And then analyzing each cut text to obtain the identified text information.

Therefore, the text information in the text image is recognized by utilizing the multi-scale OCR recognition technology, the recognition mode is reliable, the recognition result is accurate, and the accuracy and the reliability of controlling electrical equipment (such as an air conditioner) based on the text image are improved.

At step S130, an electrical device (e.g., an air conditioner) is controlled according to the text information, so as to control the electrical device (e.g., the air conditioner) through the text information in the environment to which the electrical device (e.g., the air conditioner) belongs or the environment to which the control end of the electrical device belongs.

For example: the multi-scale technology can be used for recognizing text texts at different distances from the electrical equipment (such as an air conditioner), the electrical equipment (such as the air conditioner) is controlled by recognizing the text texts through OCR (optical character recognition), so that users of the electrical equipment (such as the air conditioner) cannot be controlled by voice by a small part of special users, and the electrical equipment (such as the air conditioner) can be controlled by the text texts. Therefore, by adding the multi-scale OCR technology to control electrical equipment (such as an air conditioner), the requirement that a special group gets rid of the fact that a remote controller can use text for control can be met.

Therefore, the text information is recognized based on the text image, and the electrical equipment (such as an air conditioner) is controlled according to the text information, so that the control convenience of a user who cannot control the electrical equipment (such as the air conditioner) by using voice under the condition of getting rid of the control of a remote controller can be met.

Alternatively, the step S130 of controlling the electrical device (such as an air conditioner) according to the text information may include: any of the following control scenarios.

The first control scenario: and controlling the operation of the electrical equipment (such as an air conditioner) according to the text information.

According to the text information, a control instruction is generated to control the electrical equipment (such as an air conditioner) according to the control instruction, namely the electrical equipment (such as the air conditioner) is controlled to execute the control instruction.

For example, text is generated through OCR recognition and then parsed through bi-directional L STM based on the parsed text, text transmission related commands are generated to control electrical appliances such as air conditioners.

The second control scenario: and controlling the voice broadcast of the electrical equipment (such as an air conditioner) and controlling the operation of the electrical equipment (such as the air conditioner) according to the text information.

And synthesizing voice control information according to the text information, broadcasting the voice control information, and controlling the electrical equipment (such as an air conditioner) according to the voice control information, namely controlling the electrical equipment (such as the air conditioner) to execute the voice control information.

For example: the camera recognizes characters in the image to control electrical equipment (such as an air conditioner), and the part of functions are provided for special people; the voice broadcasting can be synthesized by a text recognizing the image.

For example: the text may be recognized through multiple scales and speech synthesized based on the recognition results, such as synthesizing speech of different ages. If different font sizes can be recognized to control electrical equipment (such as an air conditioner), the voice effect of voice electrical equipment (such as the air conditioner) can be brought to a special group (such as a group which can not listen to the voice) through the multi-scale OCR technology.

For example, bidirectional L STM semantic parsing is carried out through recognized texts, the texts are parsed to be semantically parsed to control electrical equipment (such as an air conditioner) or obtain resource information relevant to cloud, or texts are synthesized or voice is generated based on text content.

The third control scenario: and controlling voice broadcast of electrical equipment (such as an air conditioner) according to the text information.

And synthesizing voice reading information matched with the age information of the user in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control terminal of the electrical equipment belongs according to the text information, and broadcasting the voice reading information so as to broadcast the text information in the text image to the user according to the voice reading information. When the age information of the user is determined, the image information of the user can be obtained, and the age information of the user is determined according to the comparison relationship between the characteristic information of the image information of the user and the pre-stored characteristic information of different age groups; or, the age information of the user can be determined according to the comparison relationship between the identity information corresponding to the image information of the user and the identity information of the pre-stored family members.

For example, text may be generated by OCR recognition and then parsed by a two-way L STM based on the parsed text, text may be generated and synthesized into different gender and age groups of speech, such as by a synthesized speech dialog education function, and child text articles may be presented, such as text in a child text may be presented.

For example: the text may be recognized through multiple scales and speech synthesized based on the recognition results, such as synthesizing speech of different ages. The electric equipment (such as an air conditioner) can recognize characters to synthesize voices at different ages to recite the lessons to correct the pronunciation of the child, and the articles of the lessons can be recognized to recite the lessons, so that the pronunciation capability of the child is improved. Wherein, text is recognized, and the electric voice equipment (such as an air conditioner) can recognize the text, synthesize voice through TTS and correct the pronunciation of children.

For example: the camera recognizes the text handwritten by the user to control the electrical equipment (such as an air conditioner) to meet the requirements of different users on the electrical equipment (such as the air conditioner), and the electrical equipment (such as the air conditioner) with the OCR technology can be applied to child education to correct the pronunciation of the child. Such as by recognizing text and related articles through a speech appliance (e.g., air conditioner) to synthesize speech and recite the text to guide the child to follow and correct the child's mispronunciations.

Therefore, the electric equipment (such as an air conditioner) can be controlled based on the text information, the use requirements of users are not needed conveniently, the intelligent degree of the electric equipment (such as the air conditioner) is greatly improved, and the use convenience of the users is also improved.

Through a large number of tests, the technical scheme of the embodiment is adopted, the text control information in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control end of the electrical equipment belongs is identified by utilizing the multi-scale technology, and the electrical equipment (such as the air conditioner) is controlled by identifying the text, so that the requirement that a special group gets rid of the fact that the remote controller can use the text for control can be met, and the use convenience of a user is improved.

According to an embodiment of the present invention, there is also provided a control apparatus of an electric appliance (such as an air conditioner) corresponding to the control method of the electric appliance (such as the air conditioner). Referring to fig. 4, a schematic diagram of an embodiment of the apparatus of the present invention is shown. The control device of the electrical equipment (such as an air conditioner) can be applied to voice electrical equipment (such as an air conditioner), and the control device of the voice electrical equipment (such as an air conditioner) can comprise: an acquisition unit 102, a recognition unit 104 and a control unit 106.

In an optional example, the obtaining unit 102 may be configured to obtain a text image of an environment to which an electrical device (e.g., an air conditioner) belongs or an environment to which a control terminal of the electrical device belongs, in a case that a text control function of a voice electrical device (e.g., an air conditioner) is started. The specific functions and processes of the acquiring unit 102 are referred to in step S110. Text control function, i.e. a function of controlling an electric appliance (e.g. an air conditioner) such as a voice electric appliance (e.g. an air conditioner) using text information.

Alternatively, the acquiring unit 102 acquires the text image in the environment to which the electrical device (such as an air conditioner) belongs or the environment to which the control terminal of the electrical device belongs, and may include:

the obtaining unit 102 may be further specifically configured to, when the text control function of the electrical equipment (e.g., an air conditioner) is turned on, identify whether a text exists in an environment to which the electrical equipment (e.g., the air conditioner) belongs or a set control region in the environment to which the control terminal of the electrical equipment belongs, through the image acquisition module, for example, a camera provided on the electrical equipment (e.g., the air conditioner) or on the control terminal of the electrical equipment (e.g., a remote controller of the air conditioner, an APP client of the air conditioner, or the like) of the electrical equipment. The specific functions and processes of the acquisition unit 102 are also referred to in step S210.

The obtaining unit 102 may be further configured to obtain a text image of a text in a set control region in an environment to which an electrical device (e.g., an air conditioner) belongs or an environment to which a control end of the electrical device belongs, if the text exists in the set control region in the environment to which the electrical device (e.g., the air conditioner) belongs or the environment to which the control end of the electrical device belongs. Wherein, setting the control area may include: the environment to which the electrical equipment (such as an air conditioner) belongs or the area which can be acquired by the image acquisition module in the environment to which the control end of the electrical equipment belongs. The specific function and processing of the acquisition unit 102 are also referred to in step S220.

In an alternative example, the identification unit 104 may be configured to identify text information in a text image in an environment to which an electrical device (such as an air conditioner) belongs or an environment to which a control terminal of the electrical device belongs. The specific function and processing of the identification unit 104 are referred to in step S120.

Alternatively, the identifying unit 104 may identify text information in the text image in an environment to which the electrical device (such as an air conditioner) belongs or an environment to which the control terminal of the electrical device belongs, and may include:

the recognition unit 104 may be further configured to recognize a text picture in the text image by using a multi-scale OCR recognition technology, and extract feature information in the text picture. The specific function and processing of the recognition unit 104 are also referred to in step S310.

For example: when a camera in an electrical device (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical device (such as the air conditioner) can perform feature information extraction by framing texts in images at different distances and image text font sizes through a multi-scale algorithm.

The identifying unit 104 may be further configured to, after preprocessing the feature information in the text image, cut the preprocessed text image to obtain the text in the text image. The specific function and processing of the recognition unit 104 are also referred to in step S320.

More optionally, the preprocessing the feature information in the text picture by the recognition unit 104 may include: the recognition unit 104 may be further configured to perform at least one of angle correction, denoising, defogging, and image enhancement on the feature information in the text image.

The recognition unit 104 may be further configured to analyze the words in the cut word picture to obtain meanings of the words in the word picture, and the meanings are used as text information in a text image in an environment to which an electrical device (such as an air conditioner) belongs or an environment to which a control terminal of the electrical device belongs. The specific function and processing of the recognition unit 104 are also referred to in step S330.

For example: when a camera in electrical equipment (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical equipment (such as the air conditioner) can frame texts and image text font sizes in images at different distances through a multi-scale algorithm to extract feature information, then through image series image preprocessing, segmenting the characters in a feature area identified in a block diagram, and segmenting each identified character; finally, performing line-row segmentation on each line of text cut off, and cutting out each character, namely cutting out the character corresponding to each column in each line of text; and then analyzing each cut text to obtain the identified text information.

In an alternative example, the control unit 106 may be configured to control an electrical device (e.g., an air conditioner) according to the text information, so as to control the electrical device (e.g., the air conditioner) through the text information in an environment to which the electrical device (e.g., the air conditioner) belongs or an environment to which a control end of the electrical device belongs. The specific function and processing of the control unit 106 are shown in step S130.

Alternatively, the control unit 106 controls the electric device (such as an air conditioner) according to the text information, and may include: any of the following control scenarios.

The control unit 106 may be further configured to generate a control instruction according to the text information, so as to control an electrical device (e.g., an air conditioner) according to the control instruction, that is, control the electrical device (e.g., the air conditioner) to execute the control instruction.

The control unit 106 may be further configured to synthesize voice control information according to the text information, broadcast the voice control information, and control an electrical device (e.g., an air conditioner) according to the voice control information, that is, control the electrical device (e.g., the air conditioner) to execute the voice control information.

The control unit 106 may be further configured to synthesize, according to the text information, voice reading information that matches age information of a user in an environment to which an electrical device (such as an air conditioner) belongs or an environment to which a control terminal of the electrical device belongs, and broadcast the voice reading information, so as to broadcast the text information in the text image to the user according to the voice reading information. When the age information of the user is determined, the image information of the user can be obtained, and the age information of the user is determined according to the comparison relationship between the characteristic information of the image information of the user and the pre-stored characteristic information of different age groups; or, the age information of the user can be determined according to the comparison relationship between the identity information corresponding to the image information of the user and the identity information of the pre-stored family members.

Since the processes and functions implemented by the apparatus of this embodiment substantially correspond to the embodiments, principles and examples of the method shown in fig. 1 to 3, the description of this embodiment is not detailed, and reference may be made to the related descriptions in the foregoing embodiments, which are not repeated herein.

After a large number of tests, the technical scheme of the invention is adopted, the multi-scale technology is utilized to identify the text control information in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control end of the electrical equipment belongs, the text is identified by identifying the text, the electrical equipment (such as the air conditioner) can be controlled, the text can be identified in a multi-scale mode, and the voice is synthesized based on the identification result, for example, the voice of different age groups is synthesized, so that the voice effect of the voice electrical equipment (such as the air conditioner) is brought to special groups (such as groups which can listen and.

According to an embodiment of the present invention, there is also provided an electric appliance (e.g., an air conditioner) corresponding to a control device of the electric appliance (e.g., the air conditioner). The electric appliance (such as an air conditioner) may include: the control device of the electrical equipment (such as an air conditioner) is described above.

In an alternative embodiment, it is considered that a small part of special users cannot control the electric equipment (such as an air conditioner) by voice, and can only control the electric equipment (such as the air conditioner) by words; it is also contemplated that electrical devices (e.g., air conditioners) may recognize text to synthesize speech at different ages to recite lessons to correct the pronunciation of children. The scheme of the invention provides a scheme for controlling electrical equipment (such as an air conditioner) based on a multi-scale OCR technology, which can identify text texts at different distances from the electrical equipment (such as the air conditioner) by utilizing the multi-scale technology, control the electrical equipment (such as the air conditioner) by identifying the text texts, control the electrical equipment (such as the air conditioner) by utilizing the OCR technology, so that users of the electrical equipment (such as the air conditioner) cannot be controlled by utilizing voice by a small part of special users, and control the electrical equipment (such as the air conditioner) by utilizing the text texts. Therefore, by adding the multi-scale OCR technology to control electrical equipment (such as an air conditioner), the requirement that a special group gets rid of the fact that a remote controller can use text for control can be met.

Wherein the text can be read and semantically parsed using OCR and bi-directional L STM techniques.

The OCR (Optical Character Recognition) technology refers to a process in which an electronic device (e.g., a scanner or a digital camera) checks a Character printed on paper, determines its shape by detecting dark and light patterns, and then translates the shape into a computer text by a Character Recognition method; namely, the process of scanning the text data, then analyzing and processing the image file and obtaining the character and layout information.

In the problem of the input sequence being available at all time steps, the bidirectional L STM trains two, rather than one L STM, on the input sequence the first of the input sequence is the original and the second is the inverted copy of the input sequence.

Further, the scheme of the invention can also identify the text through multi-scale and synthesize the voice based on the identification result, such as synthesizing the voice of different age groups.

Alternatively, different font sizes can be recognized to control electrical equipment (such as an air conditioner), and the voice effect of voice electrical equipment (such as the air conditioner) can be brought to a special group (such as a group which can not hear the voice) through the multi-scale OCR technology.

Optionally, the electrical equipment (such as an air conditioner) can be used for recognizing characters to synthesize voices at different ages to recite the text to correct the pronunciation of the child, and articles of the child text can be recognized to recite the text, so that the pronunciation capability of the child is improved. Wherein, text is recognized, and the electric voice equipment (such as an air conditioner) can recognize the text, synthesize voice through TTS and correct the pronunciation of children.

In an alternative embodiment, reference may be made to the examples shown in fig. 5 and 6 to illustrate specific implementation procedures of the scheme of the present invention.

Fig. 5 is a schematic diagram of multi-scale transformation of characteristic regions of an electrical device (such as an air conditioner) according to an embodiment of the present invention.

Fig. 5 may represent a multi-scale transformation diagram, and the feature regions may be obtained by adjusting the block diagram according to different distances from the text to the electrical device (e.g., an air conditioner).

Fig. 6 is a schematic flow chart of an electrical device (e.g., an air conditioner) controlled based on the multi-scale OCR technology according to an embodiment of the present invention.

Fig. 6 may show a flowchart for controlling an electrical device (e.g., an air conditioner) based on a multi-scale OCR technology, wherein the electrical device (e.g., the air conditioner) is controlled by recognizing characters in an image through a camera, and the function is provided for a special crowd; the voice broadcasting can be synthesized by a text recognizing the image.

Specifically, referring to the examples shown in fig. 5 and fig. 6, the process of controlling an electrical device (such as an air conditioner) based on the multi-scale OCR technology may include:

step 1, reading an indoor room image in real time through a camera, and acquiring a picture with text characters.

And 2, identifying the size of the text in the picture with the text characters through multi-scale adjustment.

Specifically, when a camera in an electrical device (such as an air conditioner) identifies an indoor image such as a picture with text characters, an image module in the electrical device (such as the air conditioner) can frame texts in images at different distances and image text font sizes through a multi-scale algorithm to extract feature information; then, carrying out angle correction, denoising, defogging and image enhancement processes through a series of image preprocessing of the images; then, dividing the characters in the identified characteristic region in the block diagram, and cutting each line of the identified characters; finally, performing line-row segmentation on each line of text cut off, and cutting out each character, namely cutting out the character corresponding to each column in each line of text; each cut text is then parsed to obtain recognized text information, which is also a general flow of OCR.

In this way, bidirectional L STM semantic parsing is performed through the recognized text, and the text semantic parsing is performed to control electrical equipment (such as an air conditioner) or obtain resource information related to the cloud, or synthesize the text or generate voice based on text content.

And 3, generating a text through OCR recognition, analyzing the text through a bidirectional L STM, and executing the steps 4, 5 and the like.

And 4, generating a text sending related command based on the analyzed text so as to control the electrical equipment (such as an air conditioner).

And 5, generating a text based on the analyzed text, and synthesizing voices of different gender and age groups, wherein the children textbook articles can be read aloud if a voice conversation education function is synthesized.

Specifically, when a special user needs to chat with an electrical device (such as an air conditioner), a real-time conversation between text and voice can be carried out, and the text in a children lesson can also be recited. The camera recognizes the text handwritten by the user to control the electrical equipment (such as an air conditioner) to meet the requirements of different users on the electrical equipment (such as the air conditioner), and the electrical equipment (such as the air conditioner) with the OCR technology can be applied to child education to correct the pronunciation of the child.

For example: the lesson and related articles can be recognized by a voice electric device (such as an air conditioner) to synthesize voice and recite the lesson to guide the child to read after and correct the child's mispronunciation.

Since the processes and functions implemented by the electrical equipment (such as an air conditioner) of the present embodiment substantially correspond to the embodiments, principles and examples of the apparatus shown in fig. 4, reference may be made to the related descriptions in the foregoing embodiments without being detailed in the description of the present embodiment.

Through a large number of tests, the technical scheme of the invention can identify characters to synthesize voices at different ages to recite text for correcting pronunciation of children by identifying text control information in the environment of electrical equipment (such as an air conditioner) or the environment of a control terminal of the electrical equipment by utilizing a multi-scale technology, thereby facilitating the learning of children.

According to an embodiment of the present invention, there is also provided a storage medium corresponding to a control method of an electric appliance (e.g., an air conditioner). The storage medium may include: the storage medium has stored therein a plurality of instructions; the instructions are used for loading and executing the control method of the electrical equipment (such as an air conditioner) by the processor.

Since the processing and functions implemented by the storage medium of this embodiment substantially correspond to the embodiments, principles, and examples of the methods shown in fig. 1 to fig. 3, details are not described in the description of this embodiment, and reference may be made to the related descriptions in the foregoing embodiments, which are not described herein again.

Through a large number of tests and verifications, by adopting the technical scheme of the invention, text control information in the environment to which electrical equipment (such as an air conditioner) belongs or the environment to which a control terminal of the electrical equipment belongs is identified by utilizing a multi-scale technology, articles of child lessons can be identified to recite the lessons, and thus the pronunciation capability of children is improved.

According to an embodiment of the present invention, there is also provided an electric appliance (e.g., an air conditioner) corresponding to a control method of the electric appliance (e.g., the air conditioner). The electrical equipment (such as an air conditioner) may include: a processor for executing a plurality of instructions; a memory to store a plurality of instructions; wherein, the instructions are stored in the memory, and loaded by the processor and executed by the processor, the control method of the electrical equipment (such as an air conditioner) is described above.

Since the processes and functions implemented by the electrical equipment (such as an air conditioner) of the present embodiment substantially correspond to the embodiments, principles and examples of the methods shown in fig. 1 to 3, reference may be made to the related descriptions in the foregoing embodiments without being detailed in the description of the present embodiment.

After a large number of tests and verifications, by adopting the technical scheme of the invention, the multi-scale technology is utilized to identify the text control information in the environment to which the electrical equipment (such as an air conditioner) belongs or the environment to which the control terminal of the electrical equipment belongs, and when a special user needs to chat with the electrical equipment (such as the air conditioner), real-time conversation between text and voice can be carried out, so that the invention has better humanization.

In summary, it is readily understood by those skilled in the art that the advantageous modes described above can be freely combined and superimposed without conflict.

The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims

1. A method of controlling an electrical device, comprising:

acquiring a text image in an environment to which the electrical equipment belongs or an environment to which a control end of the electrical equipment belongs;

recognizing text information in a text image in an environment to which the electrical equipment belongs or an environment to which a control terminal of the electrical equipment belongs;

and controlling the electrical equipment according to the text information so as to realize the control of the electrical equipment through the text information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs.

2. The method for controlling the electrical equipment according to claim 1, wherein the obtaining of the text image in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs includes:

under the condition that the text control function of the electrical equipment is started, identifying whether a text exists in an environment to which the electrical equipment belongs or a set control area in an environment to which a control end of the electrical equipment belongs through an image acquisition module;

if the text exists in the set control area in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs, acquiring a text image of the text in the set control area in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs; wherein, set up the control area, include: the area that the image acquisition module can gather in the environment that electrical equipment belongs to or the environment that the control end of electrical equipment belongs to.

3. The method for controlling an electric appliance according to claim 1 or 2, wherein recognizing text information in the text image in an environment to which the electric appliance belongs or an environment to which a control terminal of the electric appliance belongs includes:

recognizing a text picture in the text image through a multi-scale OCR recognition technology, and extracting characteristic information in the text picture;

after preprocessing the characteristic information in the text picture, cutting the character picture obtained by preprocessing to obtain characters in the character picture;

and analyzing the characters in the character pictures obtained by cutting to obtain the meanings of the characters in the character pictures, and using the meanings as the text information in the text images in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs.

4. The control method of the electrical equipment according to claim 3, wherein the preprocessing of the feature information in the text picture comprises:

and performing at least one of angle correction, denoising, defogging and image enhancement on the characteristic information in the text picture.

5. The method of controlling an electric appliance according to claim 1 or 2, wherein controlling the electric appliance according to text information includes:

generating a control instruction according to the text information so as to control the electrical equipment according to the control instruction;

and/or the presence of a gas in the gas,

synthesizing voice control information according to the text information, broadcasting the voice control information, and controlling the electrical equipment according to the voice control information;

and/or the presence of a gas in the gas,

and synthesizing voice reading information matched with the age information of the user in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs according to the text information, and broadcasting the voice reading information so as to broadcast the text information in the text image to the user according to the voice reading information.

6. A control device of an electric appliance, characterized by comprising:

the device comprises an acquisition unit, a processing unit and a display unit, wherein the acquisition unit is used for acquiring a text image in an environment to which the electrical equipment belongs or an environment to which a control end of the electrical equipment belongs;

the identification unit is used for identifying text information in the text image in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs;

and the control unit is used for controlling the electrical equipment according to the text information so as to realize the control of the electrical equipment through the text information in the environment to which the electrical equipment belongs or the environment to which the control end of the electrical equipment belongs.

7. The control device of the electrical equipment according to claim 6, wherein the acquiring unit acquires the text image in the environment to which the electrical equipment belongs or the environment to which the control terminal of the electrical equipment belongs, and includes:

8. The control device of the electrical equipment according to claim 6 or 7, wherein the recognizing unit recognizes text information in the text image in an environment to which the electrical equipment belongs or an environment to which a control terminal of the electrical equipment belongs, and includes:

9. The control device of the electrical equipment according to claim 8, wherein the identification unit preprocesses the feature information in the text picture, and the preprocessing includes:

10. The control device of electric appliance according to claim 6 or 7, wherein the control unit controls the electric appliance according to the text information, comprising:

and/or the presence of a gas in the gas,

11. An electrical device, comprising: a control device of the electric appliance according to any one of claims 6 to 10;

alternatively, it comprises:

a processor to execute one or more instructions;

a memory to store one or more instructions;

wherein the plurality of instructions are stored by the memory and loaded and executed by the processor to perform the control method of the electrical appliance according to any one of claims 1 to 5.

12. A storage medium having a plurality of instructions stored therein; the plurality of instructions for loading and executing by a processor the control method of an electrical appliance according to any one of claims 1 to 5.