CN110686353A - Image control method and device, storage medium and air conditioner - Google Patents

Image control method and device, storage medium and air conditioner Download PDF

Info

Publication number
CN110686353A
CN110686353A CN201910917877.XA CN201910917877A CN110686353A CN 110686353 A CN110686353 A CN 110686353A CN 201910917877 A CN201910917877 A CN 201910917877A CN 110686353 A CN110686353 A CN 110686353A
Authority
CN
China
Prior art keywords
acquisition device
image acquisition
electric appliance
image
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910917877.XA
Other languages
Chinese (zh)
Inventor
汪进
文皓
郑文成
韩雪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN201910917877.XA priority Critical patent/CN110686353A/en
Publication of CN110686353A publication Critical patent/CN110686353A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/30Control or safety arrangements for purposes related to the operation of the system, e.g. for safety or monitoring
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/50Control or safety arrangements characterised by user interfaces or communication
    • F24F11/52Indication arrangements, e.g. displays
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/50Control or safety arrangements characterised by user interfaces or communication
    • F24F11/56Remote control
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/50Control or safety arrangements characterised by user interfaces or communication
    • F24F11/56Remote control
    • F24F11/58Remote control using Internet communication
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/62Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
    • F24F11/63Electronic processing
    • F24F11/64Electronic processing using pre-stored data
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F2120/00Control inputs relating to users or occupants
    • F24F2120/10Occupancy
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F2221/00Details or features not otherwise provided for
    • F24F2221/18Details or features not otherwise provided for combined with domestic apparatus

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses an image control method, an image control device, a storage medium and an air conditioner, wherein the method comprises the following steps: acquiring a control instruction for controlling the image acquisition device; the image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the control instruction comprises: an open command or a close command; according to the opening instruction, under the condition that the image acquisition device is not opened and/or the image acquisition device is not positioned outside the electric appliance body, controlling the image acquisition device to move out of the electric appliance body and controlling the image acquisition device to be opened; or according to the closing instruction, under the condition that the image acquisition device is not closed and/or the image acquisition device is not positioned in the electric appliance body, controlling the image acquisition device to be closed and controlling the image acquisition device to move back to the inside of the electric appliance body. According to the scheme, the problem that the camera is inconvenient to use due to the fact that the privacy of a family is possibly exposed can be solved, and the effect of improving use convenience is achieved.

Description

Image control method and device, storage medium and air conditioner
Technical Field
The invention belongs to the technical field of household appliances, particularly relates to an image control method and device, a storage medium and an air conditioner, and particularly relates to a control method and device for a household air conditioner with a telescopic camera capturing human body posture, a storage medium and an air conditioner.
Background
The existing household air conditioner avoids mounting the camera, and mainly when the camera is not used, the camera is exposed outside to enable a user to have certain psychological effect, such as possibly exposing family privacy.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention aims to provide an image control method, an image control device, a storage medium and an air conditioner, aiming at overcoming the defects that a camera is inconvenient to use due to the fact that the privacy of a family is possibly exposed, and achieving the effect of improving the convenience of use.
The invention provides an image control method, which comprises the following steps: acquiring a control instruction for controlling the image acquisition device; the image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the control instruction comprises: an open command or a close command; according to the opening instruction, under the condition that the image acquisition device is not opened and/or the image acquisition device is not positioned outside the electric appliance body, controlling the image acquisition device to move out of the electric appliance body and controlling the image acquisition device to be opened; or according to the closing instruction, under the condition that the image acquisition device is not closed and/or the image acquisition device is not positioned in the electric appliance body, controlling the image acquisition device to be closed and controlling the image acquisition device to move back to the inside of the electric appliance body.
Optionally, acquiring a control instruction for controlling the image capturing apparatus includes: acquiring a control instruction sent by a client APP, an electric appliance remote controller and/or a preset key module; the client APP is in pairing relation with the image acquisition device or with an electrical appliance to which the image acquisition device belongs in advance; the pairing relationship is established when confirmation information transmitted from the administrator control terminal is received.
Optionally, an accommodating space for accommodating the image acquisition device is arranged inside the electric appliance body; an elastic piece or a telescopic piece is arranged between the accommodating space and the image acquisition device; wherein, control the image acquisition device and shift out to the outside of electrical apparatus fuselage, include: through the elastic piece or the telescopic piece, under the condition that the image acquisition device is arranged in the accommodating space inside the electric appliance body, the image acquisition device is popped out or stretched out of the accommodating space so as to control the image acquisition device to move out of the electric appliance body; under the condition that the image acquisition device is moved out of the motor body, the image acquisition range of the image acquisition device can be adjusted to a preset maximum acquisition range in an indoor space to which the electric appliance belongs; and/or, controlling the image acquisition device to move back to the inside of the electric appliance body, comprising: through the elastic piece or the telescopic piece, under the condition that the image acquisition device is positioned outside the electric appliance body, the image acquisition device is retracted or retracted into the accommodating space inside the electric appliance body so as to control the image acquisition device to move back to the inside of the electric appliance body.
Optionally, the method further comprises: under the conditions that the image acquisition device is controlled to move out of the body of the electric appliance and is controlled to be started, and under the condition that an object to be monitored is in an indoor space to which the electric appliance belongs, first image information of the object to be monitored is obtained; determining the current human body posture displayed by the first image information by utilizing a human body posture neural network model obtained by pre-training according to the first image information; if the current human body posture belongs to the preset dangerous posture range, a first monitoring reminding message of the dangerous posture of the object to be monitored is initiated, and/or a second monitoring reminding message of the dangerous posture of the object to be monitored is sent to the monitor client.
Optionally, the method further comprises: before the current human body posture displayed by the first image information is determined, comparing the first image information with a preset privacy information range; and if the information characteristics in the preset privacy information range appear in the first image information, performing fuzzy processing on the information characteristics in the first image information.
Optionally, the method further comprises: under the condition that the image acquisition device is controlled to move out of the body of the electric appliance and is controlled to be started, and under the condition that no person exists in the indoor space to which the electric appliance belongs, second image information of the indoor space is acquired; if new image features appear in the second image information along with the advance of time and the image features do not belong to a preset legal feature range, initiating a first security reminding message of an unfamiliar actor in the indoor space and/or sending a second security reminding message of the unfamiliar actor in the indoor space to a manager client.
In accordance with the above method, another aspect of the present invention provides an image control apparatus, comprising: the acquisition unit is used for acquiring a control instruction for controlling the image acquisition device; the image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the control instruction comprises: an open command or a close command; the control unit is used for controlling the image acquisition device to move out of the electric appliance body and controlling the image acquisition device to be started under the condition that the image acquisition device is not started and/or the image acquisition device is not positioned outside the electric appliance body according to the starting instruction; or, the control unit is further configured to control the image capturing device to be turned off and to control the image capturing device to move back to the inside of the electric appliance body according to the turn-off instruction when the image capturing device is not turned off and/or the image capturing device is not located inside the electric appliance body.
Optionally, the acquiring unit acquires a control instruction for controlling the image capturing device, and includes: acquiring a control instruction sent by a client APP, an electric appliance remote controller and/or a preset key module; the client APP is in pairing relation with the image acquisition device or with an electrical appliance to which the image acquisition device belongs in advance; the pairing relationship is established when confirmation information transmitted from the administrator control terminal is received.
Optionally, an accommodating space for accommodating the image acquisition device is arranged inside the electric appliance body; an elastic piece or a telescopic piece is arranged between the accommodating space and the image acquisition device; wherein, the control unit controls the image acquisition device to move out to the outside of electrical apparatus fuselage, includes: through the elastic piece or the telescopic piece, under the condition that the image acquisition device is arranged in the accommodating space inside the electric appliance body, the image acquisition device is popped out or stretched out of the accommodating space so as to control the image acquisition device to move out of the electric appliance body; under the condition that the image acquisition device is moved out of the motor body, the image acquisition range of the image acquisition device can be adjusted to a preset maximum acquisition range in an indoor space to which the electric appliance belongs; and/or the control unit controls the image acquisition device to move back to the inside of the electric appliance body, and the control unit comprises: through the elastic piece or the telescopic piece, under the condition that the image acquisition device is positioned outside the electric appliance body, the image acquisition device is retracted or retracted into the accommodating space inside the electric appliance body so as to control the image acquisition device to move back to the inside of the electric appliance body.
Optionally, the method further comprises: the acquiring unit is also used for acquiring first image information of the object to be monitored under the conditions that the image acquisition device is moved out of the body of the electric appliance and is started and the object to be monitored is in the indoor space to which the electric appliance belongs; the control unit is further configured to determine, according to the first image information, a current human body posture shown by the first image information by using a human body posture neural network model obtained through pre-training; the control unit is further configured to initiate a first monitoring reminding message when the object to be monitored is in the dangerous posture and/or send a second monitoring reminding message when the object to be monitored is in the dangerous posture to the monitor client if the current human posture belongs to the preset dangerous posture range.
Optionally, the method further comprises: the control unit is further used for comparing the first image information with a preset privacy information range before determining the current human body posture displayed by the first image information; and if the information characteristics in the preset privacy information range appear in the first image information, performing fuzzy processing on the information characteristics in the first image information.
Optionally, the method further comprises: the acquisition unit is also used for acquiring second image information of the indoor space under the condition that the image acquisition device is moved out of the body of the electric appliance and is started and no person exists in the indoor space to which the electric appliance belongs; the control unit is further configured to initiate a first security reminding message of an unfamiliar actor in the indoor space and/or send a second security reminding message of the unfamiliar actor in the indoor space to the administrator client if a new image feature appears in the second image information along with the advance of time and the image feature does not belong to a preset legal feature range.
In accordance with another aspect of the present invention, there is provided an air conditioner including: the image control apparatus described above.
In accordance with the above method, a further aspect of the present invention provides a storage medium comprising: the storage medium has stored therein a plurality of instructions; the instructions are used for loading and executing the image control method by the processor.
In accordance with the above method, another aspect of the present invention provides an air conditioner, comprising: a processor for executing a plurality of instructions; a memory to store a plurality of instructions; wherein the instructions are stored by the memory, and loaded and executed by the processor.
According to the scheme, the retractable camera is adopted to hide and close the camera, so that the camera can be retracted into the air conditioner when people do not use the air conditioner or close the camera, the camera can be hidden when a user does not need to use the camera, privacy of the user is protected, psychological worry is avoided, and use convenience of the user is improved.
Furthermore, according to the scheme of the invention, the retractable camera is adopted to hide and close the camera, so that the camera can be used for capturing the human body posture to remind a person at home of safety problems such as whether a child or an old man falls down or not under the condition that the camera is opened, the auxiliary monitoring of the safety problems of the person at home needing to be protected is improved, and the user experience is good.
Further, according to the scheme of the invention, the camera in the air conditioner is controlled to move up and down or left and right, so that the camera can stretch out of the air conditioner body; the camera button can also be manually pressed to pop out the camera from the air conditioner body, or the camera is closed and is contracted to return the camera to the air conditioner body, so that the camera can stretch out and draw back in the air conditioner body, convenience is brought to a user, and reliability and safety are realized.
Furthermore, according to the scheme of the invention, the camera in the air conditioner is controlled to move up and down or left and right in a remote APP real-name pairing control mode or a remote controller control mode, and the telescopic mode is simple, convenient and reliable.
Furthermore, according to the scheme of the invention, the retractable camera is adopted to hide and close the camera, the camera can capture the posture of the human body in real time through the neural network, children or old people with inconvenient actions can be found in real time that the old people cannot stand up when falling down, and the family can be reminded through the APP, so that the intelligent household appliance is convenient to use and is humanized.
Therefore, according to the scheme, the telescopic camera device is adopted, the camera device is retracted into the air conditioner body when image information in a room is not required to be collected, the camera device is extended out of the air conditioner body when the image information in the room is required to be collected, the posture of a human body is monitored by the camera device under the condition that people exist in the room, security and protection monitoring is carried out under the condition that no people exist in the room, the problem that the camera is inconvenient to use due to the fact that the privacy of a family is possibly exposed is solved, and the effect of improving use convenience is achieved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
FIG. 1 is a flowchart illustrating an image control method according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating an embodiment of monitoring control based on first image information acquired by an image acquisition device according to the method of the present invention;
FIG. 3 is a schematic flow chart illustrating an embodiment of security control based on image information acquired by an image acquisition device in the method of the present invention;
FIG. 4 is a schematic structural diagram of an image control apparatus according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart of a household air conditioner for capturing human body gestures by a retractable camera according to an embodiment of the air conditioner of the present invention;
fig. 6 is a schematic structural diagram of a human body posture neural network according to an embodiment of the air conditioner of the present invention.
The reference numbers in the embodiments of the present invention are as follows, in combination with the accompanying drawings:
102-an obtaining unit; 104-control unit.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
According to an embodiment of the present invention, an image control method is provided, as shown in fig. 1, which is a schematic flow chart of an embodiment of the method of the present invention. The image control method is applied to electric appliances such as household appliances, wherein an accommodating space is arranged in a machine body of the electric appliance, and an image acquisition device can be accommodated in the accommodating space. The image acquisition device has the telescopic performance, can stretch out to the outside of electrical apparatus fuselage, also can retract in the accommodation space of electrical apparatus fuselage inside. The image control method may include: step S110 to step S130.
At step S110, a control instruction that can be used to control the image capturing device is obtained, that is, a control instruction that can be used to control the image capturing device and is sent by a user is obtained in an environment to which an electrical appliance to which the image capturing device belongs. The image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the elastic-retractable type is that the image acquisition device can be ejected out of the electric appliance body from the inside of the electric appliance body and retracted into the inside of the electric appliance body from the outside of the electric appliance body; the telescopic type is that the image acquisition device can extend out of the electric appliance body from the inside of the electric appliance body and retract into the inside of the electric appliance body from the outside of the electric appliance body. The control instruction may include: an open command or a close command. Specifically, the image acquisition apparatus may include: a camera is provided.
Optionally, the obtaining of the control instruction for controlling the image capturing apparatus in step S110 may include: and acquiring a control instruction sent by the client APP, the electric appliance remote controller and/or a preset key module.
The client APP is in pairing relation with the image acquisition device or with an electric appliance to which the image acquisition device belongs in advance. The pairing relationship is established when confirmation information transmitted from the administrator control terminal is received.
For example: the APP of other family members can be bound with the household air conditioner only by the consent of the householder; then the camera in the APP control air conditioner fuselage of through the cell-phone emits and opens the camera, perhaps utilizes the remote controller to open the camera and emits from the fuselage, optionally can open the camera and carry out work in combination with the button.
In addition, optionally, the electrical appliance remote controller may be a remote controller that can be used to control the electrical appliance to operate, and the electrical appliance remote controller may be used to control the image capturing device to extend out of or retract into the electrical appliance body by sending a control instruction to the image capturing device or the electrical appliance to which the image capturing device belongs, in addition to controlling the electrical appliance to operate. The key module can be arranged on an electric appliance to which the image acquisition device belongs and can be used for sending a control instruction to the image acquisition device and/or the electric appliance to which the image acquisition device belongs in a single key mode or a combined key mode.
For example: the camera in the air conditioner can be controlled to move up and down or left and right through a remote APP real-name pairing control mode or a remote controller control mode, so that the camera can stretch out of the air conditioner body; the camera button can also be manually pressed to pop the camera out of the air conditioner body, or the camera can be turned off and retracted back into the air conditioner body.
For example: the camera can be ejected by a manual button. For example: the camera button can be manually pressed to pop the camera out of the air conditioner body or close the camera and retract the camera back to the air conditioner body.
Therefore, the control instruction is sent in various forms, so that the system is convenient for users with different use habits to use, and is flexible and convenient.
In step S120, according to the start instruction, under the condition that the image capturing device is not started and/or the image capturing device is not located outside the electrical appliance body, the image capturing device is controlled to move out of the electrical appliance body and to be started. In addition, when the image acquisition device is moved out of the electric appliance body but is not started, the image acquisition device is controlled to be continuously positioned outside the electric appliance body and is controlled to be started. And under the condition that the image acquisition device is started but is not moved out of the electric appliance body, controlling the image acquisition device to be kept in a started state and controlling the image acquisition device to be moved out of the electric appliance body. And under the condition that the image acquisition device is started and moved out of the electric appliance body, controlling the image acquisition device to be kept in a started state and controlling the image acquisition device to be continuously positioned outside the electric appliance body.
For example: can match the mode of control through long-range APP real name, or the mode through remote controller control, control the camera in the air conditioner and carry out up-and-down or side-to-side movement to stretch out and draw back from the air conditioner fuselage. Such as: the camera can be changed from horizontal to ninety-degree pop-up from the body.
Or, in step S130, controlling the image capturing device to be turned off and to be moved back to the inside of the electric appliance body according to the turn-off instruction in the case that the image capturing device is not turned off and/or the image capturing device is not located inside the electric appliance body. In addition, under the condition that the image acquisition device is closed but not positioned in the electric appliance body, the image acquisition device is controlled to keep a closed state and is controlled to move back to the inside of the electric appliance body. And under the condition that the image acquisition device is not turned off but is moved back to the electric appliance body, controlling the image acquisition device to be continuously positioned inside the electric appliance body and turning off the image acquisition device. And under the condition that the image acquisition device is closed and moved back to the electric appliance body, controlling the image acquisition device to keep a closed state and controlling the image acquisition device to be continuously positioned in the electric appliance body.
From this, through adopting the image acquisition device that has elasticity and receive performance or flexible performance, shift out the outside to the electrical apparatus fuselage under the instruction of opening, move back to the inside of electrical apparatus fuselage under the instruction of closing, can hide the inside at the electrical apparatus fuselage when the user does not use like this, avoid the user to have image acquisition device to shoot worry and expose privacy and have psychological pressure because of feeling, also protected image acquisition device itself in order to avoid exposing at the outside ash that falls of electrical apparatus fuselage, receive the collision and damage, make user's use more convenient also more reassurance.
Optionally, an accommodating space for accommodating the image capturing device is provided inside the electrical appliance body. An elastic piece or a telescopic piece is arranged between the accommodating space and the image acquisition device. The elastic piece or the telescopic piece can pop up or stretch out the image acquisition device from the accommodating space under the condition that the image acquisition device is arranged in the accommodating space inside the electric appliance body. The elastic piece or the telescopic piece can also retract or retract the image acquisition device into the accommodating space inside the electric appliance body under the condition that the image acquisition device is positioned outside the electric appliance body. The elastic member or the telescopic member can also be controlled by a control module of the electric appliance. And the control module of the electric appliance can receive the control command and control the elastic member or the telescopic member to act based on the control command. The on or off switch of the image acquisition device can also be controlled by a control module of the electric appliance. And the control module of the electric appliance can receive the control instruction and control the switch piece based on the control instruction to realize the on-off of the image acquisition device.
For example: the elastic element can be a spring or a spring sheet. The telescopic member may be a telescopically arranged sleeve.
Then, based on the elastic member or the telescopic member, the movement control of the image capturing device may include any one or several of the following situations.
The first case: the step S120 of controlling the image capturing device to move out of the electrical appliance body may include: through elastic component or extensible member, place the inside accommodation space's of electrical apparatus fuselage in image acquisition device under the condition, pop out or stretch out image acquisition device from this accommodation space to control image acquisition device and shift out to the outside of electrical apparatus fuselage.
Wherein, under the condition that image acquisition device shifts out to the outside of motor fuselage, image acquisition device's image acquisition scope can be adjusted to the biggest collection scope of presetting in the indoor space that electrical apparatus belongs to. Specifically, the adjustment may be automatic adjustment or passive adjustment in the case where an adjustment instruction is received.
For example: the camera can rotate left and right or rotate in a pitching mode when emerging from the body, the pitch angle and the yaw angle of the camera are obtained in real time, the view field of the camera is enlarged, and the camera can rotate left and right or rotate in a pitching mode to enable a room to have no dead angle. The camera can pop up from top to bottom or from left to right, and when the camera is not used, the air conditioner body is retracted by the camera, so that the user does not need to expose a series of troubles for using the related privacy of the air conditioner with the camera.
For example: under the condition that the camera is arranged outside the air conditioner body, the camera can be controlled to rotate left and right and/or up and down to obtain a larger collection view field. Under the condition that the camera can rotate or in the process of rotating the camera, the pitch angle and the yaw angle of the camera can be obtained in real time, and the camera can acquire room conditions without dead angles as much as possible by adjusting the pitch angle and the yaw angle of the camera.
The second case: the step S130 of controlling the image capturing device to move back to the inside of the main body of the electrical appliance may include: through the elastic piece or the telescopic piece, under the condition that the image acquisition device is positioned outside the electric appliance body, the image acquisition device is retracted or retracted into the accommodating space inside the electric appliance body so as to control the image acquisition device to move back to the inside of the electric appliance body.
Therefore, the image acquisition device can be moved more conveniently and flexibly by adopting the elastic piece or the telescopic piece.
In an alternative embodiment, the method may further include: after the image acquisition device is controlled to move out of the electric appliance body and is controlled to be started, the monitoring control process is carried out based on the first image information acquired by the image acquisition device.
With reference to the flowchart of fig. 2, a specific process of monitoring and controlling based on the first image information acquired by the image acquisition device is further described, which includes: step S210 to step S230.
Step S210, under the condition that the image acquisition device is moved out of the body of the electric appliance and is turned on, and under the condition that the object to be monitored is in the indoor space to which the electric appliance belongs, first image information of the object to be monitored is obtained.
Step S220, according to the first image information, a human body posture neural network model obtained through pre-training is utilized to determine the current human body posture displayed by the first image information. For example: a human posture neural network model as shown in figure 6.
Step S230, if the current body posture belongs to the preset dangerous posture range, initiating a first monitoring reminding message indicating that the object to be monitored is in a dangerous posture, and/or sending a second monitoring reminding message indicating that the object to be monitored is in a dangerous posture to the monitor client.
For example: the household air conditioner has the advantages that the computer vision can bring great convenience to the life of people, the problem that the camera can expose the family privacy is solved, the household air conditioner with the retractable camera for capturing the human body gesture is provided, the household air conditioner can adopt the retractable camera to hide and close the camera, the camera can be retracted into the air conditioner when people do not use the air conditioner or close the camera, and the camera can be used for capturing the human body gesture to remind people at home of having safety problems such as children or whether old people fall down under the condition that the camera is opened. Such as: utilize the camera can catch human gesture in real time through neural network, can discover in real time that children or the inconvenient old man of action fall down and can not stand and remind the family personnel through APP.
For example: under the condition that the camera needs to be used, the camera stretches out and draws back from the air conditioner body or the camera is popped out from the air conditioner body, and then the real-time human body posture can be captured by the camera. Therefore, people can use computer vision to bring convenience to users, and the use experience, comfort and safety of the users are improved.
For example: under the condition of determining the pitch angle and the yaw angle of the camera, on one hand, the human body posture in a room can be captured in real time by utilizing a camera neural network; and then according to this human gesture, can remind other people or guardians in the family when the condition that child or old man fell down takes place in the family, for example: reminding other people or guardians in the home through the network. On the other hand, the camera can be used for monitoring the security condition in the house in real time, so that a prompt or an alarm is initiated when the situation of dangerous security in the house is found. For example: the method comprises the steps that a human posture neural network model is used for obtaining that a child or an old person in a real-time family falls on the ground and cannot stand, at the moment, an air conditioner informs family members through a network, or when factors such as cerebral hemorrhage attacks of the old person and the like occur, a camera can judge corresponding results through human postures and expressions and give relevant conditions to a user through the network, and the problem of patients in the family is solved at the first time; when the home does not have a network, the air conditioner can alarm to sound to remind the home user and the next door neighbor.
Therefore, after the image acquisition device is started, the monitoring control is carried out based on the first image information acquired by the image acquisition device, the object to be monitored in the indoor space can be monitored, so that the monitoring reminding is timely initiated when a dangerous condition occurs, the object to be monitored can be better and timely protected, and the monitoring device is more humanized.
In a further optional embodiment, may further include: and before the current human body posture displayed by the first image information is determined, carrying out privacy protection processing on the object to be monitored.
Specifically, the first image information may be compared with a preset privacy information range before determining the current human body posture exhibited by the first image information. If the information characteristics in the preset privacy information range appear in the first image information, after the information characteristics in the first image information are subjected to fuzzy processing, the current human body posture shown by the first image information is determined. For example: if the first image information of the object to be monitored contains privacy information such as changing clothes, fuzzy processing such as code printing or doodling is carried out on the information characteristics of the privacy information such as changing clothes in the first image information.
Therefore, privacy of the user can be protected by processing privacy protection on the object to be monitored, psychological stress of the user is lower, and humanization is better.
In an alternative embodiment, the method may further include: and after the image acquisition device is controlled to move out of the electric appliance body and is controlled to be started, the security control process is carried out based on the image information acquired by the image acquisition device.
In the following, with reference to a schematic flow chart of an embodiment of performing security control based on image information acquired by an image acquisition device in the method of the present invention shown in fig. 3, a specific process of performing security control based on image information acquired by an image acquisition device is further described, which may include: step S310 and step S320.
And step S310, under the condition that the image acquisition device is moved out of the body of the electric appliance and is turned on, and under the condition that no person exists in the indoor space to which the electric appliance belongs, acquiring second image information of the indoor space.
Step S320, if a new image feature appears in the second image information along with the time advance and the image feature does not belong to the preset legal feature range, initiating a first security and protection reminding message of an unfamiliar actor appearing in the indoor space, and/or sending a second security and protection reminding message of an unfamiliar actor appearing in the indoor space to the administrator client. The legal feature range may include: a feature range formed by image features of an active person who is allowed to freely enter and exit the indoor space.
For example: the camera can play the security protection effect, can the nobody condition in real time monitoring family.
From this, through carrying out security protection control based on the image information that image acquisition device gathered, can promote reliability and security to indoor control, user experience is better.
Through a large amount of experimental verifications, adopt the technical scheme of this embodiment, hide through adopting the elasticity camera and close the camera, like this when people do not use the air conditioner or close the camera inside the camera just can contract the air conditioner, can hide the camera when the user need not use the camera, not only protected user's privacy, still removed psychological worry from, promoted the convenience that the user used.
According to an embodiment of the present invention, there is also provided an image control apparatus corresponding to the image control method. Referring to fig. 4, a schematic diagram of an embodiment of the apparatus of the present invention is shown. The image control device can be applied to electric appliances such as household appliances, an accommodating space is arranged in a machine body of the electric appliances, and the image acquisition device can be accommodated in the accommodating space. The image acquisition device has the telescopic performance, can stretch out to the outside of electrical apparatus fuselage, also can retract in the accommodation space of electrical apparatus fuselage inside. The image control apparatus may include: an acquisition unit 102 and a control unit 104.
In an optional example, the obtaining unit 102 may be configured to obtain a control instruction that may be used to control the image capturing apparatus, that is, in an environment to which the image capturing apparatus belongs, a control instruction that is sent by a user and may be used to control the image capturing apparatus is obtained. The image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the elastic-retractable type is that the image acquisition device can be ejected out of the electric appliance body from the inside of the electric appliance body and retracted into the inside of the electric appliance body from the outside of the electric appliance body; the telescopic type is that the image acquisition device can extend out of the electric appliance body from the inside of the electric appliance body and retract into the inside of the electric appliance body from the outside of the electric appliance body. The control instruction may include: an open command or a close command. Specifically, the image acquisition apparatus may include: a camera is provided. The specific functions and processes of the acquiring unit 102 are referred to in step S110.
Optionally, the acquiring unit 102 acquires a control instruction that may be used to control the image capturing apparatus, and may include: the obtaining unit 102 may be further specifically configured to obtain a control instruction sent by the client APP, the appliance remote controller, and/or a preset key module.
The client APP is in pairing relation with the image acquisition device or with an electric appliance to which the image acquisition device belongs in advance. The pairing relationship is established when confirmation information transmitted from the administrator control terminal is received.
For example: the APP of other family members can be bound with the household air conditioner only by the consent of the householder; then the camera in the APP control air conditioner fuselage of through the cell-phone emits and opens the camera, perhaps utilizes the remote controller to open the camera and emits from the fuselage, optionally can open the camera and carry out work in combination with the button.
In addition, optionally, the electrical appliance remote controller may be a remote controller that can be used to control the electrical appliance to operate, and the electrical appliance remote controller may be used to control the image capturing device to extend out of or retract into the electrical appliance body by sending a control instruction to the image capturing device or the electrical appliance to which the image capturing device belongs, in addition to controlling the electrical appliance to operate. The key module can be arranged on an electric appliance to which the image acquisition device belongs and can be used for sending a control instruction to the image acquisition device and/or the electric appliance to which the image acquisition device belongs in a single key mode or a combined key mode.
For example: the camera in the air conditioner can be controlled to move up and down or left and right through a remote APP real-name pairing control mode or a remote controller control mode, so that the camera can stretch out of the air conditioner body; the camera button can also be manually pressed to pop the camera out of the air conditioner body, or the camera can be turned off and retracted back into the air conditioner body.
For example: the camera can be ejected by a manual button. For example: the camera button can be manually pressed to pop the camera out of the air conditioner body or close the camera and retract the camera back to the air conditioner body.
Therefore, the control instruction is sent in various forms, so that the system is convenient for users with different use habits to use, and is flexible and convenient.
In an optional example, the control unit 104 may be configured to control the image capturing device to move out of the electrical apparatus body and to turn on the image capturing device according to the turn-on instruction when the image capturing device is not turned on and/or the image capturing device is not located outside the electrical apparatus body. In addition, when the image acquisition device is moved out of the electric appliance body but is not started, the image acquisition device is controlled to be continuously positioned outside the electric appliance body and is controlled to be started. And under the condition that the image acquisition device is started but is not moved out of the electric appliance body, controlling the image acquisition device to be kept in a started state and controlling the image acquisition device to be moved out of the electric appliance body. And under the condition that the image acquisition device is started and moved out of the electric appliance body, controlling the image acquisition device to be kept in a started state and controlling the image acquisition device to be continuously positioned outside the electric appliance body. The specific function and processing of the control unit 104 are referred to in step S120.
For example: can match the mode of control through long-range APP real name, or the mode through remote controller control, control the camera in the air conditioner and carry out up-and-down or side-to-side movement to stretch out and draw back from the air conditioner fuselage. Such as: the camera can be changed from horizontal to ninety-degree pop-up from the body.
Or, in an optional example, the control unit 104 may be further configured to control the image capturing device to be turned off and to control the image capturing device to move back to the inside of the electric appliance body according to the turn-off instruction in a case that the image capturing device is not turned off and/or the image capturing device is not located inside the electric appliance body. In addition, under the condition that the image acquisition device is closed but not positioned in the electric appliance body, the image acquisition device is controlled to keep a closed state and is controlled to move back to the inside of the electric appliance body. And under the condition that the image acquisition device is not turned off but is moved back to the electric appliance body, controlling the image acquisition device to be continuously positioned inside the electric appliance body and turning off the image acquisition device. And under the condition that the image acquisition device is closed and moved back to the electric appliance body, controlling the image acquisition device to keep a closed state and controlling the image acquisition device to be continuously positioned in the electric appliance body. The specific function and processing of the control unit 104 are also referred to in step S130.
From this, through adopting the image acquisition device that has elasticity and receive performance or flexible performance, shift out the outside to the electrical apparatus fuselage under the instruction of opening, move back to the inside of electrical apparatus fuselage under the instruction of closing, can hide the inside at the electrical apparatus fuselage when the user does not use like this, avoid the user to have image acquisition device to shoot worry and expose privacy and have psychological pressure because of feeling, also protected image acquisition device itself in order to avoid exposing at the outside ash that falls of electrical apparatus fuselage, receive the collision and damage, make user's use more convenient also more reassurance.
Optionally, an accommodating space for accommodating the image capturing device is provided inside the electrical appliance body. An elastic piece or a telescopic piece is arranged between the accommodating space and the image acquisition device. The elastic piece or the telescopic piece can pop up or stretch out the image acquisition device from the accommodating space under the condition that the image acquisition device is arranged in the accommodating space inside the electric appliance body. The elastic piece or the telescopic piece can also retract or retract the image acquisition device into the accommodating space inside the electric appliance body under the condition that the image acquisition device is positioned outside the electric appliance body. The elastic member or the telescopic member can also be controlled by a control module of the electric appliance. And the control module of the electric appliance can receive the control command and control the elastic member or the telescopic member to act based on the control command. The on or off switch of the image acquisition device can also be controlled by a control module of the electric appliance. And the control module of the electric appliance can receive the control instruction and control the switch piece based on the control instruction to realize the on-off of the image acquisition device.
For example: the elastic element can be a spring or a spring sheet. The telescopic member may be a telescopically arranged sleeve.
Then, based on the elastic member or the telescopic member, the movement control of the image capturing device may include any one or several of the following situations.
The first case: the control unit 104 controls the image capturing device to move out of the electrical appliance body, and may include: the control unit 104 may be further configured to eject or extend the image capturing device from the accommodating space through an elastic member or a telescopic member when the image capturing device is placed in the accommodating space inside the electrical appliance body, so as to control the image capturing device to move out of the electrical appliance body.
Wherein, under the condition that image acquisition device shifts out to the outside of motor fuselage, image acquisition device's image acquisition scope can be adjusted to the biggest collection scope of presetting in the indoor space that electrical apparatus belongs to. Specifically, the adjustment may be automatic adjustment or passive adjustment in the case where an adjustment instruction is received.
For example: the camera can rotate left and right or rotate in a pitching mode when emerging from the body, the pitch angle and the yaw angle of the camera are obtained in real time, the view field of the camera is enlarged, and the camera can rotate left and right or rotate in a pitching mode to enable a room to have no dead angle. The camera can pop up from top to bottom or from left to right, and when the camera is not used, the air conditioner body is retracted by the camera, so that the user does not need to expose a series of troubles for using the related privacy of the air conditioner with the camera.
For example: under the condition that the camera is arranged outside the air conditioner body, the camera can be controlled to rotate left and right and/or up and down to obtain a larger collection view field. Under the condition that the camera can rotate or in the process of rotating the camera, the pitch angle and the yaw angle of the camera can be obtained in real time, and the camera can acquire room conditions without dead angles as much as possible by adjusting the pitch angle and the yaw angle of the camera.
The second case: the control unit 104 controls the image capturing device to move back to the inside of the main body of the electric appliance, and may include: the control unit 104 may be further configured to retract or retract the image capturing device into the accommodating space inside the electrical apparatus body through an elastic member or a telescopic member when the image capturing device is located outside the electrical apparatus body, so as to control the image capturing device to move back to the inside of the electrical apparatus body.
Therefore, the image acquisition device can be moved more conveniently and flexibly by adopting the elastic piece or the telescopic piece.
In an alternative embodiment, the method may further include: after the image acquisition device is controlled to move out of the electric appliance body and is controlled to be started, the monitoring control process is carried out based on the first image information acquired by the image acquisition device, which specifically includes the following steps:
the obtaining unit 102 may be further configured to obtain first image information of the object to be monitored in a case where the image collecting device is controlled to move out of the body of the electrical appliance and the image collecting device is controlled to be turned on and in a case where the object to be monitored is located in an indoor space to which the electrical appliance belongs. The specific functions and processes of the acquisition unit 102 are also referred to in step S210.
The control unit 104 may be further configured to determine, according to the first image information, a current human body posture shown by the first image information by using a human body posture neural network model obtained through pre-training. The specific functions and processes of the control unit 104 are also referred to in step S220. For example: a human posture neural network model as shown in figure 6.
The control unit 104 may be further configured to initiate a first monitoring reminding message indicating that the object to be monitored is in the dangerous posture and/or send a second monitoring reminding message indicating that the object to be monitored is in the dangerous posture to the monitor client if the current human posture belongs to the preset dangerous posture range. The specific function and processing of the control unit 104 are also referred to in step S230.
For example: the household air conditioner has the advantages that the computer vision can bring great convenience to the life of people, the problem that the camera can expose the family privacy is solved, the household air conditioner with the retractable camera for capturing the human body gesture is provided, the household air conditioner can adopt the retractable camera to hide and close the camera, the camera can be retracted into the air conditioner when people do not use the air conditioner or close the camera, and the camera can be used for capturing the human body gesture to remind people at home of having safety problems such as children or whether old people fall down under the condition that the camera is opened. Such as: utilize the camera can catch human gesture in real time through neural network, can discover in real time that children or the inconvenient old man of action fall down and can not stand and remind the family personnel through APP.
For example: under the condition that the camera needs to be used, the camera stretches out and draws back from the air conditioner body or the camera is popped out from the air conditioner body, and then the real-time human body posture can be captured by the camera. Therefore, people can use computer vision to bring convenience to users, and the use experience, comfort and safety of the users are improved.
For example: under the condition of determining the pitch angle and the yaw angle of the camera, on one hand, the human body posture in a room can be captured in real time by utilizing a camera neural network; and then according to this human gesture, can remind other people or guardians in the family when the condition that child or old man fell down takes place in the family, for example: reminding other people or guardians in the home through the network. On the other hand, the camera can be used for monitoring the security condition in the house in real time, so that a prompt or an alarm is initiated when the situation of dangerous security in the house is found. For example: the method comprises the steps that a human posture neural network model is used for obtaining that a child or an old person in a real-time family falls on the ground and cannot stand, at the moment, an air conditioner informs family members through a network, or when factors such as cerebral hemorrhage attacks of the old person and the like occur, a camera can judge corresponding results through human postures and expressions and give relevant conditions to a user through the network, and the problem of patients in the family is solved at the first time; when the home does not have a network, the air conditioner can alarm to sound to remind the home user and the next door neighbor.
Therefore, after the image acquisition device is started, the monitoring control is carried out based on the first image information acquired by the image acquisition device, the object to be monitored in the indoor space can be monitored, so that the monitoring reminding is timely initiated when a dangerous condition occurs, the object to be monitored can be better and timely protected, and the monitoring device is more humanized.
In a further optional embodiment, may further include: before determining the current body posture shown by the first image information, a processing procedure of privacy protection on the object to be monitored may specifically be as follows:
the control unit 104 may be further configured to compare the first image information with a preset privacy information range before determining the current human body posture shown by the first image information. If the information characteristics in the preset privacy information range appear in the first image information, after the information characteristics in the first image information are subjected to fuzzy processing, the current human body posture shown by the first image information is determined. For example: if the first image information of the object to be monitored contains privacy information such as changing clothes, fuzzy processing such as code printing or doodling is carried out on the information characteristics of the privacy information such as changing clothes in the first image information.
Therefore, privacy of the user can be protected by processing privacy protection on the object to be monitored, psychological stress of the user is lower, and humanization is better.
In an alternative embodiment, the method may further include: after controlling image acquisition device to shift out to the outside of electrical apparatus fuselage and controlling image acquisition device to open, the process of carrying out security protection control based on the image information that image acquisition device gathered specifically can be as follows:
the obtaining unit 102 may be further configured to obtain second image information of an indoor space to which the electrical appliance belongs under the condition that the image capturing device is moved out of the electrical appliance body and turned on and no person is in the indoor space. The specific functions and processing of the acquisition unit 102 are also referred to in step S310.
The control unit 104 may be further configured to initiate a first security notification message indicating that an unknown actor is present in the indoor space and/or send a second security notification message indicating that an unknown actor is present in the indoor space to the administrator client if a new image feature is present in the second image information and the image feature does not belong to a preset legal feature range with the advance of time. The legal feature range may include: a feature range formed by image features of an active person who is allowed to freely enter and exit the indoor space. The specific functions and processes of the control unit 104 are also referred to in step S320.
For example: the camera can play the security protection effect, can the nobody condition in real time monitoring family.
From this, through carrying out security protection control based on the image information that image acquisition device gathered, can promote reliability and security to indoor control, user experience is better.
Since the processes and functions implemented by the apparatus of this embodiment substantially correspond to the embodiments, principles and examples of the method shown in fig. 1 to 3, the description of this embodiment is not detailed, and reference may be made to the related descriptions in the foregoing embodiments, which are not repeated herein.
Through a large number of tests, the technical scheme of the invention is adopted, the retractable camera is adopted to hide and close the camera, and the camera can be used for capturing the human body posture under the condition that the camera is opened to remind a person at home of having safety problems such as whether children or old people fall down, so that the auxiliary monitoring of the safety problems of the person at home needing to be protected is improved, and the user experience is good.
According to an embodiment of the present invention, there is also provided an air conditioner corresponding to the image control apparatus. The air conditioner may include: the image control apparatus described above.
In an optional embodiment, in view of great convenience brought to the life of people by computer vision, in order to solve the problem that a camera may expose the privacy of a family, the scheme of the invention provides a household air conditioner with a retractable camera for capturing the posture of a human body.
The computer vision means that a camera and a computer are used for replacing human eyes to perform machine vision such as identification, tracking and measurement on a target, and further image processing is performed, so that the computer processing becomes an image more suitable for human eye observation or transmitted to an instrument for detection.
In an optional example, in the scheme of the invention, the camera in the air conditioner can be controlled to move up and down or left and right in a remote APP real-name pairing control mode or a remote controller control mode, so that the camera can extend out of the air conditioner body; the camera button can also be manually pressed to pop the camera out of the air conditioner body, or the camera can be turned off and retracted back into the air conditioner body. Furthermore, the human body posture can be captured in real time through the neural network by utilizing the camera, children or old people with inconvenient actions can be found in real time, the old people cannot stand when falling down, and family people can be reminded through the APP.
Optionally, the camera in the air conditioner can be controlled to move up and down or left and right in a remote APP real-name pairing control mode or a remote controller control mode so as to stretch out of the air conditioner body.
For example: the camera can be changed from horizontal to ninety-degree pop-up from the body.
Alternatively, the camera may be caused to pop up by a manual button. For example: the camera button can be manually pressed to pop the camera out of the air conditioner body or close the camera and retract the camera back to the air conditioner body.
Wherein, under the condition that needs use the camera, the camera stretches out and draws back from the air conditioner fuselage, or the camera pops out from the air conditioner fuselage after, utilizes the camera can catch real-time human gesture. Therefore, people can use computer vision to bring convenience to users, and the use experience, comfort and safety of the users are improved.
In an alternative embodiment, reference may be made to the examples shown in fig. 5 and 6 to illustrate specific implementation procedures of the scheme of the present invention.
In an optional specific example, in the scheme of the present invention, the APP may be paired in a real-name manner, and the APP of other family members can be bound to the home air conditioner only by the consent of the user; then the camera in the APP control air conditioner fuselage of through the cell-phone emits and opens the camera, perhaps utilizes the remote controller to open the camera and emits from the fuselage, optionally can open the camera and carry out work in combination with the button. The camera can rotate left and right or rotate in a pitching mode when emerging from the body, the pitch angle and the yaw angle of the camera are obtained in real time, the view field of the camera is enlarged, and the camera can rotate left and right or rotate in a pitching mode to enable a room to have no dead angle. The camera can pop up from top to bottom or from left to right, and when the camera is not used, the air conditioner body is retracted by the camera, so that the user does not need to expose a series of troubles for using the related privacy of the air conditioner with the camera.
Wherein the pitch angle is an included angle between an X axis of a machine body coordinate system and a horizontal plane; the pitch angle is positive when the positive semi-axis of the X-axis is above the horizontal plane through the origin of coordinates (head up), and negative otherwise. The yaw angle is an included angle between the projection of the x b axis of the machine body coordinate system on the horizontal plane and the x g axis (on the horizontal plane, the pointing target is positive) of the ground coordinate system, and when the x g axis rotates anticlockwise to the projection line of the x b axis of the machine body, the yaw angle is positive, namely the right yaw of the machine head is positive, and the other way round is negative.
Specifically, the home air-conditioning flow for the scalable camera to capture the human body gesture can be exemplarily described with reference to the home air-conditioning flow for the scalable camera to capture the human body gesture as shown in fig. 5. In fig. 5, the telescopic or pressing type air conditioner body emits, then the camera is opened to capture the human body posture of the family member or the security protection effect, and the camera is closed to withdraw the camera into the air conditioner body. As shown in fig. 5, in the solution of the present invention, the process of a home air conditioner for capturing a human body gesture by a scalable camera may include:
and step 11, starting the camera. For example: the camera can be turned on by manually pressing a camera button, which can be a control component for controlling the camera to be turned on or off, and the control component can be arranged on the camera or outside the air conditioner body. For another example: the camera can be opened through the APP connected with the air conditioner in a matched mode or through the air conditioner remote controller.
And step 12, after the air conditioner or the camera receives the opening instruction for opening the camera in the step 11, popping up the camera from the air conditioner body, or slowly popping up or stretching out from the air conditioner body.
For example: the air conditioner body is internally provided with an accommodating space for accommodating the camera, and the camera can be accommodated in the accommodating space. An elastic piece or a telescopic piece can be arranged between the inner wall of the accommodating space and the camera. This elastic component or extensible member can be under APP, button, remote controller etc. control, can withdraw the camera to this accommodation space under the outside condition of air conditioner fuselage in the camera is external, and close the camera under the condition that the camera was not closed, can send out this accommodation space with the camera under the condition of placing in this accommodation space of air conditioner fuselage inside in the camera so that the camera is external in the air conditioner fuselage outside, and open the camera under the condition that the camera was not opened.
And step 13, under the condition that the camera is arranged outside the air conditioner body, the camera can be controlled to rotate left and right and/or up and down to obtain a larger collection view field.
And step 14, under the condition that the camera can rotate or in the process of rotating the camera, the pitch angle and the yaw angle of the camera can be obtained in real time, so that the camera can acquire the room conditions without dead angles as much as possible by adjusting the pitch angle and the yaw angle of the camera.
Step 15, under the condition of determining the pitch angle and the yaw angle of the camera, on one hand, the human body posture in a room can be captured in real time by utilizing a camera neural network; and then according to this human gesture, can remind other people or guardians in the family when the condition that child or old man fell down takes place in the family, for example: reminding other people or guardians in the home through the network. On the other hand, the camera can be used for monitoring the security condition in the house in real time, so that a prompt or an alarm is initiated when the situation of dangerous security in the house is found.
In an optional specific example, in the scheme of the present invention, after the camera is turned on, training is performed through a Convolutional Neural Network (CNN) and a generated target box (generic anchor) and class (class); then predicting (pre _ anchor) and a target frame to obtain a regression loss function (anchor _ loss) and a classification function (class _ loss), iterating through step (step number) in iteration times (epoch) to change an learning rate (least rate), finally obtaining a loss function minimum value through loss back propagation (loss _ back), and finally obtaining a trained human body posture neural network.
In particular, a detailed human posture neural network flow chart can be seen with reference to a human posture neural network as shown in fig. 6, and the human posture neural network can be seen with an exemplary illustration of the detailed human posture neural network flow. As shown in fig. 6, in the scheme of the present invention, the detailed human posture neural network process can be seen in the human posture neural network, and the process may include:
step 21, obtaining a training posture image to form a training sample; and acquiring a test attitude image to form a test sample.
And step 22, performing CNN training on the training samples to obtain a CNN feature extraction model. And performing feature extraction on the test sample by using the CNN feature extraction model to obtain a training posture feature and a test posture feature.
And step 23, carrying out classification training on the training posture characteristics by using a softmax classifier to obtain a softmax classification model.
And 24, classifying the test posture features by using the softmax classification model to obtain a classification result, and taking the classification result as a human body posture neural network model. For example: by the human posture neural network model, the automatic classification result of whether the human posture in the room is in a falling state or other dangerous conditions can be obtained based on the image information in the room.
Therefore, the fact that the children or the old in the family fall on the ground and cannot stand is obtained through the human posture neural network model, at the moment, the air conditioner informs family members through a network, or when factors such as cerebral hemorrhage attacks of the old and the like occur, the camera can judge corresponding results through the human posture and the expression and give relevant conditions to users through the network, and the patients in the family are solved at the first time; when the home does not have a network, the air conditioner can alarm to sound to remind the home user and the next door neighbor. And finally, the camera can play a security role and can monitor the condition that no one is at home in real time.
Since the processing and functions of the air conditioner of this embodiment are basically corresponding to the embodiments, principles and examples of the apparatus shown in fig. 4, the description of this embodiment is not given in detail, and reference may be made to the related descriptions in the embodiments, which are not described herein again.
Through a large number of tests, the technical scheme of the invention is adopted, and the camera in the air conditioner is controlled to move up and down or left and right, so that the camera can stretch out of the air conditioner body; the camera button can also be manually pressed to pop out the camera from the air conditioner body, or the camera is closed and is contracted to return the camera to the air conditioner body, so that the camera can stretch out and draw back in the air conditioner body, convenience is brought to a user, and reliability and safety are realized.
According to an embodiment of the present invention, there is also provided a storage medium corresponding to the image control method. The storage medium may include: the storage medium has stored therein a plurality of instructions; the instructions are used for loading and executing the image control method by the processor.
Since the processing and functions implemented by the storage medium of this embodiment substantially correspond to the embodiments, principles, and examples of the methods shown in fig. 1 to fig. 3, details are not described in the description of this embodiment, and reference may be made to the related descriptions in the foregoing embodiments, which are not described herein again.
Through a large number of tests, the technical scheme of the invention is adopted, the camera in the air conditioner is controlled to move up and down or left and right in a remote APP real-name matching control mode or a remote controller control mode, and the telescopic mode is simple, convenient and reliable.
According to an embodiment of the present invention, there is also provided an air conditioner corresponding to the image control method. The air conditioner may include: a processor for executing a plurality of instructions; a memory to store a plurality of instructions; wherein the instructions are stored by the memory, and loaded and executed by the processor.
Since the processing and functions of the air conditioner of this embodiment are basically corresponding to the embodiments, principles and examples of the methods shown in fig. 1 to 3, the description of this embodiment is not detailed, and reference may be made to the related descriptions in the foregoing embodiments, which are not described herein again.
Through a large number of tests, the technical scheme of the invention is adopted, the flexible camera is adopted to hide and close the camera, the camera can capture the posture of the human body in real time through the neural network, children or old people with inconvenient actions can be found in real time that the old people cannot stand up when falling down, and the APP reminds the family people, so that the use is convenient, and the humanization is good.
In summary, it is readily understood by those skilled in the art that the advantageous modes described above can be freely combined and superimposed without conflict.
The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims (14)

1. An image control method, comprising:
acquiring a control instruction for controlling the image acquisition device; the image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the control instruction comprises: an open command or a close command;
according to the opening instruction, under the condition that the image acquisition device is not opened and/or the image acquisition device is not positioned outside the electric appliance body, controlling the image acquisition device to move out of the electric appliance body and controlling the image acquisition device to be opened;
or according to the closing instruction, under the condition that the image acquisition device is not closed and/or the image acquisition device is not positioned in the electric appliance body, controlling the image acquisition device to be closed and controlling the image acquisition device to move back to the inside of the electric appliance body.
2. The method of claim 1, wherein obtaining control instructions for controlling an image acquisition device comprises:
acquiring a control instruction sent by a client APP, an electric appliance remote controller and/or a preset key module;
the client APP is in pairing relation with the image acquisition device or with an electrical appliance to which the image acquisition device belongs in advance; the pairing relationship is established when confirmation information transmitted from the administrator control terminal is received.
3. The method according to claim 1, characterized in that, inside the electrical appliance body, there is provided an accommodating space for accommodating the image acquisition device; an elastic piece or a telescopic piece is arranged between the accommodating space and the image acquisition device;
wherein the content of the first and second substances,
control the image acquisition device and move out to the outside of electrical apparatus fuselage, include:
through the elastic piece or the telescopic piece, under the condition that the image acquisition device is arranged in the accommodating space inside the electric appliance body, the image acquisition device is popped out or stretched out of the accommodating space so as to control the image acquisition device to move out of the electric appliance body; under the condition that the image acquisition device is moved out of the motor body, the image acquisition range of the image acquisition device can be adjusted to a preset maximum acquisition range in an indoor space to which the electric appliance belongs;
and/or the presence of a gas in the gas,
controlling the image acquisition device to move back to the inside of the electric appliance body, comprising:
through the elastic piece or the telescopic piece, under the condition that the image acquisition device is positioned outside the electric appliance body, the image acquisition device is retracted or retracted into the accommodating space inside the electric appliance body so as to control the image acquisition device to move back to the inside of the electric appliance body.
4. The method of any one of claims 1-3, further comprising:
under the conditions that the image acquisition device is controlled to move out of the body of the electric appliance and is controlled to be started, and under the condition that an object to be monitored is in an indoor space to which the electric appliance belongs, first image information of the object to be monitored is obtained;
determining the current human body posture displayed by the first image information by utilizing a human body posture neural network model obtained by pre-training according to the first image information;
if the current human body posture belongs to the preset dangerous posture range, a first monitoring reminding message of the dangerous posture of the object to be monitored is initiated, and/or a second monitoring reminding message of the dangerous posture of the object to be monitored is sent to the monitor client.
5. The method of claim 4, further comprising:
before the current human body posture displayed by the first image information is determined, comparing the first image information with a preset privacy information range; and if the information characteristics in the preset privacy information range appear in the first image information, performing fuzzy processing on the information characteristics in the first image information.
6. The method of any one of claims 1-3, further comprising:
under the condition that the image acquisition device is controlled to move out of the body of the electric appliance and is controlled to be started, and under the condition that no person exists in the indoor space to which the electric appliance belongs, second image information of the indoor space is acquired;
if new image features appear in the second image information along with the advance of time and the image features do not belong to a preset legal feature range, initiating a first security reminding message of an unfamiliar actor in the indoor space and/or sending a second security reminding message of the unfamiliar actor in the indoor space to a manager client.
7. An image control apparatus, characterized by comprising:
the acquisition unit is used for acquiring a control instruction for controlling the image acquisition device; the image acquisition device can be arranged in the electric appliance body in an elastic or telescopic manner; the control instruction comprises: an open command or a close command;
the control unit is used for controlling the image acquisition device to move out of the electric appliance body and controlling the image acquisition device to be started under the condition that the image acquisition device is not started and/or the image acquisition device is not positioned outside the electric appliance body according to the starting instruction;
or, the control unit is further configured to control the image capturing device to be turned off and to control the image capturing device to move back to the inside of the electric appliance body according to the turn-off instruction when the image capturing device is not turned off and/or the image capturing device is not located inside the electric appliance body.
8. The apparatus according to claim 7, wherein the acquiring unit acquires a control instruction for controlling the image capturing apparatus, including:
acquiring a control instruction sent by a client APP, an electric appliance remote controller and/or a preset key module;
the client APP is in pairing relation with the image acquisition device or with an electrical appliance to which the image acquisition device belongs in advance; the pairing relationship is established when confirmation information transmitted from the administrator control terminal is received.
9. The device as claimed in claim 7, wherein an accommodating space for accommodating the image acquisition device is provided inside the body of the electrical appliance; an elastic piece or a telescopic piece is arranged between the accommodating space and the image acquisition device;
wherein the content of the first and second substances,
the control unit controls the image acquisition device to move out of the electric appliance body, and comprises:
through the elastic piece or the telescopic piece, under the condition that the image acquisition device is arranged in the accommodating space inside the electric appliance body, the image acquisition device is popped out or stretched out of the accommodating space so as to control the image acquisition device to move out of the electric appliance body; under the condition that the image acquisition device is moved out of the motor body, the image acquisition range of the image acquisition device can be adjusted to a preset maximum acquisition range in an indoor space to which the electric appliance belongs;
and/or the presence of a gas in the gas,
the control unit controls the image acquisition device to move back to the interior of the electric appliance body, and comprises:
through the elastic piece or the telescopic piece, under the condition that the image acquisition device is positioned outside the electric appliance body, the image acquisition device is retracted or retracted into the accommodating space inside the electric appliance body so as to control the image acquisition device to move back to the inside of the electric appliance body.
10. The apparatus of any of claims 7-9, further comprising:
the acquiring unit is also used for acquiring first image information of the object to be monitored under the conditions that the image acquisition device is moved out of the body of the electric appliance and is started and the object to be monitored is in the indoor space to which the electric appliance belongs;
the control unit is further configured to determine, according to the first image information, a current human body posture shown by the first image information by using a human body posture neural network model obtained through pre-training;
the control unit is further configured to initiate a first monitoring reminding message when the object to be monitored is in the dangerous posture and/or send a second monitoring reminding message when the object to be monitored is in the dangerous posture to the monitor client if the current human posture belongs to the preset dangerous posture range.
11. The apparatus of claim 10, further comprising:
the control unit is further used for comparing the first image information with a preset privacy information range before determining the current human body posture displayed by the first image information; and if the information characteristics in the preset privacy information range appear in the first image information, performing fuzzy processing on the information characteristics in the first image information.
12. The apparatus of any of claims 7-9, further comprising:
the acquisition unit is also used for acquiring second image information of the indoor space under the condition that the image acquisition device is moved out of the body of the electric appliance and is started and no person exists in the indoor space to which the electric appliance belongs;
the control unit is further configured to initiate a first security reminding message of an unfamiliar actor in the indoor space and/or send a second security reminding message of the unfamiliar actor in the indoor space to the administrator client if a new image feature appears in the second image information along with the advance of time and the image feature does not belong to a preset legal feature range.
13. An air conditioner, comprising: the image control apparatus according to any one of claims 7 to 12;
alternatively, the first and second electrodes may be,
the method comprises the following steps:
a processor for executing a plurality of instructions;
a memory to store a plurality of instructions;
wherein the plurality of instructions are for being stored by the memory and loaded and executed by the processor to perform the image control method of any of claims 1-6.
14. A storage medium having a plurality of instructions stored therein; the plurality of instructions for being loaded by a processor and for performing the image control method according to any one of claims 1 to 6.
CN201910917877.XA 2019-09-26 2019-09-26 Image control method and device, storage medium and air conditioner Pending CN110686353A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910917877.XA CN110686353A (en) 2019-09-26 2019-09-26 Image control method and device, storage medium and air conditioner

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910917877.XA CN110686353A (en) 2019-09-26 2019-09-26 Image control method and device, storage medium and air conditioner

Publications (1)

Publication Number Publication Date
CN110686353A true CN110686353A (en) 2020-01-14

Family

ID=69110384

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910917877.XA Pending CN110686353A (en) 2019-09-26 2019-09-26 Image control method and device, storage medium and air conditioner

Country Status (1)

Country Link
CN (1) CN110686353A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111427292A (en) * 2020-03-24 2020-07-17 深圳市博电电子技术有限公司 Control method and device of toilet and toilet

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006155109A (en) * 2004-11-26 2006-06-15 Yec Co Ltd Image processor
CN102955479A (en) * 2012-10-25 2013-03-06 歌尔声学股份有限公司 Running control device for television camera
CN103442188A (en) * 2013-08-30 2013-12-11 康佳集团股份有限公司 Television with camera
CN104023190A (en) * 2014-06-20 2014-09-03 冠捷显示科技(厦门)有限公司 Automatic lifting camera and display device thereof
CN104279705A (en) * 2014-10-08 2015-01-14 广东美的制冷设备有限公司 Air conditioner control method, air conditioner control system and air conditioner
CN106485164A (en) * 2016-09-27 2017-03-08 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN107860097A (en) * 2017-09-20 2018-03-30 珠海格力电器股份有限公司 Security-protecting and monitoring method, device and the air-conditioning with the device
CN107945458A (en) * 2017-12-11 2018-04-20 北京奇虎科技有限公司 Fall detection method, device and computing device under camera scene
CN108632523A (en) * 2017-03-22 2018-10-09 奥克斯空调股份有限公司 A kind of occlusion method of air-conditioning camera
CN109151292A (en) * 2018-10-31 2019-01-04 广东美的制冷设备有限公司 Cam device and air conditioner indoor unit
US10237380B1 (en) * 2017-11-17 2019-03-19 Phuong Mai Nguyen Movable cover for camera of electronic device
CN109920208A (en) * 2019-01-31 2019-06-21 深圳绿米联创科技有限公司 Tumble prediction technique, device, electronic equipment and system
CN110233959A (en) * 2019-06-28 2019-09-13 青岛海信电器股份有限公司 Dtv

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006155109A (en) * 2004-11-26 2006-06-15 Yec Co Ltd Image processor
CN102955479A (en) * 2012-10-25 2013-03-06 歌尔声学股份有限公司 Running control device for television camera
CN103442188A (en) * 2013-08-30 2013-12-11 康佳集团股份有限公司 Television with camera
CN104023190A (en) * 2014-06-20 2014-09-03 冠捷显示科技(厦门)有限公司 Automatic lifting camera and display device thereof
CN104279705A (en) * 2014-10-08 2015-01-14 广东美的制冷设备有限公司 Air conditioner control method, air conditioner control system and air conditioner
CN106485164A (en) * 2016-09-27 2017-03-08 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN108632523A (en) * 2017-03-22 2018-10-09 奥克斯空调股份有限公司 A kind of occlusion method of air-conditioning camera
CN107860097A (en) * 2017-09-20 2018-03-30 珠海格力电器股份有限公司 Security-protecting and monitoring method, device and the air-conditioning with the device
US10237380B1 (en) * 2017-11-17 2019-03-19 Phuong Mai Nguyen Movable cover for camera of electronic device
CN107945458A (en) * 2017-12-11 2018-04-20 北京奇虎科技有限公司 Fall detection method, device and computing device under camera scene
CN109151292A (en) * 2018-10-31 2019-01-04 广东美的制冷设备有限公司 Cam device and air conditioner indoor unit
CN109920208A (en) * 2019-01-31 2019-06-21 深圳绿米联创科技有限公司 Tumble prediction technique, device, electronic equipment and system
CN110233959A (en) * 2019-06-28 2019-09-13 青岛海信电器股份有限公司 Dtv

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111427292A (en) * 2020-03-24 2020-07-17 深圳市博电电子技术有限公司 Control method and device of toilet and toilet

Similar Documents

Publication Publication Date Title
CN106406119B (en) Service robot based on interactive voice, cloud and integrated intelligent Household monitor
CN107422859B (en) Gesture-based regulation and control method and device, computer-readable storage medium and air conditioner
CN105022981B (en) A kind of method, device and mobile terminal detecting human eye health state
CN104777821B (en) stage monitoring system and method
CN107704085A (en) A kind of detection method and household electrical appliance, storage medium
CN105204351B (en) The control method and device of air-conditioner set
WO2016177154A1 (en) Method and device for switching operation mode of mobile terminal
CN107589725B (en) Smart home equipment control method and control equipment based on built-in antenna
CN104422066A (en) System and method for controlling intelligent air conditioner and air conditioner thereof
CN110426962A (en) A kind of control method and system of smart home device
CN105824439A (en) Standby state control method and mobile terminal
CN106325514B (en) A kind of the Anti-fall method, apparatus and its electronic equipment of hand-held intelligent terminal
CN111505947B (en) Household appliance control method, intelligent door lock and computer readable storage medium
WO2019153378A1 (en) Security protection method and device of floor cleaning robot
US10971152B2 (en) Imaging control method and apparatus, control device, and imaging device
CN110908340A (en) Smart home control method and device
CN110686353A (en) Image control method and device, storage medium and air conditioner
CN108966015A (en) A kind of video broadcasting condition control method, mobile terminal and storage medium
CN111665938A (en) Application starting method and electronic equipment
CN114578701A (en) Learning method and control method of intelligent household control system
CN111667798A (en) Screen adjusting method and device
CN104063041B (en) A kind of information processing method and electronic equipment
CN108983620B (en) Control method and device and electronic equipment
JP2012161001A (en) Control system, face authentication system used with the control system, and portable terminal
CN106778901A (en) Indoor article loses reminding method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200114

RJ01 Rejection of invention patent application after publication