WO2020223967A1 - 主动的智能控制方法、系统及智能装置 - Google Patents

主动的智能控制方法、系统及智能装置 Download PDF

Info

Publication number
WO2020223967A1
WO2020223967A1 PCT/CN2019/086265 CN2019086265W WO2020223967A1 WO 2020223967 A1 WO2020223967 A1 WO 2020223967A1 CN 2019086265 W CN2019086265 W CN 2019086265W WO 2020223967 A1 WO2020223967 A1 WO 2020223967A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
user
smart device
radar sensor
user event
Prior art date
Application number
PCT/CN2019/086265
Other languages
English (en)
French (fr)
Inventor
李修球
Original Assignee
李修球
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 李修球 filed Critical 李修球
Priority to PCT/CN2019/086265 priority Critical patent/WO2020223967A1/zh
Publication of WO2020223967A1 publication Critical patent/WO2020223967A1/zh

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric

Definitions

  • the present invention relates to the field of artificial intelligence, in particular to an active intelligent control method, system and intelligent device.
  • Smart home is a residential platform, using integrated wiring technology, network communication technology, security technology, automatic control technology, audio and video technology to integrate the facilities related to home life to build an efficient management system for residential facilities and family schedule affairs, and improve Home safety, convenience, comfort, artistry, and to achieve an environmentally friendly and energy-saving living environment.
  • smart devices in smart home systems integrate multiple networks and multiple systems , Multi-sensor technology, so that its products can provide users with multiple functions such as safety protection, smart interaction, environmental monitoring, telemedicine/education, and home control.
  • smart devices can be controlled in a variety of ways, such as: panel control, APP software control, remote control control, voice control, gesture control, etc.
  • panel control APP software control
  • remote control control voice control
  • gesture control etc.
  • these control methods have various defects. For example, for the panel control method, because the panel needs to be installed at home, it is not beautiful and the construction is difficult.
  • the user needs to go to the panel to control, so the operation Inconvenience; for the APP software control method, although the problem of not needing to go to the panel to control is solved, the user needs to click on the hierarchical directory of the APP software to control the home equipment, and the mobile phone must be carried at home at any time.
  • the operation is also inconvenient , Especially for the elderly, children, and disabled users who cannot operate or cannot operate; for remote control mode, because the remote control is not fixed, it is easy to find it when needed; for voice control mode, it is limited The recognition distance of speech, the recognition accuracy rate is low, and it cannot be controlled for inconvenient or non-sounding occasions (such as when a child is sleeping); for gesture control methods, the current technology is very immature and requires users to be smart The distance between the devices should be very close, and the video recognition gesture requires the camera of the smart device to be kept on, which is easy to reveal the user's privacy.
  • control methods of smart devices have various defects. Moreover, these control methods are “passive” in response to user needs. The reason why they are called “passive” is because smart devices cannot actively sense. User needs cannot provide users with active services, and they feel that smart devices are not smart, and therefore, the user experience is poor.
  • the technical problem to be solved by the present invention is that the prior art has the defect of poor user experience.
  • the technical solution adopted by the present invention to solve its technical problem is to construct an active intelligent control method, which is applied to a smart device, and the smart device is communicatively connected to a household device, including:
  • Step S10 Acquire sensing data of at least one multiple-transmit and multiple-receive radar sensor in real time, and sequentially buffer the sensed data, wherein the at least one multiple-transmit and multiple-receive radar sensor is set on a smart device;
  • Step S20 Open a sliding window of a specific length, and obtain the sensing data in the current sliding window, and determine the user's motion information according to the sensing data in the current sliding window, the motion information including: motion track, motion direction , Movement speed;
  • Step S30 Input the exercise information and the field information into a pre-established user event model, and obtain user event information according to the output result of the user event model, wherein the field information includes at least one of the following: House structure information, indoor space information, environmental information, time information;
  • Step S40 Actively control corresponding household appliances and/or output corresponding prompt information according to the user event information.
  • a camera is further provided on the front of the smart device, and before the step S30, the method further includes:
  • Step S50 Obtain image data of the camera, and process the image data to obtain user characteristic information.
  • the user characteristic information includes at least one of the following: identity, expression, posture, and clothing;
  • inputting the exercise information and the scene information into a pre-established user event model respectively includes:
  • the exercise information, the user characteristic information, and the scene information are respectively input into a pre-established user event model.
  • the number of the radar sensors is multiple
  • the multiple radar sensors are arranged in cascade; or,
  • At least one radar sensor is arranged on the upper part of the smart device, other radar sensors are arranged on the lower part of the smart device, and the detection space of the upper radar sensor and the detection space of the lower radar sensor at least partially overlap.
  • step S40 outputting corresponding prompt information includes:
  • the present invention also constructs an intelligent device to communicate with multiple household devices, including:
  • At least one radar sensor with multiple transmitters and receivers
  • a cache module for acquiring the sensing data of the radar sensor in real time, and sequentially buffering the sensing data
  • the motion information acquisition module is used to open a sliding window of a specific length and acquire the sensing data in the current sliding window, and determine the user's motion information according to the sensing data in the current sliding window, and the motion information includes: Trajectory, movement direction, movement speed;
  • the event information acquisition module is used to input the sports information and site information into a pre-established user event model, and obtain user event information according to the output result of the user event model, wherein the site information includes the following At least one of: house structure information, indoor space information, environmental information, and time information;
  • the execution module is used to actively control the corresponding household appliances and/or output corresponding prompt information according to the user event information.
  • it also includes:
  • the characteristic information acquisition module is configured to acquire the image data of the camera and process the image data to acquire user characteristic information.
  • the user characteristic information includes at least one of the following: identity, expression, posture, and clothing;
  • the event information acquisition module is configured to input the exercise information, the user characteristic information, and the on-site information into a pre-established user event model, and obtain user event information according to the output result of the user event model.
  • the number of the radar sensors is multiple
  • the multiple radar sensors are arranged in cascade; or,
  • At least one radar sensor is arranged on the upper part of the smart device, other radar sensors are arranged on the lower part of the smart device, and the detection space of the upper radar sensor and the detection space of the lower radar sensor at least partially overlap.
  • it also includes an audio output module and/or a display screen and/or at least one LED light strip, and,
  • the execution module is configured to output corresponding prompt information by controlling the audio output module; and/or output corresponding prompt information by controlling the display screen; and/or output corresponding prompt information by controlling the at least one LED strip Prompt information.
  • the present invention also constructs an active intelligent control system, including at least one household device, which is characterized in that it also includes the above-mentioned intelligent device.
  • the user’s motion information is determined according to the sensing data of the radar sensor during application, and the user’s movement information is determined intelligently through machine learning and big data analysis. Real needs, and then actively provide users with accurate care services, so that users can get a convenient, intelligent and comfortable user experience.
  • FIG. 1 is a flowchart of Embodiment 1 of the active intelligent control method of the present invention
  • Fig. 2 is a logical structure diagram of the first embodiment of the smart device of the present invention.
  • FIG. 1 is a flowchart of the first embodiment of the active smart control method of the present invention.
  • the smart control method of this embodiment is applied to a smart device that is communicatively connected to a home device.
  • the home device includes, for example, smart lamps and smart lamps installed indoors. Air conditioners, smart curtains, smart TVs, etc., and the smart control method of this embodiment includes the following steps:
  • Step S10 Acquire sensing data of at least one multiple-transmit and multiple-receive radar sensor in real time, and sequentially buffer the sensed data, wherein the at least one multiple-transmit and multiple-receive radar sensor is set on a smart device;
  • Step S20 Open a sliding window of a specific length, and obtain the sensing data in the current sliding window, and determine the user's motion information according to the sensing data in the current sliding window, the motion information including: motion track, motion direction , Movement speed;
  • the radar sensor is a radar sensor with multiple transmissions and multiple receptions
  • the user's position on the horizontal plane can be determined based on the sensing data, and when the user is moving, the user can be drawn based on multiple positions within a period of time.
  • the trajectory of the movement, and the direction and speed of the user's movement can be determined.
  • Step S30 Input the exercise information and the field information into a pre-established user event model, and obtain user event information according to the output result of the user event model, wherein the field information includes at least one of the following: House structure information, indoor space information, environmental information, time information;
  • the house structure information can be input to the smart device by the user, property management personnel, or manufacturer maintenance personnel before the smart device is used for the first time, for example, the house structure picture of the house is input to the designated path of the smart device; It can also be obtained through big data analysis based on the house structure data of other smart devices in the local area network during the use of the smart device.
  • indoor space information for example, including indoor layout, furniture placement, etc., it can be obtained by taking pictures of the room with its own camera before the first use of the smart device and processing it into a panoramic picture; it can also be obtained by its own radar sensor It is obtained by detecting distance in all directions of the room and generating a digital map of the room.
  • environmental information it is obtained through one or more of its own smoke sensor, gas sensor, CO sensor, VOC sensor, temperature and humidity sensor, PM2.5 sensor, formaldehyde sensor, CO2 sensor, and illuminance sensor.
  • time information it can be obtained through its own clock generation module, and the clock can also be calibrated by communicating with at least one of the following: user mobile terminal, remote server, other smart devices in the community LAN, unit door phone Wait.
  • the on-site information can also include on-site audio information, and the audio information can be obtained through its own microphone (or microphone array).
  • Step S40 Actively control corresponding household appliances and/or output corresponding prompt information according to the user event information.
  • the correspondence between user event information and prompt information or control instructions of home appliances can be pre-set and stored by the user, or can be acquired by the backend server through big data learning and then transmitted to the corresponding
  • the user event information is that when the user leaves home for work, the corresponding control of the home device is: all lights, display screens, TVs, curtains, and air conditioners in the control room are turned off and enter the armed state; the corresponding The prompt message is: The owner has a safe journey.
  • the user event information is when the user goes home from get off work, the corresponding control of the home device is: control the entrance lights, living room lights, kitchen lights, display screens, curtains, etc.
  • the corresponding prompt information is : Welcome home.
  • the user event information is that when the user gets up at night, the corresponding control of the household device is: control the toilet light to turn on.
  • the corresponding prompt message is: Please get up and move around.
  • the user event model can be established according to the following steps:
  • training sample data includes: on-site information and user motion information determined according to the sensing data of the radar sensor;
  • a preset training method is used to train the sensing feature information and user event information to obtain a user event model.
  • the user event model needs to be trained first.
  • first obtain a large amount of training sample data then extract the sensing feature information, and then train the sensing feature information and the user's actual event information according to the preset training method, so that the user event model can be obtained, and the user event information can be Including: working away from home, going home from work, getting up at night, getting up, lying down, falling, being sedentary, sedentary, and illegal invasion.
  • the user if the user walks from the living room to the hallway location at about 7 o'clock in the morning of a working day, it is determined that the user leaves home for work; if the user opens the door and enters at about 7 o'clock in the evening of the working day, it is determined that the user is off work Go home; if the user gets out of bed and walks to the bathroom at night, it is determined to be the user getting up at night; if the user moves in a specific area (such as the treadmill position) at a specific speed during the leisure time, it is determined as The user exercises; if the user stays in a specific location (such as a sofa) for more than a preset value (such as two hours), it is determined that the user is sedentary.
  • a specific area such as the treadmill position
  • the user event model can be verified using the training sample data. If the verification is passed, the user event model can be applied. If the verification fails, further training sample data needs to be collected to continue. Training until the user event model that passed the verification is obtained.
  • a camera is further provided on the front of the smart device, and before step S30, the method further includes:
  • Step S50 Obtain image data of the camera, and process the image data to obtain user characteristic information.
  • the user characteristic information includes at least one of the following: type, expression, posture, identity, dress, image;
  • inputting the exercise information and the scene information into a pre-established user event model respectively includes:
  • the exercise information, the user characteristic information, and the scene information are respectively input into a pre-established user event model.
  • the user expression includes, for example, happy, sad, tired, etc.
  • the user posture includes, for example, lying, sitting, standing, etc.
  • the user's dress includes, for example, formal, sports, and leisure.
  • the user characteristic information is also input into the user event model to obtain more accurate user events, thereby proactively providing users with more accurate care services. For example, when the user event is that the user is happy to go home from get off work, the smart speaker can be controlled to play cheerful music; when the user event is wearing sportswear to work, output a message reminding the owner to change dress; when the user event is lying on the floor When moving, an alarm can be triggered.
  • multiple radar sensors are arranged in cascade or arranged up and down, and the way of up and down arrangement is, for example, that at least one radar sensor is arranged at all.
  • the detection space of the upper radar sensor and the detection space of the lower radar sensor at least partially overlap.
  • step S40 outputting corresponding prompt information includes:
  • the LED light strip includes, for example, three groups of red, green, and blue lamp beads. These three groups of lamp beads can be connected in series or in parallel, and then can be adjusted by the principle of PWM dimming. The color and brightness of the corresponding LED light strips are controlled and adjusted to display different prompt messages.
  • Fig. 2 is a logical structure diagram of the first embodiment of the smart device of the present invention.
  • the smart device of this embodiment includes: a radar sensor 20, a cache module 11, a motion information acquisition module 12, an event information acquisition module 13, and an execution module 14, in which, The cache module 11, the motion information acquisition module 12, the event information acquisition module 13, and the execution module 14 are integrated in the core processor of the smart device.
  • the buffer module 11 is used to obtain the sensing data of the radar sensor 20 in real time, and to sequentially buffer the sensing data;
  • the motion information acquisition module 12 is used to open a sliding window of a specific length and obtain the current sliding window
  • the user’s motion information is determined based on the sensing data in the current sliding window.
  • the motion information includes: motion trajectory, motion direction, and motion speed; the event information acquisition module 13 is used to combine the motion information with The scene information is respectively input into the pre-established user event model, and the user event information is obtained according to the output result of the user event model.
  • the scene information includes at least one of the following: house structure information, indoor space information, environment Information and time information; the execution module 14 is used to actively control the corresponding household appliances and/or output corresponding prompt information according to the user event information.
  • the smart device also includes a camera 30 arranged on the front.
  • a characteristic information acquisition module 15 is integrated in the core processor.
  • the characteristic information acquisition module 15 is used to acquire image data of the camera 30 and to compare the image The data is processed to obtain user characteristic information.
  • the user characteristic information includes at least one of the following: identity, expression, posture, and clothing.
  • the multiple radar sensors 20 are arranged in cascade; or, at least one radar sensor is arranged on the upper part of the smart device, and other radar sensors are arranged on the The lower part of the smart device, and the detection space of the upper radar sensor and the detection space of the lower radar sensor at least partially overlap.
  • the smart device further includes an audio output module and/or a display screen and/or at least one LED light strip, and the execution module 14 is used to control the audio output module to output corresponding prompt information; and/or , Output corresponding prompt information by controlling the display screen; and/or output corresponding prompt information by controlling at least one LED strip.
  • the present invention also constructs an active intelligent control system, which includes the aforementioned intelligent device and at least one household device.
  • the smart device when a user event occurs, can determine the user's motion information by analyzing the sensing data of the radar sensor, and intelligently judge user needs through machine learning and big data analysis, and accurately Provide users with prompts such as active care, inquiries, warnings, reminders, and guidance, or link with other household devices to improve user experience.
  • Away from home scenario When going to work or school, the smart device perceives that the user is walking towards the entrance door and arrives at a specific location (away from the entrance door or from the smart device preset distance or habit area), and automatically voice care for the user, such as "Master , Please bring your belongings when leaving home, and have a safe journey to school/work" or "Master, it will rain today, please bring rain gear when you go out”; or, when the last user arrives at a certain location, the user will be automatically cared for by voice, For example, “Master, please turn on the privacy switch before you leave home, so that I can help you take good care of your home”; or, when the user perceives that the user leaves home as a hearing impaired, it will automatically care for the user through the flashing of a specific coded LED light strip" Turn on the privacy switch Or and farewell care"; or, when the user turns on the privacy sensor, the smart device automatically recognizes the user's current image/expression/clothing/body temperature and other states, when it is recognized that the user'
  • the smart device senses that the entrance door is opened, and automatically voices care for the user, such as "Welcome home, please disarm”. At the same time, when the sense of illumination is lower than the preset value, it also automatically turns on the entrance area lights, curtains, and display screens.
  • Air conditioning and other equipment play the role of lighting and care; for example, when the user is hearing impaired, the smart device will automatically code the flashing light to care for the user and remind the user to disarm; when the user is not disarmed within the preset time, or walk directly into the room In other spaces, the smart device automatically sends out sound and light alarms, and simultaneously pushes the on-site alarm video and audio information to the property operation center and the mobile terminal of the user's mobile phone; when the user confirms the identity, the smart device automatically video recognizes the user's current image/expression/clothing/body temperature When it is recognized that the user’s current image/expression/clothing/body temperature does not meet the planned preset value, the automatic voice or code flashing lights care for the user, such as "Master, did you succeed in seeing the customer today?" or "Master, you look Very unhappy, please don’t bring your bad mood to your home" or “Master, your body temperature is a bit high now, is it uncomfortable there?" or "Master, are you happy to go to school today?
  • the smart device automatically cares to remind the user to turn off the privacy switch; after the care reminds the user, if the user still does not turn off the privacy switch or does not reply, the smart device determines that the user does not want to turn off the privacy switch.
  • Wake up scene in the morning users usually wake up at 7 o'clock in the morning, but today they can't fall asleep and get up at 6:30.
  • the smart device senses that the user gets out of bed and automatically cares for the user by voice, such as "Master, you got up!” and automatically opens the curtains and displays The screen, if the perceived light is not enough, it can also automatically turn on the light, play wake-up music or remind the user to care according to the user’s sleep situation last night, such as "Master, good morning, the indoor air quality last night did not exceed the standard in the whole process" or "Master, good morning, you went to the toilet * times last night, pay more attention to your body” etc.; if the user is a hearing impaired user, the smart device senses that the user gets out of bed, automatically encodes the flashing light to care for the user, and automatically opens the curtains and display screens, Show the user’s health related to sleeping at night; when there are two users, if the smart device senses that the user gets up first, it will automatically turn on the dark light
  • the smart device in the living room senses that the user enters the bedroom from the living room to exceed the preset time value, and automatically turns on the sleep mode, turns off the living room TV, lights, and curtains, and activates the arming mode; the smart device in the bedroom senses that the user goes to bed, if it is not turned off
  • the privacy switch the automatic voice care reminds the user to turn off the privacy switch; when the smart device senses that the user has not moved for more than the preset time after going to bed, it automatically turns on the sleep mode, turns off the bedroom TV, lights, curtains, and adjusts the air conditioner to the appropriate temperature. Start the armed state.
  • the smart device will detect that the user opens the bedroom door, automatically turn on the night mode, and turn on the night light; when the smart device senses that the user walks outside the toilet door, it automatically turns on the toilet light ; When the smart device senses that the time after the user walks out of the toilet exceeds the preset time value, it automatically turns off the toilet light.
  • the smart device in the bedroom senses that the user wakes up at night, automatically turns on the wake-up mode, and turns on the night light; when the smart device senses that the user walks outside the toilet door, it automatically turns on the toilet light; when the smart device senses the user is coming from the toilet When the time after stepping out exceeds the preset time value, the toilet light is automatically turned off; when the device senses that the user goes back to bed and exceeds the preset time value, it automatically turns off the bedroom night light.
  • the smart device judges to switch the lights by sensing the user's state, which is energy-saving and intelligent, and also avoids voice control from interfering with the rest of relatives, and also avoids the trouble of manual switching.
  • the emergency music will be automatically turned on, and the elderly will be reminded that if they do not reply within 2 minutes, an alarm signal will be formed. If you have hearing problems, you can also flash the lights to remind users. If there is no reply for more than 2 minutes, the current emergency status of the elderly will be automatically pushed to the property operation center or relatives or service platform. If the elderly stays in a room that the smart device cannot perceive for a long time, instead of the normal rest time, the smart device will prompt the user with a voice prompt "Master, your father/mother is in a certain room N times when the children of the elderly return home. Staying for a long time is not good for your health.
  • the smart device will automatically dial the phone or flash the indoor lights. Remind the elderly to go out and walk, such as voice/phone/music/flashing light without a reply from the elderly, and automatically push the current emergency status of the elderly to the property operation platform or relatives or service platform. If the smart device detects the fall of the elderly, it will automatically turn on the camera and voice, video analysis or monitor the user’s current status. If the user’s privacy protection turns off the camera or microphone, the smart device will flash a light or play emergency music to remind the elderly. If not within 2 minutes Reply, form an alarm signal and push it to the property operation center or relatives or service platform.
  • the smart device took the initiative to care for the elderly "Master, your stomach is not good, so and so gastrointestinal medicine needs to be taken 1 hour before meals, please take the medicine on the spot”.
  • the smart device perceives the elderly to wander N times (trajectory/speed/direction/frequency/distance/area/old habits/time nodes, etc.), and take the initiative to care for the elderly "Master, do you meet Are you unhappy?" or "Master, you have limited space for wandering around at home. You can go outside and bring your location sheet so I can know where you are at any time" or "Master, there is a rare calligraphy recently You can come and take a look at the work.
  • the smart device perceives that there are users or multiple users in the living room or the last user walks from other rooms to the living room, and at the same time it is 8 o'clock when a certain TV series starts, actively caring "Master, the TV series watched last night has now begun , Do you want to watch it together?" If the user replies with "OK", the audio-visual mode is automatically turned on, the lights in the dining room, toilet, and bedroom are automatically turned off, and the lights in the living room are dimmed. When the children in the living room make too much noise, the smart device actively cares for the user "children, please don't make loud noises at night, and don't interfere with others' rest”.
  • the smart device automatically switches the art display content when it senses that the user passes the device distance to the preset value, and can be set to introduce the origin, author, characteristics, historical story, etc. of the artwork with appropriate voice volume And, when the smart device perceives that the user is not interested in leaving, it will automatically close the voice content, so as not to disturb the user’s life. Through such inadvertent and fragmented time, it can infect, influence and improve users' artistic literacy and knowledge, turning passive into active information service, and enriching users' amateur life.
  • Dining scene During the dining time (such as defining 7 o'clock / 12 o'clock / 18 o'clock, or machine learning analysis to adjust the user's usual dining time), when the smart device senses that there are high-temperature items or people gather, it will automatically turn on the dining mode, turn on the restaurant lights, and eat Light music sounds, lights in other rooms are turned off (perceives that the user has left), and the user actively cares about the user "Master, are you ready to eat?", the user replied “Yes, call the children over for dinner”.
  • the dining time such as defining 7 o'clock / 12 o'clock / 18 o'clock, or machine learning analysis to adjust the user's usual dining time
  • the smart device senses that the host opens the door to let the guests enter the room, and takes the initiative to care for the guest "Dear XX guest, welcome to my home", and then automatically turns on the meeting mode.
  • the smart device senses that the guest is approaching, it will automatically switch to display the precious famous paintings stored in advance to attract the attention of the guest, increase the communication topics between the host and the guest, and also show the host’s hobbies.
  • the smart device senses that the user opens the entrance door, it automatically cares for the user "is the distinguished guest leaving? Welcome to come again next time.”
  • Smart devices can also be installed in the meeting room, and when the user enters the scheduled meeting time, participants, duration, meeting subject, remote area and other related information through the mobile APP/PC/platform, etc.
  • the smart device senses that a user enters the meeting room at a preset time before the meeting, it will automatically activate the display screen and display company-related advertisements or introductions, and take the initiative to care for the user "colleagues, hello! This meeting room will be after the ** time There are important meetings, please pay attention to the time", and automatically start the projection and air conditioning in the meeting room, and adjust the temperature and humidity to appropriate values.
  • the smart device When the meeting start time is up, the smart device actively reminds all participating colleagues "meeting time is up, everyone is ready to have a meeting", and cast a screen to display the meeting report PPT content.
  • the host announces that "today's meeting is here, the meeting is over”
  • the smart device senses that the last user has left the meeting room, and automatically turns off the meeting room lights/curtains/air conditioning and display screens.
  • Display scene Smart devices can also be installed in the exhibition hall, and users can enter the appointment visit time, visiting unit, visitors, interpreters, escorts, visit time, flow chart, etc. through the mobile APP/PC/platform/local Information about the purpose of the visit.
  • Smart devices can also be installed in the office, and during the morning work hours, the smart devices in the front desk or lobby will perceive and recognize users, automatically disarm and turn on the lights, curtains and air-conditioning of the user’s card slot and corridors, and take the initiative Caring for users "Good morning! Mr. Chen came to the company so early! Or 10 minutes before work, the smart device automatically turns on the background music to remind users that they are close to work, and please be prepared for work. During the noon break, the smart device automatically plays background music to remind users that they are off work, and turn off the lights and curtains in the office area within 10 minutes after get off work, so that users can return to the company for lunch after lunch.
  • the smart device automatically turns on the background music to remind users that they are close to work, and please be prepared for work.
  • the smart device senses that there are no people in the area and automatically turns off the lights in the area until all people leave, turn off all office lights, curtains and air conditioners, and deploy security.
  • overtime hours for example, when the smart device senses (or recognizes the identity of the video) overtime at 8 o’clock in the evening, and actively cares for the user "colleague (renamed the user title "General Chen” after the video is recognized), you are still working overtime, thank you for your help Paying by the company" or at 10 p.m.
  • Hotel scene Smart devices can also be installed in hotel guest rooms. When the smart device senses that hotel guests open the door, it will automatically turn on the room lights, curtains (closed at night), air-conditioning, etc., and take the initiative to care for guests, such as "Dear guest, welcome When staying at a XX hotel, I am the housekeeper of your hotel. If you have any needs, you can tell me directly.” When the guest arrives at the TV and the stay time exceeds the preset value, the TV is automatically turned on. If the guest tells the smart device before going to bed, "Housekeeper, I will get up at 7 tomorrow, I am going to have a meeting, and I am sleeping now", the smart device will automatically reply "OK, I am going to wake you up at 7".
  • the smart device senses that the guest goes to bed and lie down to sleep, it automatically activates the sleep mode, turns off the lights and curtains, adjusts the air conditioner to a suitable temperature, and activates the arming state. If the door or window senses the human body for the first time, it will automatically alarm; such as sensing the guest from the bed When entering the armed area, it is regarded as normal activity. If the guest wakes up at night, the smart device senses that the user wakes up, automatically turns on the wake-up mode, and automatically turns on the dark light and the dark light of the toilet. When the user goes back to bed from the toilet, the wake-up mode is automatically turned off.
  • the smart device When the smart device senses that the guest wakes up at 6 in the morning, it automatically plays the wake-up music, and actively cares for the user, such as "Mr. Chen, you wake up at 7 o'clock regularly, did you not sleep well?" or "Mr. Chen, it is now 6 o'clock, But you have a meeting in the morning, you can get up now” or "President Chen, it was okay to sleep last night. You went to the toilet 3 times. Is it because your stomach is not good? Pay more attention to your body!.
  • the device calculates the sleep time according to the guest's sleep at 12 o'clock yesterday, automatically turns on the wake-up mode, automatically plays wake-up music from low to high volume, and actively cares for the user, such as "Mr Chen, The breakfast time of our hotel is from 7 to 9 o'clock, and now I can catch up with the last meal time when I get up.”
  • the smart device takes the initiative to care for guests at 11:30 noon, such as "Mr. Chen, the latest check-out time of our hotel is 12 o'clock, do you need to renew the room?" Or sense the frequent movement of guests, and then stay at the door of the guest room.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

一种主动的智能控制方法、系统及智能装置，主动的智能控制方法包括：实时获取至少一个多发多收的雷达传感器（20）的感测数据，并依序进行缓存（S10）；获取当前滑动窗口内的感测数据，并确定用户的运动信息（S20）；将运动信息及现场信息分别输入到预先建立的用户事件模型中，并获取用户事件信息（S30）；根据用户事件信息主动控制相应的家居装置和/或输出相应的提示信息（S40）。

Description

主动的智能控制方法、系统及智能装置 技术领域
本发明涉及人工智能领域，尤其涉及一种主动的智能控制方法、系统及智能装置。
 背景技术
智能家居是以住宅为平台，利用综合布线技术、网络通信技术、安全防范技术、自动控制技术、音视频技术将家居生活有关的设施集成，构建高效的住宅设施与家庭日程事务的管理系统，提升家居安全性、便利性、舒适性、艺术性，并实现环保节能的居住环境。
目前，智能家居系统中的智能装置（例如，智能电视、智能室内对讲分机、智能机器人、智能网关、智能路由器、魔镜、智能音箱、智能冰箱、智能空调等）通过集成多网络、多系统、多传感器技术，使其产品自身能为用户提供安全保障、智慧互动、环境监测、远程医疗/教育、家居控制等多项功能。伴随着智能装置的核心硬件越来越强大，智能装置的控制方式也多种多样，例如包括：面板控制、APP软件控制、遥控器控制、语音控制、手势控制等。但是，这些控制方式都存在各种各样的缺陷，例如，对于面板控制方式，由于需要在家中安装面板，所以不美观，施工难度也大，而且，需要用户走到面板前去控制，因此操作不便；对于APP软件控制方式，虽然解决了不需要走到面板前去控制的问题，但需要用户通过点击APP软件的分层目录去控制家居设备，且在家里必须随时携带手机，操作同样不方便，尤其是对于老人、小孩、残障人士等不会操作或无法操作的用户；对于遥控器控制方式，由于遥控器放置位置不固定，在需要时容易找不到；对于语音控制方式，受限于语音的识别距离，识别准确率较低，而且，对于不便发声或不能发声的场合（例如在小孩睡觉时），也无法进行控制；对于手势控制方式，目前技术很不成熟，并且要求用户离智能装置的距离要很近，而且，视频识别手势需要智能装置的摄像头保持在开启状态，容易泄露用户隐私。
综上，现有的智能装置的控制方式都存在着各种各样的缺陷，而且，这些控制方式都是“被动”响应用户需求，之所以称为“被动”，是因为智能装置无法主动感知用户需求，也就无法为用户提供主动服务，给用户的感觉就是智能装置不智能，因此，用户体验较差。
 技术问题
本发明要解决的技术问题在于，现有技术存在用户体验差的缺陷。
 技术解决方案
本发明解决其技术问题所采用的技术方案是：构造一种主动的智能控制方法，应用于智能装置，所述智能装置通讯连接家居装置，包括：
步骤S10.实时获取至少一个多发多收的雷达传感器的感测数据，并将所述感测数据依序进行缓存，其中，所述至少一个多发多收的雷达传感器设置在智能装置上；
步骤S20.开一特定长度的滑动窗口，并获取当前滑动窗口内的感测数据，而且，根据当前滑动窗口内的感测数据确定用户的运动信息，所述运动信息包括：运动轨迹、运动方向、运动速度；
步骤S30.将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息，其中，所述现场信息包括下列中的至少一个：户型结构信息、室内空间信息、环境信息、时间信息；
步骤S40.根据所述用户事件信息主动控制相应的家居装置和/或输出相应的提示信息。
优选地，所述智能装置的正面还设置有摄像头，而且，所述步骤S30之前，还包括：
步骤S50.获取所述摄像头的图像数据，并对所述图像数据进行处理，以获取用户特性信息，所述用户特性信息包括下列中的至少一个：身份、表情、姿态、着装；
而且，在所述步骤S30中，将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，包括：
将所述运动信息、所述用户特性信息及现场信息分别输入到预先建立的用户事件模型中。
优选地，在所述雷达传感器的数量为多个时，
所述多个雷达传感器级联设置；或者，
至少一个雷达传感器设置在所述智能装置的上部，其它雷达传感器设置在所述智能装置的下部，且所述上部的雷达传感器的探测空间与所述下部的雷达传感器的探测空间至少部分重叠。
优选地，在步骤S40中，输出相应的提示信息，包括：
通过控制音频输出模块输出相应的提示信息；和/或，
通过控制显示屏相应的提示信息；和/或，
通过控制至少一个LED灯带输出相应的提示信息。
本发明还构造一种智能装置，与多个家居装置通讯连接，包括：
至少一个多发多收的雷达传感器；
缓存模块，用于实时获取所述雷达传感器的感测数据，并将所述感测数据依序进行缓存；
运动信息获取模块，用于开一特定长度的滑动窗口，并获取当前滑动窗口内的感测数据，而且，根据当前滑动窗口内的感测数据确定用户的运动信息，所述运动信息包括：运动轨迹、运动方向、运动速度；
事件信息获取模块，用于将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息，其中，所述现场信息包括下列中的至少一个：户型结构信息、室内空间信息、环境信息、时间信息；
执行模块，用于根据所述用户事件信息主动控制相应的家居装置和/或输出相应的提示信息。
优选地，还包括：
设置在正面的摄像头；
特性信息获取模块，用于获取所述摄像头的图像数据，并对所述图像数据进行处理，以获取用户特性信息，所述用户特性信息包括下列中的至少一个：身份、表情、姿态、着装；
而且，
所述事件信息获取模块，用于将所述运动信息、所述用户特性信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息。
优选地，在所述雷达传感器的数量为多个时，
所述多个雷达传感器级联设置；或者，
至少一个雷达传感器设置在所述智能装置的上部，其它雷达传感器设置在所述智能装置的下部，且所述上部的雷达传感器的探测空间与所述下部的雷达传感器的探测空间至少部分重叠。
优选地，还包括音频输出模块和/或显示屏和/或至少一个LED灯带，而且，
所述执行模块，用于通过控制所述音频输出模块输出相应的提示信息；和/或，通过控制显示屏输出相应的提示信息；和/或，通过控制所述至少一个LED灯带输出相应的提示信息。
本发明还构造一种主动的智能控制系统，包括至少一个家居装置，其特征在于，还包括以上所述的智能装置。
 有益效果
实施本发明的技术方案，通过在装置上设置多发多收的雷达传感器，在应用时，根据雷达传感器的感测数据确定出用户的运动信息，并通过机器学习与大数据分析来智慧判断用户的真实需求，进而主动给用户提供准确的关怀服务，使用户得到方便、智能、舒适的用户体验。
 附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。附图中：
图1是本发明主动的智能控制方法实施例一的流程图；
图2是本发明智能装置实施例一的逻辑结构图。
 本发明的实施方式
下面结合附图详细说明本发明的具体实施方式。
在此记载的具体实施方式/实施例为本发明的特定的具体实施方式，用于说明本发明的构思，均是解释性和示例性的，不应解释为对本发明实施方式及本发明范围的限制。除在此记载的实施例外，本领域技术人员还能够基于本申请权利要求书和说明书所公开的内容采用显而易见的其它技术方案，这些技术方案包括采用对在此记载的实施例的做出任何显而易见的替换和修改的技术方案，都在本发明的保护范围之内。
需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
图1是本发明主动的智能控制方法实施例一的流程图，该实施例的智能控制方法应用于智能装置中，该智能装置通讯连接家居装置，家居装置例如包括设置在室内的智能灯具、智能空调、智能窗帘、智能电视等，而且，该实施例的智能控制方法包括以下步骤：
步骤S10.实时获取至少一个多发多收的雷达传感器的感测数据，并将所述感测数据依序进行缓存，其中，所述至少一个多发多收的雷达传感器设置在智能装置上；
步骤S20.开一特定长度的滑动窗口，并获取当前滑动窗口内的感测数据，而且，根据当前滑动窗口内的感测数据确定用户的运动信息，所述运动信息包括：运动轨迹、运动方向、运动速度；
在该步骤中，由于雷达传感器为多发多收的雷达传感器，因此可根据感测数据确定出用户在水平面上的位置，而且，在用户运动时，可根据一段时间内的多个位置绘制出用户运动的轨迹，并可确定出用户运动的方向和速度。
步骤S30.将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息，其中，所述现场信息包括下列中的至少一个：户型结构信息、室内空间信息、环境信息、时间信息；
在该步骤中，关于户型结构信息，其可在智能装置首次使用前由用户、物业管理人员或厂商维护人员向智能装置输入，例如，将房子的户型结构图片输入至智能装置的指定路径下；也可以为智能装置在使用过程中根据小区局域网中其它智能装置的户型结构数据，通过大数据分析而获得。关于室内空间信息，例如，包括室内布局、家具摆放等，其可在智能装置首次使用前通过自身的摄像头对房间进行拍摄，并将其处理成全景图片而获得；也可以通过自身的雷达传感器对房间各个方向进行距离探测，并生成房间的数字地图而获得。关于环境信息，其通过自身的烟雾传感器、燃气传感器、CO传感器、VOC传感器、温湿度传感器、PM2.5传感器、甲醛传感器、CO2传感器、照度传感器中的一个或多个来获取。关于时间信息，其可通过自身的时钟产生模块来获取，而且，还可通过与下列中的至少一个通讯来校准时钟：用户移动终端、远端服务器、小区局域网内的其它智能装置、单元门口机等。当然，进一步地，现场信息还可包括现场的音频信息，而且，音频信息可通过自身的麦克风（或麦克风阵列）来获取。
步骤S40.根据所述用户事件信息主动控制相应的家居装置和/或输出相应的提示信息。
在该步骤中，首先说明的是，用户事件信息与提示信息或家居装置的控制指令之间的对应关系，可由用户预先设置并存储，也可由后台服务器通过大数据学习获取到后传送至相应的智能装置中，例如，用户事件信息为用户离家上班时，相对应的家居装置的控制为：控制室内的所有灯、显示屏、电视、窗帘、空调均关闭，并进入布防状态；相对应的提示信息为：主人一路平安。用户事件信息为用户下班回家时，相对应的家居装置的控制为：控制玄关灯、客厅灯、厨房灯、显示屏、窗帘等开启；控制空调开启在26度；相对应的提示信息为：欢迎主人回家。用户事件信息为用户夜晚起夜时，相对应的家居装置的控制为：控制卫生间灯开启。用户事件信息为久坐不动时，相对应的提示信息为：请起身活动一下。
另外，用户事件模型可根据下列步骤建立：
在训练时，获取训练样本数据，其中，所述训练样本数据包括：现场信息、根据雷达传感器的感测数据确定出的用户运动信息；
对所述训练样本数据进行处理，以获取感测特征信息；
使用预设的训练方法，对所述感测特征信息和用户事件信息进行训练，以获得用户事件模型。
在一个具体应用中，在智能装置安装好后，需首先对用户事件模型做训练。在训练时，首先获取大量的训练样本数据，然后提取感测特征信息，再按照预设训练方法对感测特征信息及用户的实际事件信息进行训练，从而可获取用户事件模型，用户事件信息可包括：离家上班、下班回家、起夜、起床、躺下、跌倒、久坐不起、久坐不动、非法入侵。具体地，若在工作日的早七点左右用户从客厅走到玄关位置，则确定为用户离家上班；若在工作日的晚七点左右用户开门进入，验证身份后，则确定为用户下班回家；若在夜间用户从床上下床并走向卫生间，则确定为用户起夜；若在休闲时段内，用户以某一特定速度在某一特定区域（例如跑步机位置）运动，则确定为用户锻炼；若用户在特定位置（例如沙发）的停留时间超过预设值（例如两个小时），则确定为用户久坐不动。进一步地，当获取到用户事件模型后，还可使用训练样本数据对用户事件模型进行验证，如果验证通过则可应用该用户事件模型，如果验证通不过则需进一步采集训练样本数据，以继续做训练，直至获取到验证通过的用户事件模型。
进一步地，在一个优选实施例中，智能装置的正面还设置有摄像头，而且，在步骤S30之前，还包括：
步骤S50.获取所述摄像头的图像数据，并对所述图像数据进行处理，以获取用户特性信息，所述用户特性信息包括下列中的至少一个：类型、表情、姿态、身份、着装、形象；
而且，在所述步骤S30中，将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，包括：
将所述运动信息、所述用户特性信息及现场信息分别输入到预先建立的用户事件模型中。
在该实施例中，用户表情例如包括有；开心、难过、疲倦等；用户姿态例如包括躺、坐、站等；用户着装例如包括：正式、运动、休闲等。而且，也将用户特性信息输入至用户事件模型中，以获取更精准的用户事件，进而给用户主动提供更准确地关怀服务。例如，在用户事件为用户下班回家很开心时，可控制智能音箱播放欢快的音乐；在用户事件为穿运动装上班时，输出提醒主人更换着装的消息；在用户事件为躺在地板上不动时，可触发报警。
进一步地，在一个优选实施例中，多发多收的雷达传感器的数量为多个时，例如，多个雷达传感器级联设置或者上下设置，上下设置的方式例如为：至少一个雷达传感器设置在所述智能装置的上部，其它雷达传感器设置在所述智能装置的下部，且所述上部的雷达传感器的探测空间与所述下部的雷达传感器的探测空间至少部分重叠。这样，可根据感测数据确定出用户在三维空间中的位置，即使摄像头在不开启的状态，也能检测出用户的跌倒、坐、站等姿态。
在一个可选实施例中，进一步地，在步骤S40中，输出相应的提示信息，包括：
通过控制音频输出模块输出相应的提示信息；和/或，
通过控制显示屏输出相应的提示信息；和/或，
通过控制至少一个LED灯带输出相应的提示信息。
在该实施例中，有多种方式来输出提示信息：语音输出；显示屏输出；LED灯带输出。关于LED灯带的输出方式，需说明的是，LED灯带例如包括红、绿、蓝三组灯珠，这三组灯珠可串联也可并联，然后通过PWM调色调光原理便可对相应LED灯带的颜色、亮度等进行控制和调整，以展示不同的提示信息。
图2是本发明智能装置实施例一的逻辑结构图，该实施例的智能装置包括有：雷达传感器20、缓存模块11、运动信息获取模块12、事件信息获取模块13和执行模块14，其中，缓存模块11、运动信息获取模块12、事件信息获取模块13和执行模块14集成在智能装置的核心处理器中。而且，缓存模块11用于实时获取雷达传感器20的感测数据，并将所述感测数据依序进行缓存；运动信息获取模块12用于开一特定长度的滑动窗口，并获取当前滑动窗口内的感测数据，而且，根据当前滑动窗口内的感测数据确定用户的运动信息，所述运动信息包括：运动轨迹、运动方向、运动速度；事件信息获取模块13用于将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息，其中，所述现场信息包括下列中的至少一个：户型结构信息、室内空间信息、环境信息、时间信息；执行模块14用于根据所述用户事件信息主动控制相应的家居装置和/或输出相应的提示信息。
进一步地，智能装置还包括设置在正面的摄像头30，同时，核心处理器中还集成有特性信息获取模块15，而且，特性信息获取模块15用于获取摄像头30的图像数据，并对所述图像数据进行处理，以获取用户特性信息，所述用户特性信息包括下列中的至少一个：身份、表情、姿态、着装。
在一个可选实施例中，在雷达传感器20的数量为多个时，该多个雷达传感器级联设置；或者，至少一个雷达传感器设置在所述智能装置的上部，其它雷达传感器设置在所述智能装置的下部，且所述上部的雷达传感器的探测空间与所述下部的雷达传感器的探测空间至少部分重叠。
在一个可选实施例中，智能装置还包括音频输出模块和/或显示屏和/或至少一个LED灯带，而且，执行模块14用于通过控制音频输出模块输出相应的提示信息；和/或，通过控制显示屏输出相应的提示信息；和/或，通过控制至少一个LED灯带输出相应的提示信息。
本发明还构造一种主动的智能控制系统，该智能控制系统包括上述智能装置及至少一个家居装置。
实施本发明的技术方案，当某一用户事件发生时，智能装置可通过对雷达传感器的感测数据进行分析来确定用户的运动信息，并通过机器学习与大数据分析来智慧判断用户需求，准确地给用户提供主动关怀、询问、警告、提醒、引导等提示，或者联动其它家居装置，提高用户体验。
下面来说明智能装置的一些应用场景：
离家场景：上班或上学时间，智能装置感知到用户走向入户门，到达某一特定位置（离入户门或距离智能装置预设距离或习惯区域）时，自动语音关怀用户，如“主人，离家请带好随身物品，上学/上班路上一路平安”或“主人，今天天气会下雨，出门请带好雨具”；或者，当感知最后一个用户到达某一特定位置时，自动语音关怀用户，如“主人，您离家前请打开隐私开关，以便我帮您看好家”；或者，当感知用户为听障人士离家时，自动通过特定编码的LED灯带闪烁来关怀用户“打开隐私开关或和告别关怀”；或者，当用户打开隐私传感器后，智能装置自动视频识别用户当前形象/表情/衣着/体温等状态，当识别到用户当前形象/表情/衣着/体温不符合计划预设值时，自动语音或编码闪灯关怀用户，如“主人，今天见客户请着正装”或“主人，您看上去很不开心，请不要把坏心情带到工作中去”或“主人，您的头发还没有梳理”或“主人，你现在体温有点高，请注意身体”等；当感知最后一个用户关门离家后，智能装置自动关闭灯光/窗帘/电视/空调/显示屏等设备，达到预设时间值时，装置自动进入布防状态。
回家场景：智能装置感知入户门被打开，自动语音关怀用户，如“欢迎回家，请撤防”，同时感知光照度低于预设值时，还自动开启玄关区域灯、窗帘、显示屏及空调等设备，起到照明与关怀的作用；如用户为听障人士时，智能装置自动编码闪灯关怀用户，并提醒撤防；当用户在预设时间内，没有撤防时或和直接走到室内其它空间，智能装置自动发出声光报警，并将现场报警视音频信息同步推送至物业运营中心和用户手机移动端；当用户确认身份后，智能装置自动视频识别用户当前形象/表情/衣着/体温等状态，当识别到用户当前形象/表情/衣着/体温不符合计划预设值时，自动语音或编码闪灯关怀用户，如“主人，今天见客户成功吗？”或“主人，您看上去很不开心，请不要把坏心情带到家里来”或“主人，你现在体温有点高，是不是那里不舒服？”或“小主人，今天上学开心吗？今天上了什么课程？”或“主人，看您样子很开心，要不要来点音乐”等。当用户没有回复或回复不要打扰时，智能装置自动关怀提醒用户关闭隐私开关；在关怀提醒用户后，若用户还是没有关闭隐私开关或回复不关时，智能装置判断为用户不希望关闭隐私开关。
早上起床场景：早上用户一般定时7点起床，但今天有事睡不着6点半就起床，智能装置感知用户下床，自动语音关怀用户，如“主人，您起床了！”并自动打开窗帘与显示屏，如感知光照不够时，还可自动打开灯光，播放起床音乐或根据昨晚用户睡觉情况向用户关怀提醒，如“主人，早上好，昨晚室内空气质量全过程各项指标没有超标”或“主人，早上好，昨晚您去了*次厕所，多注意身体”等；如用户为听障用户，智能装置感知用户下床，自动编码闪灯关怀用户，并自动打开窗帘与显示屏，显示用户晚上睡觉的相关健康情况；在用户的数量有两个时，若智能装置感知一用户先起床，便自动开启暗灯光，方便用户穿衣；如果卧室没有安装智能装置，用户起床打开卧室门，智能装置感知用户出来，自动语音关怀用户，并开启起床模式，打开背景音乐/窗帘/显示屏；并根据不同卧室的不同用户在不同时间段，以不同的语音主动关怀用户，如“主人，早上好，昨晚您太晚睡觉，现在又这么早起床，多注意身体”或“主人，早上好，昨晚客厅空间甲醛指标超标，我已为您开启新风或窗户调节空气（没有新风机或电动窗时，提醒用户安装新风机）”或“老人家，早上好，今天室外气温12度，请注意保暖”或“小朋友，早上好，今天是第十天按时早起，值得表扬，继续保持”等。
晚上睡觉：客厅的智能装置感知用户从客厅进入卧室超预设时间值后，自动开启睡觉模式，关闭客厅电视、灯光、窗帘，并启动布防模式；卧室的智能装置感知用户上床后，如未关闭隐私开关，则自动语音关怀提醒用户关闭隐私开关；当智能装置感知用户上床后超预设时间值没有动时，自动开启睡觉模式，关闭卧室电视、灯光、窗帘并将空调调至合适温度，同时启动布防状态。
起夜：如果卧室没有安装智能装置，根据户型结构特点，智能装置感知用户打开卧室门，自动开启起夜模式，开启起夜灯；当智能装置感知用户走到厕所门外时，自动开启厕所灯光；当智能装置感知用户从厕所走出后的时间超预设时间值时，自动关闭厕所灯。如果卧室安装有智能装置，卧室智能装置感知用户夜晚起床，自动开启起夜模式，开启起夜灯；当智能装置感知用户走到厕所门外时，自动开启厕所灯光；当智能装置感知用户从厕所走出后的时间超预设时间值时，自动关闭厕所灯；当装置感知用户重新上床超预设时间值时，自动关闭卧室的起夜灯。起夜时，智能装置通过感知用户状态判断开关灯光，既节能又智能，还免除语音控制干扰亲人休息，也免除手动开关的麻烦等。
老人在家场景：在只有老人在家时，智能装置感知老人坐在沙发上连续时间超预设值时，主动语音关怀用户，如“老人家，您已经在沙发上连续坐了3小时了，您身体不好，不适合长时间不动”或“老人家，您在书桌旁连续坐了3小时了，来点音乐一起放松一下吧”或“老人家，有一首您喜欢的广场舞曲要不要一起互动一下？”，如果语音没有得到老人的回复，智能装置自动开启摄像机，视频分析用户当前状态，如果老人状态出现异常，自动开启紧急状态音乐，且提醒老人如果2分钟内不回复，便形成报警信号，如果老人听力有问题，也可闪烁灯光来提醒用户。若超过2分钟未回复，则自动将老人当前紧急状态推送给物业运营中心或亲属或服务平台。如果老人在智能装置不能感知的房间长时间持续停留，而非正常休息时间，智能装置在老人的子女回家时，第一时间语音告知用户“主人，您父亲/母亲N次在某某房室连续长时间停留，这样不利于健康，您可以在房间安装一个智能装置，这样我就可以为您照顾老人了”，或者，对于听力障碍的老人，智能装置自动拔打老人电话或闪烁室内灯光来提醒老人出来走动，如语音/电话/音乐/闪灯均没有得到老人的回复，自动将老人当前紧急状态推送给物业运营平台或亲属或服务平台。如果智能装置探测老人跌倒，自动开启摄像机及语音，视频分析或监听用户当前状态，如果用户隐私保护关闭了摄像机或麦克风，则智能装置通过闪灯或播放紧急音乐来提醒老人，如果2分钟内不回复，便形成报警信号推送到物业运营中心或亲属或服务平台。在上午11点时，智能装置主动关怀老人“主人，您肠胃不好，某某肠胃药需要饭前1小时服用，请您现场服药”。在老人闲的时候，智能装置感知老人徘徊N次（轨迹/速度/方向/频次/距离/区域/老人习惯/时间节点等综合来判断是为徘徊），主动关怀老人“主人，您是不是遇到不开心事了？”或“主人，您在家徘徊走动空间有限，您可以去外面走动一下，带上您的定位表，好让我随时知道你在那里”或“主人，最近有一幅珍品书法作品，您可以过来看一下，它是谁于N年创造，当时的背景是……”或“主人，您上次没有听完的评书，要不要接着听一下？”。通过根据老人当前状况，主动关怀并与老人交流互动，让老人在休闲的时候做自己想做的事，缓解老人在家独单无聊，缺少关爱与交流。
休闲娱乐场景：智能装置感知客厅有用户或多个用户或最后一个用户从其它房间走到客厅，同时时间为某电视剧开始的8点钟，主动关怀“主人，昨晚看的电视剧现在已经开始了，要不要一起看呀？”，如用户回复“OK”，便自动开启影音模式，自动关闭餐厅、厕所、卧室的灯光，调暗客厅灯光。当客厅小孩打闹声音太大时，智能装置主动关怀用户“小朋友，夜晚请不要大声喧哗，不要影响他人休息”。另外，在休闲时间段，智能装置感知用户经过装置距离到达预设值时，自动切换艺术展示内容，并可设置伴随合适的语音音量介绍该艺术品的来由、作者、特点、历史故事等内容，而且，当智能装置感知用户无兴趣离开时，则自动关闭语音内容，不给用户生活带来干扰。通过这样不经意、碎片化的时间中感染、影响与提升用户的艺术素养与知识，变被动为主动信息服务，充实用户业余生活。
就餐场景：在就餐时段（如定义7点/12点/18点，或机器学习分析调整用户通常就餐时间），智能装置感知有高温物品或人员聚集时，自动开启就餐模式，打开餐厅灯光，就餐轻音乐响起，关闭其它房间灯光（感知用户已离开），并主动关怀用户“主人，是不是准备吃饭了？”，用户回复“对呀，叫小孩们过来吃饭了”。
会客场景：智能装置感知主人开门让客人进入室内，主动关怀客人“尊贵的某某客人，欢迎来我家做客”，然后自动开启会客模式。当智能装置感知客人靠近时，自动切换显示预存的珍贵名画，吸引客人注意，增加主人与客人的沟通话题，同时也展示主人的兴趣爱好。当智能装置感知用户打开入户门，自动关怀用户“贵客是不是要走了？欢迎下次再来”。
会议场景：智能装置还可装设在会议室，而且，当用户通过移动APP端/PC端/平台等输入预约会议时间、参会人员、时长、会议主题、远程区域等相关信息。当智能装置感知到有用户在会议前的预设时段进入会议室，便自动启动显示屏并显示公司相关广告或介绍，且主动关怀用户“同事，你好！这个会议室将在**时间后有重要会议，请注意把握时间”，而且，自动启动会议室的投影、空调，并将温湿度调到合适值。当会议开始时间到时，智能装置主动提醒所有参会同事“会议时间到，大家准备开会”，并投屏显示会议汇报PPT内容。当会议结束时，主持人宣布“今天的会议到就到这，散会”，智能装置感知最后一个用户离开会议室，便自动关闭会议室灯光/窗帘/空调与显示屏。
展示场景：智能装置还可装设在展示厅，而且，用户通过移动APP端/PC端/平台/本地输入预约参观时间、参观单位、参观人员、讲解人员、陪同人员、参观时长、流程图、参观目的等相关信息。当参观客户到达展示厅时，智能装置感知讲解人员或多个客户已到达展示区域时，装置主动关怀“欢迎您到某某公司展厅参观……，如果你想了解更多可以向我提问，我帮您解答”或“欢迎参观某某板块内容，我公司在本板块主要……”，装置根据讲解人员或多客户人群的移动路径判断参观人员移动路径，已参观过的内容后续参观者可以随意提问互动，未参观过的内容系统默认保持静默状态，直到讲解人员到达，避免每个装置都发出声音干扰正常参观流程；当参观人群参观完最后一个展示区离开展厅时，智能装置感知最后参观者离开展示区域时，主动关怀参观者“某某公司相关领导，今天参观的主要内容就这些，欢迎您下次莅临指导”，智能装置自动打开展厅大门欢送参观者，当智能装置感知最后参观者离开感知区域后，自动关闭灯光/空调/显示屏等。
办公场景：智能装置还可装设在办公室，而且，在早上上班时段，前台或大厅的智能装置感知与识别用户，自动撤防并开启该用户所在卡位及走廊的灯光、窗帘及空调，并主动关怀用户“早上好！陈总这么早就来公司了!”或上班前10分钟，智能装置自动开启背景音乐，提醒用户离上班时间已经很近，请大家做好上班准备。在中午休息时段，智能装置自动播放背景音乐，提醒用户已经下班，并在下班后10分钟内关闭办公区灯光、窗帘，以便用户吃完中午饭后回公司午休。在下午上班前5分钟，智能装置自动开启背景音乐，提醒用户离上班时间已经很近，请大家做好上班准备。在下午下班时段，智能装置感知没有人的区域自动关闭该区域的灯光，直至所有人员离开，关闭所有办公室灯光、窗帘与空调，并安防布防。在加班时段，例如，晚上8点智能装置感知（或视频识别身份）加班人员经过，主动关怀用户“同事（视频识别身份后改称用户职称“陈总”），您还在加班呢，感谢您为公司所做的付出”或晚上10点装置感知（或视频识别身份）加班人员经过时，主动关怀用户“同事（视频识别身份后改称用户职称“陈总”），您应该回去休息了，多注意身体，工作可以明天做”等，对不同加班时间段，定义不同的问候语，让员工感受公司的温暖，增强员工的归属感与责任感。
酒店场景：智能装置还可装设在酒店客房，当智能装置感知酒店客人开门，自动打开客房灯光、窗帘（晚上为关闭）、空调等，并主动关怀客人，如“尊贵的某某客人，欢迎入住某某酒店，我是您酒店的管家，您有什么需求可以直接跟我讲”。当感知客人到达电视前且停留时间超预设值时，自动开启电视。若客人睡觉前跟智能装置讲“管家，我明天7点起床，要去开个会，现在睡觉了”，智能装置自动回复“好的，我准备7点叫您起床”。然后智能装置感知客人上床躺下睡觉，便自动启动睡觉模式，关闭灯光、窗帘，将空调调至合适温度，同时启动布防状态，如果门窗第一时间感知到人体，自动报警；如感知客人从床上下来，进入布防区域时，则视为正常活动。如果客人晚上起夜时，智能装置感知用户起床，自动开启起夜模式，自动开启暗灯光与厕所的暗灯光，当用户从厕所回来上床后超预设时间值时，起夜模式自动关闭。当智能装置感知到客人早上6点起床，自动播放起床音乐，并主动关怀用户，如“陈总，您定时7点起床，是不是您没有睡好？”或“陈总，现在时间6点，不过您早上有会要开，您现在可以起床了”或“陈总，昨天晚上睡觉还好吧，您上了3次厕所，是不是您肠胃不好，多注意身体！”。如果用户没有定时起床，此时已经8点30分，装置根据昨天客人12点睡觉计算睡眠时间，自动开启起床模式，从小到大的音量自动播放起床音乐，并主动关怀用户，如“陈总，我们酒店的早餐用餐时间是7点至9点，现在起床还能赶上最后的就餐时间”。智能装置在中午11点30分主动关怀客人，如“陈总，我们酒店最迟退房时间是12点，您需要续房吗？”或感知客人频繁移动，之后在客房入户门方向停留，加上11点30分左右时间，可判断客人可能准备退房，自动关怀客人，如“陈总，您是不是准备退房了”或用户直接语音告知装置“管家，我走了”，装置自动回复“一路平安，欢迎下次再次入住，我现在安排服务员查房”。
以上仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何纂改、等同替换、改进等，均应包含在本发明的权利要求范围之内。

Claims (9)

  1. 一种主动的智能控制方法，应用于智能装置，所述智能装置通讯连接家居装置，其特征在于，包括：
    步骤S10.实时获取至少一个多发多收的雷达传感器的感测数据，并将所述感测数据依序进行缓存，其中，所述至少一个多发多收的雷达传感器设置在智能装置上；
    步骤S20.开一特定长度的滑动窗口，并获取当前滑动窗口内的感测数据，而且，根据当前滑动窗口内的感测数据确定用户的运动信息，所述运动信息包括：运动轨迹、运动方向、运动速度；
    步骤S30.将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息，其中，所述现场信息包括下列中的至少一个：户型结构信息、室内空间信息、环境信息、时间信息；
    步骤S40.根据所述用户事件信息主动控制相应的家居装置和/或输出相应的提示信息。
  2. 根据权利要求1所述的主动的智能控制方法，其特征在于，所述智能装置的正面还设置有摄像头，而且，所述步骤S30之前，还包括：
    步骤S50.获取所述摄像头的图像数据，并对所述图像数据进行处理，以获取用户特性信息，所述用户特性信息包括下列中的至少一个：身份、表情、姿态、着装；
    而且，在所述步骤S30中，将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，包括：
    将所述运动信息、所述用户特性信息及现场信息分别输入到预先建立的用户事件模型中。
  3. 根据权利要求1所述的主动的智能控制方法，其特征在于，在所述雷达传感器的数量为多个时，
    所述多个雷达传感器级联设置；或者，
    至少一个雷达传感器设置在所述智能装置的上部，其它雷达传感器设置在所述智能装置的下部，且所述上部的雷达传感器的探测空间与所述下部的雷达传感器的探测空间至少部分重叠。
  4. 根据权利要求1-3任一项所述的主动的智能控制方法，其特征在于，在步骤S40中，输出相应的提示信息，包括：
    通过控制音频输出模块输出相应的提示信息；和/或，
    通过控制显示屏相应的提示信息；和/或，
    通过控制至少一个LED灯带输出相应的提示信息。
  5. 一种智能装置，与多个家居装置通讯连接，其特征在于，包括：
    至少一个多发多收的雷达传感器；
    缓存模块，用于实时获取所述雷达传感器的感测数据，并将所述感测数据依序进行缓存；
    运动信息获取模块，用于开一特定长度的滑动窗口，并获取当前滑动窗口内的感测数据，而且，根据当前滑动窗口内的感测数据确定用户的运动信息，所述运动信息包括：运动轨迹、运动方向、运动速度；
    事件信息获取模块，用于将所述运动信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息，其中，所述现场信息包括下列中的至少一个：户型结构信息、室内空间信息、环境信息、时间信息；
    执行模块，用于根据所述用户事件信息主动控制相应的家居装置和/或输出相应的提示信息。
  6. 根据权利要求5所述的智能装置，其特征在于，还包括：
    设置在正面的摄像头；
    特性信息获取模块，用于获取所述摄像头的图像数据，并对所述图像数据进行处理，以获取用户特性信息，所述用户特性信息包括下列中的至少一个：身份、表情、姿态、着装；
    而且，
    所述事件信息获取模块，用于将所述运动信息、所述用户特性信息及现场信息分别输入到预先建立的用户事件模型中，并根据所述用户事件模型的输出结果获取用户事件信息。
  7. 根据权利要求5所述的智能装置，其特征在于，在所述雷达传感器的数量为多个时，
    所述多个雷达传感器级联设置；或者，
    至少一个雷达传感器设置在所述智能装置的上部，其它雷达传感器设置在所述智能装置的下部，且所述上部的雷达传感器的探测空间与所述下部的雷达传感器的探测空间至少部分重叠。
  8. 根据权利要求5-7任一项所述的智能装置，其特征在于，还包括音频输出模块和/或显示屏和/或至少一个LED灯带，而且，
    所述执行模块，用于通过控制所述音频输出模块输出相应的提示信息；和/或，通过控制显示屏输出相应的提示信息；和/或，通过控制所述至少一个LED灯带输出相应的提示信息。
  9. 一种主动的智能控制系统，包括至少一个家居装置，其特征在于，还包括权利要求5-8任一项所述的智能装置。
PCT/CN2019/086265 2019-05-09 2019-05-09 主动的智能控制方法、系统及智能装置 WO2020223967A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/086265 WO2020223967A1 (zh) 2019-05-09 2019-05-09 主动的智能控制方法、系统及智能装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/086265 WO2020223967A1 (zh) 2019-05-09 2019-05-09 主动的智能控制方法、系统及智能装置

Publications (1)

Publication Number Publication Date
WO2020223967A1 true WO2020223967A1 (zh) 2020-11-12

Family

ID=73050997

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/086265 WO2020223967A1 (zh) 2019-05-09 2019-05-09 主动的智能控制方法、系统及智能装置

Country Status (1)

Country Link
WO (1) WO2020223967A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107438019A (zh) * 2016-05-27 2017-12-05 宇龙计算机通信科技(深圳)有限公司 智能家居学习控制方法、装置以及系统
US10132517B2 (en) * 2013-04-26 2018-11-20 Google Llc Facilitating ambient temperature measurement accuracy in an HVAC controller having internal heat-generating components
CN109088799A (zh) * 2018-09-28 2018-12-25 腾讯科技（深圳）有限公司 一种客户端接入方法、装置、终端以及存储介质
CN109188414A (zh) * 2018-09-12 2019-01-11 北京工业大学 一种基于毫米波雷达的手势运动探测方法
CN109445288A (zh) * 2018-09-28 2019-03-08 深圳慧安康科技有限公司 一种智慧家庭普及应用的实现方法
CN109634129A (zh) * 2018-11-02 2019-04-16 深圳慧安康科技有限公司 主动关怀的实现方法、系统及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10132517B2 (en) * 2013-04-26 2018-11-20 Google Llc Facilitating ambient temperature measurement accuracy in an HVAC controller having internal heat-generating components
CN107438019A (zh) * 2016-05-27 2017-12-05 宇龙计算机通信科技(深圳)有限公司 智能家居学习控制方法、装置以及系统
CN109188414A (zh) * 2018-09-12 2019-01-11 北京工业大学 一种基于毫米波雷达的手势运动探测方法
CN109088799A (zh) * 2018-09-28 2018-12-25 腾讯科技（深圳）有限公司 一种客户端接入方法、装置、终端以及存储介质
CN109445288A (zh) * 2018-09-28 2019-03-08 深圳慧安康科技有限公司 一种智慧家庭普及应用的实现方法
CN109634129A (zh) * 2018-11-02 2019-04-16 深圳慧安康科技有限公司 主动关怀的实现方法、系统及装置

Similar Documents

Publication Publication Date Title
CN109634129B (zh) 主动关怀的实现方法、系统及装置
US20240038037A1 (en) Systems, methods, and devices for activity monitoring via a home assistant
US10121361B2 (en) Smart hazard detector drills
JP6490675B2 (ja) 適切な瞬間において非警報ステータス信号を与えるスマートホームハザード検出器
CN109445288B (zh) 一种智慧家庭普及应用的实现方法
CN110275443A (zh) 主动的智能控制方法、系统及智能装置
Jiang et al. Smart home research
FI122787B (fi) Etävalvontajärjestelmä
US20190272724A1 (en) Baby monitoring with intelligent audio cueing based on an analyzed video stream
JP2008243197A (ja) 予期ユーティリティ制御デバイス
CN110599747A (zh) 一种用户提醒方法、装置及智能门铃系统
WO2020191755A1 (zh) 智慧家庭的实现方法及智能装置
JP5016968B2 (ja) 機器制御システム
Alesii et al. Short range wireless solutions enabling ambient assisted living to support people affected by the Down syndrome
KR20220094839A (ko) 스마트 홈 제어 방법 및 시스템
US11693903B2 (en) Information processing device, information processing method, and information processing program
WO2020223967A1 (zh) 主动的智能控制方法、系统及智能装置
JP2020141235A (ja) 機器制御システム、機器制御方法及びプログラム
CN114986532A (zh) 夺冠服务机器人及无命令式主动智能的实现方法
US20210076007A1 (en) Visitor-tailored property configuration
WO2020087515A1 (zh) 主动关怀的实现方法、系统及装置
EP3607521B1 (en) Method and apparatus for monitoring usage of a lighting system
KR20230083445A (ko) 스마트 홈 제어 시스템
CN116931439A (zh) 一种构建无命令式主动智能的实现方法、装置和设备
WO2020215204A1 (zh) 智能装置及其音量控制方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19927623

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19927623

Country of ref document: EP

Kind code of ref document: A1