WO2019140697A1

WO2019140697A1 - Interphone extension intelligent robot device

Info

Publication number: WO2019140697A1
Application number: PCT/CN2018/073660
Authority: WO
Inventors: 李修球
Original assignee: 深圳慧安康科技有限公司
Priority date: 2018-01-22
Filing date: 2018-01-22
Publication date: 2019-07-25

Abstract

Provided is an intercom extension intelligent robot device. The robot device comprises: a microphone array for receiving a device configuration command input by a user via voice; and a main control module, which is configured to perform a voiceprint recognition, and to identify a device brand, a device model and a device name of a smart device when the acquired voiceprint feature is consistent with a preset voiceprint feature. The main control module is further configured to search and load a communication protocol corresponding to the smart device from a protocol library, and to obtain a device identifier of the smart device through the communication protocol, so as to establish an association relationship between the device name, the device identifier, and the communication protocol of the smart device.

Description

Intercom extension intelligent robot device

Technical field

The invention relates to the field of smart home, in particular to an intercom extension intelligent robot device.

Background technique

With the advent of China's comprehensive well-off society in 2020, people are increasingly demanding the quality of life, and they are expecting more and more life, safety, health, comfort, convenience and enjoyment.

At present, the conventional indoor intelligent system mainly includes home control, indoor alarm, indoor visual intercom, video surveillance, etc. The correlation between these systems is not large, and also needs to be converted into Internet data. After the real estate is invested in basic intelligent equipment, users, property, manufacturers and merchants are all coping with the application or simply not using it. The convenience and wisdom of the user's investment in intelligent enjoyment is not high. Even if high-end users want to build smart homes, and because of the distributed and stacking integration of one device per function, users do not know how to choose parameters, products, functions, appearance and integration, which leads to the stagnation of smart home applications. Therefore, the market needs a device that can solve all problems of non-professional, afraid of investment, difficult to invest, difficult to select, difficult to install, and difficult to integrate.

If you want to achieve the control of these decentralized smart devices, the device often needs to have a built-in powerful intelligent hardware system and software operation platform, and also need to provide a variety of hardware expansion interfaces, so that users can expand the hardware and software smart system functions to achieve what users want. Smart home system features. However, there are hardware and software installations and software protocol docking problems. Currently, it belongs to the professional engineering field. The average user does not know what to do. This is one of the key reasons why smart homes cannot be universally applied. Then, how to integrate the decentralized intelligent devices in the user's house to realize smart homes on one device to realize control, so that integration, hesitation integration, fear of trouble integration, worry about budget expenses, low cultural level, and the elderly and children do not understand The user's solution to the burden is an unavoidable problem.

technical problem

The technical problem to be solved by the present invention is that the prior art has the defects that the home smart device is too dispersed, the user is passively integrated, and the communication protocol is difficult to integrate.

Technical solution

The technical solution adopted by the present invention to solve the technical problem is: constructing an intercom extension intelligent robot device, and communicating with the door machine and the management center, including a network module, a shooting module, a display module and a first power amplifier module, further comprising:

a storage module, configured to store, in the protocol library, a communication protocol corresponding to multiple different device types in advance;

a microphone array, configured to receive a device configuration command input by a user by using a voice, where the device configuration command includes a device brand of the smart device to be configured, a device model, and a device name specified by the user; and the manual array is disposed in front of the microphone array ;

a main control module, configured to perform voiceprint recognition on a device configuration command received by the microphone array in a device configuration mode, to obtain a voiceprint feature of the user, and determine the acquired voiceprint feature and a preset sound When the pattern features are consistent, the device brand, the device model, and the device name of the smart device are identified from the device configuration command, and the smart device is searched for and loaded from the protocol library according to the identified device brand and device model. a communication protocol corresponding to the device, and acquiring the device identifier of the smart device by using the communication protocol, to establish an association relationship between the device name, the device identifier, and the communication protocol of the smart device; and for controlling the first power amplifier The module plays configuration process information and configuration result information.

Preferably, the main control module is further configured to enter a pre-home mode when receiving a user-input unit door information sent by the preset unit door machine; and enter a home mode when the user enters the door information; Enter the away mode when getting the user's door-to-door information.

Preferably, the main control module is further configured to: when determining that the preset condition is met, controlling the display module to display an artwork image according to a preset play mode, wherein the preset condition is detected in the home mode No human body appears within the preset distance, or an artwork display instruction input by the user is received.

Preferably, the photographing module comprises at least one set of binocular cameras and at least one user-expanded back camera, the back camera is disposed opposite to the binocular camera, and the binocular camera and the back camera are in front of the lens Each set a manually connected manual bezel, and,

The main control module is further configured to combine the image captured by the back camera with the image captured by the binocular camera to form a 360-degree panoramic 3D image.

Preferably, the main control module is further configured to perform image analysis on a 3D image of a user image captured by the shooting module in an artificial intelligence assistant mode to obtain a current hairstyle information, makeup information, and clothing information of the user, and The defect information and the improvement information of the current image of the user are determined according to the plurality of image template information stored in advance, and the defect information and the improvement information of the current image of the user are output through the display module or the first power amplifier module.

Preferably, the main control module is further configured to: in the fitting mode, receive a user to select a specified clothing from the plurality of clothing image information, and integrate the body parameter information input by the user with the specified clothing to generate a test. a 3D image of the clothing effect;

The display module is configured to display a 3D image of the fitting effect.

Preferably, the method further includes an FM frequency modulation module and a second power amplifier module, and

The microphone array is further configured to receive a specified music or broadcast input by a user by voice;

The main control module is further configured to: after identifying the specified music or broadcast, search for a corresponding music file from the Internet or a plurality of pre-stored music files, or frequency the FM FM module to a designated channel, And controlling the first power amplifier module or the second power amplifier module to play the music file or the broadcast information of the corresponding channel.

Preferably, the main control module is further configured to send, in the video telephony mode, the 3D image and the voice information of the user captured by the shooting module to the real-time through the network module after establishing a connection with the designated contact. The mobile terminal or the intercom extension intelligent robot device of the designated contact, and the 3D image of the designated contact sent by the mobile terminal or the intercom extension intelligent robot device receiving the designated contact through the network module and Voice information, and controlling the display module to display the received 3D image and controlling the first power amplifier module or an external earphone to play the voice information to implement a 3D holographic video call with the designated contact.

Preferably, the method further includes a health detecting rod embedded on the casing, and

The health detecting rod is configured to detect health information of the user;

The main control module is further configured to record the health information detected by the user each time in the health check mode, and analyze the health change information of the user according to the health information in the preset time period, and when the abnormality is determined, The network module is pushed to the designated mobile terminal or the smart home cloud operation platform; and is also used to send the 3D image and voice information of the user captured by the shooting module to the remote doctor through the network module in the remote consultation mode. And receiving the prescription information and the medical order information sent by the remote doctor through the network module.

Preferably, a fingerprint sensor is further included, and

The storage module is further configured to store, in the fingerprint database, a plurality of fingerprint information set by the user and an alarm type corresponding to each fingerprint information in advance;

The fingerprint sensor is configured to receive fingerprint information input by a user;

An environmental sensor for detecting current environmental information;

The main control module is further configured to: when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, determine an alarm type corresponding to the input fingerprint information, and obtain current monitoring information and/or user health information and / or environmental information, and generate alarm information, and send the alarm information to the corresponding property management center or cloud operation platform or alarm center or designated mobile terminal through the network module.

Preferably, the main control module is further configured to acquire position information and posture information of the user according to the 3D image of the user captured by the shooting module in the game mode, and control according to the position information and the posture information. The display module.

Preferably, the microphone array is further configured to receive a device control instruction input by a user by using a voice, where the device control instruction includes a device name and a control instruction of the smart device to be controlled;

The main control module is further configured to perform voiceprint recognition on a device control command received by the microphone array to obtain a voiceprint feature of the user, and when determining that the acquired voiceprint feature is consistent with a preset voiceprint feature, Identifying, by the device control instruction, a device name and a control instruction of the smart device, determining a communication protocol corresponding to the smart device according to the identified device name, and using the communication protocol to use the control command Send to the corresponding smart device, so that the corresponding smart device executes the corresponding control command.

Preferably, the main control module is further configured to send, in the distance education mode, the 3D image and the voice information of the user captured by the shooting module to the remote teacher's terminal through the network module, and pass the The network module receives the 3D image and voice information of the teacher to implement distance education. .

Beneficial effect

By implementing the technical solution of the invention, the automatic configuration of the smart device in the home can be realized by simple voice, thereby eliminating the complicated operation of the user, and naturally attracting the user to expand the function requirement, so that the general user can expand the demand according to the needs of the smart system. The device thus promotes the popularization of smart systems.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work. In the figure:

1 is a logic structural diagram of Embodiment 1 of an interactive intelligent robot apparatus of the present invention. .

Embodiments of the invention

1 is a logical structural diagram of Embodiment 1 of an intercom extension intelligent robot apparatus according to the present invention. The intercom extension intelligent robot apparatus (hereinafter referred to as a robot apparatus, whose name is, for example, a "small ball") is disposed at a porch position of a resident. It can be connected with the door machine (community door machine, unit door machine, outdoor door machine) and management center, in addition to basic video intercom, surveillance, elevator linkage, (QR code, Bluetooth, IC card, Passwords, such as opening the door, can also be combined with the Internet, big data, and smart home cloud operation platform, art display cloud platform, 3D fitting, 3D interactive game, 3D video phone operation platform, image design cloud platform, The voice recognition cloud platform, the public service cloud platform, and other commercial service cloud platform services enable users to enjoy the convenience, comfort, enjoyment, speed, and artificial intelligence brought by the smart home. Let real estate enjoy the value enhancement brought by the basic investment and the continuous profit from the operation platform. Let the property enjoy the sustained profit from the user's proactive smart consumption, reduce the workload of the traditional system's complicated passive service and improve the property service level. Let the merchants enjoy the continuous profitability and product service enhancement brought by the user's proactive smart consumption. This kind of benign solution that benefits many parties is the real driving force for the smart family and the smart community to realize the smart city and smart China. Safe China, a healthy Chinese dream.

With reference to FIG. 1 , the robot apparatus of this embodiment includes a main control module, a network module, a shooting module, a display module, a first power amplifier module, a second power amplifier module, an input module, a storage module (TF memory card), an FM frequency modulation module, and a health Detection rods, environmental sensors, proximity transmission modules, telephone modules, power modules, etc. In addition, you can connect audio, camera, etc. through some expansion interfaces. The main control module is an intelligent CPU/MCU core group. The input module includes a microphone array, a touch button or a touch screen, and a fingerprint module. The network module includes a PON module, a WIFI module, a SIM card module, and a carrier module. Environmental sensors include temperature/humidity/illuminance sensors, CO/CO2/PM2.5 smoke sensors, formaldehyde sensors, and gas sensors. The short-range transmission module includes a 315/433MHz wireless receiving module, a ZIGBEE module, and a Bluetooth module. Finally, it should be noted that the robot apparatus further includes some intermediate processing modules, for example, audio and video codec, analysis, control, etc., for example, the first power amplifier module includes audio decoding and power amplifier, and the camera is connected with a video encoding module, The two power amplifier modules can be connected to the ceiling sound. The storage module can be externally connected with a TF memory card, and the microphone array is connected with an audio coding module, and the health monitoring rod is connected with an analysis module, a touch button or a touch screen connected with a control module.

The interface portion of the robot apparatus will be described below with reference to FIG. 1:

About the input interface: The bus interface is mainly to solve the communication docking problem of the indoor intelligent bus system protocol. The 315MHz and 433MHz wireless interfaces mainly solve the problem that the cable cannot be laid indoors. Users can install the wireless alarm front-end device on the bedroom or the door to wirelessly transmit the alarm signal to the device, so that the device can convert the alarm signal into the Internet signal and push it to the cloud platform. User mobile terminal. The DI interface mainly solves the direct connection device of the indoor switch quantity alarm signal, so that the device converts the alarm signal into an internet signal. Custom audio local sound output mainly solves human-computer interaction, video intercom, value-added service, alarm or false alarm, deter the illegal intruder and remind the user of false alarms, to reduce the system false alarm rate, confirm the system processing Normal working condition. Multi-RJ45 electrical port and PON optical port input, solve the problem of indoor intelligent equipment fiber-to-the-home, network intelligent device expansion and network transmission. The fingerprint input module solves the identity authentication and normal operation, and defines different levels of alarm help information. The wireless home control signal access solves the problem of smart home control application where the old and new residential users do not lay cables. CO, CO2, PM2.5, infrared detectors, human body sensing detectors, formaldehyde sensors, temperature and humidity sensors, illuminance sensors, smoke detectors and gas detectors are used to detect environmental information. The carrier module realizes the interconnection of any two-core transmission network signal and the floor carrier conversion optical device through the broadband power carrier technology, and the floor carrier conversion optical device interconnects the network signal through the optical fiber and the management center, thereby avoiding the incompatibility of the old project when the system is upgraded. The old problem of re-laying. The FM FM module mainly addresses the need for users to listen to FM radio through the device. The storage module mainly solves data storage problems such as monitoring, pictures, music, protocols, and program files. The Bluetooth module mainly provides Bluetooth beacons for automatic scenes and data communication functions of the user extension system via Bluetooth. The display module together with the control module mainly drives the display and control of the touch LCD large screen. The audio coding module is mainly connected to the microphone voice array input to realize human-computer interaction voice input. The medical analysis module is mainly connected to the health test stick. The user only needs to hold the test stick for 1 minute, and the system can analyze the current physical health data of the user. After the device analysis, the analysis result can be directly displayed and the user can be informed of the health condition and the precautions. Push relevant data to the user's mobile terminal and cloud service platform. The visual doorbell interface mainly solves the problem of visual doorbell access for user extension purchase.

About the output interface: The DO interface mainly solves the problem that the device controls the output of related devices such as alarm lights, sirens, switch valves, etc. during an alarm. The RJ45 interface mainly solves the problem of wired access to the external network, and is wired with the indoor and outdoor network routers to solve the problem of unstable WIFI signal or small delay and large traffic transmission. The WIFI interface mainly solves the problem that the device can be connected to the Internet through the WIFI wireless and the user indoor router when the device cannot be wired to the Internet, thereby solving the problem of user wiring troubles and high cost. The second power amplifier module mainly solves the user background music expansion requirement, and the user only needs to purchase the ceiling speaker to access the interface, and can play his favorite music through the manual operation or voice control of the device or the user mobile terminal. The telephone module user can implement a privacy video or voice call through a Bluetooth headset or a wired headset. The SIM card module mainly solves the problem that when the user does not have the wired broadband and the WIFI network, the SIM card wireless network is used to connect with the Internet; when the alarm is activated, the SIM card wireless network and the wired network can also be defined to simultaneously send alarm signals to the property management center and the user mobile terminal. And smart home cloud service platform, to ensure that the alarm information is not leaked and pushed to relevant people and service organizations.

In a robot apparatus according to an embodiment of the present invention, a storage module is configured to store a communication protocol corresponding to a plurality of different device types in a protocol library in advance; a microphone array is configured to receive a device configuration instruction that the user inputs by voice, and the device configuration instruction includes The device brand, device model, and user-specified device name of the smart device to be configured. In addition, a manual baffle is arranged in front of the microphone array, and the robot device can promptly remind the user to open the manual baffle when needed to protect the user's privacy when necessary. The main control module is configured to perform voiceprint recognition on the device configuration command received by the microphone array in the device configuration mode to obtain the voiceprint feature of the user, and determine that the obtained voiceprint feature is consistent with the preset voiceprint feature. The device brand, the device model, and the device name of the smart device are identified from the device configuration command, and the communication protocol corresponding to the smart device is searched and loaded from the protocol library according to the identified device brand and device model, and the communication protocol is adopted. The device identifier of the smart device is obtained to establish a device name, a device identifier, and a communication protocol association relationship of the smart device, and is also used to control the first power amplifier module to play the configuration process information and the configuration result information.

In this embodiment, the robot device has added a communication protocol compatible with each compatible smart device to the protocol library, for example: lighting panel class---X brand---XYZ model (model includes Zigbee protocol, dual loop control) And a number of characteristic parameters); home air conditioning class --- Y brand --- ABC model (model includes Wifi protocol and many other parameters) 2 sets; bus system central air conditioning class --- Z brand --- CDE model ( The model includes a number of characteristic parameters such as 485 bus protocol); wired visual doorbell type---B brand---ASD model (model includes TCP and other characteristic parameters). When the user needs to set up after expanding the hardware, the user first needs to confirm that the extended device and the device physical link must be connected or co-located on a network, and then tell the device to enter the system setting through human-machine interactive voice or manual operation, and then the voice tells the device to : "Small ball, small ball, start system setting (the robot device replies "has entered the system settings") --- increase the control system (the robot device replies "has entered the control system settings") --- increase the living room lighting control (robot device Reply "Created a living room lighting control interface for you, and named it the living room lighting control loop 1")---The brand is the X brand (the robotic device replies "The lighting control X brand has been selected for you")---The model number is XYZ Model (the robot device replies "The XYZ model has been selected for you", the protocol is successfully paired)---Save the configuration (the robot device replies "The configuration data has been saved for you")---Exit the device system (the robot device replies " Has already quit the system settings for you.) If the user wants to expand the living room Y brand appliance air conditioner, first connect to the home according to the air conditioner manual. Router Wifi network and voice device (directly connected to the device wired or wireless network without this step), and all other rooms of the same model air conditioning power supply off, "small ball, small ball, start system settings (robot device reply "has entered the system Setting ") --- increase control system (the robot device replies "has entered the control system settings") --- increase the living room air conditioning control (the robot device replies "has created a living room air conditioning control interface for you, and named the living room air conditioning control first Taiwan")---The brand is Y brand (the robot device replies "The air conditioner X brand has been selected for you")---The model is ABC model (the robot device replies "X-brand ABC model has been selected for you", agreement matching Success)---Save configuration (the robot device replies "Save configuration data for you")---Exit the device system (the robot device replies "has quit the system settings for you"), and then successfully open another room after pairing The same type of air conditioner power supply, the automatic configuration process of the same step. If the user wants to expand the central air conditioner, the user connects to the bus according to the wiring rules of the device, and the voice "small ball, small ball, start system setting (the robot device returns "has entered the system setting") - increase the control system (the robot device reply "has entered the control system settings") --- Increase the central air conditioning control (the robot device replies "has created a central air conditioning control interface for you, and named it central air conditioning control") --- the brand is the Z brand (the robot device replies "has For you to choose the central air-conditioning Z brand ") --- model is CDE model (the robot device replies "Z brand CDE model has been selected for you", the agreement is successful) --- assigned bedroom 1 for extension 1 (robot device reply "The bedroom 1 has been assigned to you for extension 1 control")---Save the configuration (the robot device replies "Save configuration data for you")---Exit the device system (the robot device replies "has quit the system settings for you") If the user wants to expand the video doorbell, after the user connects the cable according to the device wiring rules, the voice "small ball, small ball, start system setting (the robot device replies" Enter system settings")---Increase the visual doorbell system (the device returns "has entered the visual doorbell system settings")---add visual doorbell control (the robot device replies "has created a visual doorbell control interface for you, and Named as visual doorbell control")---The brand is brand B (the robotic device replies "The doorbell B brand has been selected for you")---The model is ASD model (the robot device replies "B has been selected for you B" Brand ASD model", the protocol is successfully paired)---Save the configuration (the robot device replies "The configuration data has been saved for you")---Exit the device system (the device replies "has quit the system settings for you"). This simple voice configuration eliminates the debugging method of the user's complicated operation, and can make the complicated system debugging become a simple debugging of the user, which naturally attracts users to expand the function requirements themselves, so that the general users can expand the demand according to their own intelligent system requirements. The equipment and functions, in order to promote the popularization of smart systems.

In the robot apparatus according to an embodiment of the present invention, after the smart device is configured, the device can be controlled. Specifically, the microphone array is configured to receive a device control command input by the user through voice, and the device control command includes to be controlled. The device name and control instruction of the smart device; the main control module is configured to perform voiceprint recognition on the device control command received by the microphone array to obtain the voiceprint feature of the user, and determine the acquired voiceprint feature and the preset When the voiceprint features are consistent, the device name and the control command of the smart device are identified from the device control command, and then the communication protocol corresponding to the smart device is determined according to the identified device name, and the communication is used. The protocol sends the control command to the corresponding smart device to cause the corresponding smart device to execute the corresponding control command.

In this embodiment, the smart device in the home can be controlled by a separate robot device, and the smart device can be controlled in combination with the user's mobile terminal and the artificial intelligence television, thereby satisfying the rigid requirement of the popularized application and reducing the user. Popularizing the investment threshold of smart homes can also guide and attract users to expand other functional investment consumption, and greatly improve the user experience and experience, and take into account the user's privacy needs. The robot device has a built-in microphone array and an audio output module, so that the user's own voice can wake up the system normally, and other people without authorization can not open the robot device. When the user has a visitor, the user can temporarily open the open mode. The authorized user can also control the home smart device within the authorized control range. The human-machine interaction can realize the video intercom, video surveillance, home control, and user extension system. Configuration services, Internet security alarms, environmental monitoring, music appreciation, art appreciation, remote door opening, fault repair and other community services, shopping and other life services, education and learning, health services and other functions.

In the robot apparatus according to an embodiment of the present invention, the main control module is further configured to enter a pre-home mode when receiving a user-input unit door information sent by the preset unit door machine; when the user enters the door information, Enter the home mode; enter the away mode when getting the user's door-to-door information.

In this embodiment, the robot apparatus has an automatic scene control function, specifically: when the user opens the door through the identity recognition in the building unit door, the robot apparatus automatically turns on the pre-home mode, for example, opens the indoor air conditioner according to the user's favorite environment requirement. Household appliances, improve the indoor environment; when the user walks to the entrance door, the user mobile terminal detects the Bluetooth beacon of the robot device, and the robot device automatically turns on the home mode; when the user mobile terminal Bluetooth is not turned on and cannot detect the Bluetooth line label, If the infrared detector on the robot device or the door magnet installed on the door detects that the user enters the door, the robot device will automatically turn on the home mode and greet the user and ask the user for the service request. When the user leaves home in the morning, the last user who leaves the home opens the door, the infrared detector of the robot device detects or the door magnet installed on the door detects that the entrance door is open and the user's mobile phone cannot detect the Bluetooth beacon of the robot device. The robot device will automatically say goodbye to the user. After the user closes the door, the system automatically turns on the home mode.

In the robot apparatus of the embodiment of the present invention, the main control module is further configured to: when the determination meets the preset condition, control the display module to display the artwork image according to the preset play mode, wherein the preset condition is back In the home mode, no human body is detected within the preset distance, or an artwork display instruction input by the user is received.

In this embodiment, the first description is that community O2O, e-commerce, advertising, online shopping and other value-added, due to the disruptive development of mobile Internet technology, most have been transferred to the user mobile terminal, of course, this is just the need to intercom in the current indoor The extension display has poor performance, the display is too small, it is not smart, the function is single, and the advertisement disturbs the people. The robotic device displays precious planes and 3D three-dimensional artworks to the mass users through realistic display technology, which can avoid the advertisements and disturb the people to increase the indoor art life, and can also cultivate the residents' sentiments, and also help ordinary users to analyze and judge the art works. It can generate value-added income for a long time, and can also analyze the characteristics of users' needs with big data and provide relevant services in a targeted manner. The user can select the art painting of his favorite mobile phone APP to push it to the display of the robot device display, or tell the robot device by voice, "small ball, small ball, I want to see the portrait of Mona Lisa", the robot device automatically displays the Na Lisha portrait, and record the favorite art painting data; if the art painting user does not change for a long time, the system will automatically interrogate the user's preferences on a regular basis, as well as the voice to explain the origin of each art photo, artistic characteristics, artistic connotation, market value Etc., attract and improve the user's ideological understanding, life experience, artistic accomplishment; to improve the user's aesthetic ability; cultivate personal morality, improve people's ideological understanding, cultivate sentiment; develop people's intelligence, increase wisdom, broaden understanding; Active entertainment, can be entertained, and promote people's physical and mental health.

The black screen keeps the energy saving state when the user leaves the home mode. When the system turns on the home mode, the display screen displays the user's favorite art picture; when the intercom is called, the unit door visitor video image is automatically displayed, when the intercom system is completed. Automatically restore the art display; when the system is not required to be displayed, the display continues to maintain the art display; when the user needs to enter the operation interface, the user can log in to the operation interface through human body sensing, fingerprint recognition, voice, and password; In the mode, the black screen of the display remains in a state of energy saving; when the system wakes up the user in the morning, the display resumes the art display.

In addition, in addition to the interactive robots in the porch position, the user can expand the installation of the intercom extension intelligent robot simplified version to display the artwork, and expand the simplified version. The wireless or wired and intercom extension intelligent robots share the art push platform to achieve the entire indoor art coverage.

In the robot apparatus according to an embodiment of the present invention, the photographing module includes at least one set of binocular cameras and at least one user-expanded back camera, and the back camera can be externally connected to the robot device through the expansion interface, and is opposite to the binocular camera, and the double Both the camera and the back camera are equipped with a manually connected manual bezel in front of the lens. When used, the user is reminded to open the manual bezel by voice to protect the user's privacy when necessary. Moreover, the main control module is further configured to combine the image captured by the back camera with the image captured by the binocular camera to form a 360-degree panoramic 3D image. The acquired 3D images can be used for other system applications such as 3D stereo video telephony, 3D stereoscopic monitoring, artificial intelligence assistant, 3D fitting, 3D interactive games, remote consultation. In addition, the robot device also reserves a multi-channel wired network camera access extension, which mainly solves the video surveillance expansion of the channel entrance of the general household entrance door, the back door or the stairs.

In the robot apparatus according to an embodiment of the invention, the main control module is further configured to perform image analysis on the 3D image of the user image captured by the shooting module in the artificial intelligence assistant mode to obtain the current hairstyle information, makeup information, and clothing of the user. The information is determined according to the plurality of image template information stored in advance, and the defect information and the improvement information of the current image of the user are determined, and the defect information and the improvement information of the current image of the user are output through the display module or the power amplifier module.

In this embodiment, firstly, the virtual assistant that assists an individual in accomplishing multiple tasks or multiple services is a technology integration based on the robot device, and provides a new human-computer interaction service in combination with the environmental sensor. Assistants, and on this basis, can also implement a large number of platform operations applications. Provide users with such things as booking air tickets, shopping, taxiing, image design, appointment registration, etc. For example, before the user goes out in the morning, he stands in front of the intercom remote intelligent robot and tells the device. “Small ball, small ball, today I want to see an important customer, how do I pay attention to my image?” The device is based on the intercom extension. The multi-camera built into the intelligent robot ingests the user's 3D image to analyze whether the user has combed the hair, the beard, and what clothes to wear, and then the device will tell the user how to pay attention to the dress, hair and makeup, and give guidance when changing clothes in real time. For another example, when the user cooks, they find that there is no salt. Before the intercom remote intelligent robot, the voice tells the device. "Small ball, small ball, I want to buy a packet of salt (the robot device replies "has helped you find three in the nearby store. Brand salt, the price is ..., you need that brand ")", the user tells the device "I want Haiyan No. 1 (robot device reply: you have purchased Haiyan No. 1, please authorize payment)", the user passed After completing the system payment after fingerprint authentication, you only need to wait for the delivery person to send salt to the door at home. For example, in the morning, the user asks for the device before going out. "Small ball, small ball, how is the weather today? (Robot device reply: There is light rain on cloudy day, temperature is 10 degrees, outdoor PM2.5 value is 210 heavy pollution, please go out Rain gear, wear a cold jacket, and bring a good mask)". The user closes the home to warm in the winter, and the robot device senses that the indoor CO2 and the air are dry when the household is closed for a long time. The robot device voices to remind the user that “the current indoor CO2 exceeds the standard, please open the window (the window does not have an automatic window, and there is no user of the fresh air system, there are Fresh air users can automatically switch on fresh air ventilation)" or "Current indoor relative humidity is less than 20%, please turn on the humidifier or put a basin of water in the room, pay attention to the water to add water" (users without linkage humidifier), etc. Service user scenario.

In the robot apparatus according to an embodiment of the present invention, the main control module is further configured to receive, in the fitting mode, the user selects the specified clothing from the plurality of clothing image information, and performs physical parameter information input by the user in advance with the designated clothing. Integrating to generate a 3D image of the fitting effect; the display module is for displaying a 3D image of the fitting effect.

In this embodiment, the robot device has built-in 3D fitting software, and according to various parameters of the user's body, such as leg length, arm length, hair style, skin color, etc., the user can freely select the clothes that create the 3D model, and the try-on process can be tried. In the middle, you can change the angle at will, and see the fitting effect from every angle through the naked-eye 3D display. After trying on it, you can save the share, or you can change your style, color, etc. to save unnecessary troubles in shopping in the store.

In the robot apparatus according to an embodiment of the invention, the microphone array is further configured to receive the specified music or broadcast input by the user by voice; the main control module is further configured to: after identifying the specified music or broadcast, from the Internet or pre-stored Searching for the corresponding music file in a plurality of music files or the Internet or frequency-modulating the FM module to a designated channel, and controlling the first power amplifier module or the second power amplifier module to play the music file or the broadcast information of the corresponding channel.

In this embodiment, the robot device has built-in two-channel audio, high-power amplifier, stereo output, built-in multi-equalization mode, and also supports FM FM broadcasting, which satisfies the needs of general users for home background music and broadcast appreciation. The user can select his favorite music and FM FM station to play and enjoy through the human-computer interaction voice and software menu of the robot device and the mobile terminal. For example, "small ball, small ball, I want to listen to Jackie Chan singing male self-strength song", the robot recognizes the user voice command, automatically play the corresponding song. When the home mode is activated, the device can automatically play the music that has not been played last time, and can also replay the user's favorite music.

In the robot apparatus according to an embodiment of the present invention, the main control module is further configured to: after establishing a connection with the designated contact in the video telephony mode, pass the 3D image and voice information of the user captured by the shooting module to the The network module sends the mobile terminal or the intercom extension intelligent robot device to the specified contact in real time, and receives the specified contact sent by the mobile terminal or the intercom extension intelligent robot device of the designated contact through the network module. a 3D image and voice information of the person, and controlling the display module to display the received 3D image and controlling the power amplifier module or the external earphone to play the voice information to implement a 3D holographic video call with the designated contact . It should be noted that when the designated contact receives the 3D image, the 3D display can be directly performed on the robot device, the 3D display can be performed on the mobile terminal, and the 3D image can also be viewed through the VR device.

In this embodiment, the robot device can capture 3D video images between the user and the user through the naked-eye 3D display screen and the plurality of stereo cameras, and can realize the 3D video communication between the user and the user; and the user can extend the back camera and the front multiple devices. The camera takes the user's 3D stereo image together with the user VR glasses and the user mobile terminal holographic 3D software and device to realize the user VR stereo live video call and the user mobile 3D holographic video call. In addition, because the device is online 24 hours in the fixed porch position, it completely replaces the function of the indoor telephone. When the user has a confidential call requirement, the user can also listen to the other party's voice through the user's extended Bluetooth headset or wired headset. Users can realize 3D VR visual, 3D holographic visual, voice, text, pictures and other ways of communication, and also have pictures and texts, intuitive image and good experience.

In the robot apparatus according to an embodiment of the invention, the health detecting bar is used for detecting the health information of the user; the main control module is further configured to record the health information detected by the user each time in the health check mode, and according to the preset time period. The health information analyzes the user's health change information, and when it is abnormal, it is pushed to the designated mobile terminal or the smart home cloud operation platform through the network module; and is also used to scan the user of the shooting module in the remote consultation mode. The 3D image and voice information are sent to the remote doctor's terminal in real time through the network module, and the prescription information and medical order information sent by the remote doctor through the network module are received.

In this embodiment, the robot device has a built-in health detecting rod, such as a quantum health detecting rod. The user only needs to remove the health detecting rod from the side of the device and hold the health detecting rod for one minute, and the system automatically analyzes the user's cardiovascular and cerebrovascular diseases and stomach. Basic health data such as bowel function, colon function, biliary function, kidney function, bone density, blood sugar, trace elements, vitamins, coenzymes, heavy metals, basic physique, allergies, obesity, skin, eyes, collagen and blood. Record and analyze health changes and actively push them to user smart terminals and smart home cloud operating platforms. In addition, using the built-in multiple cameras to capture the user's stereo image and voice to interact with the doctor to achieve remote consultation, the conventional disease doctor can directly open the prescription, and the user can show the medicine prescribed by the doctor to purchase the medicine.

Further, the robot device may further analyze and process the health data detected by the health check bar, the health data of the user when the user is sick, the data of the remote consultation, and the health data is actively pushed to the user mobile terminal and the smart home. The cloud operation platform, based on the user data collected actively and passively, helps the user to implement personalized health services such as health monitoring, tracking, consultation, reminding, and appointment registration through big data analysis.

In the robot apparatus of the embodiment of the present invention, the storage module is further configured to store a plurality of fingerprint information set by the user and an alarm type corresponding to each fingerprint information in the fingerprint database in advance; the fingerprint sensor is configured to receive the fingerprint information input by the user. The environmental sensor is configured to detect current environmental information; the main control module is further configured to determine an alarm type corresponding to the input fingerprint information when determining that the input fingerprint information is consistent with the pre-stored fingerprint information, and obtain current monitoring Information and/or user health information and/or environmental information, and generating alarm information, and transmitting the alarm information to the property management center or the cloud operation platform or the alarm center or the designated mobile terminal through the network module.

In this embodiment, the robot apparatus is provided with an access alarm function. When the robot device senses an alarm, it automatically pushes the alarm help information and the authorized video, picture or recording to the property management center or the user mobile terminal or the cloud operation platform, and uses the robot device to locally customize the voice alarm or man-machine. Interact to solve the indoor false positive problem, avoid the actual problem of "wolf coming" every day, let the user intuitively judge whether there is a false alarm. Custom voice alarms or human-computer interactions also let the user know that the platform has been alerted or that the current alarm settings are working properly. If there is a false alarm, the alarm will be revoked as soon as possible, and defining the voice alarm in the armed state can also deter the illegal intruder.

In addition, the robot device utilizes multiple interface design, supports multi-zone wired and wireless alarm signal access, solves the problem of home alarm information access that has installed wired alarm equipment, and also solves the problem that no alarm device is installed, and does not want to damage the decoration installation wired alarm. The problem of installing the wireless alarm device in the home of the device; the built-in battery of the device ensures that the alarm help information can be normally pushed to the user mobile terminal and the smart home cloud operation platform when the power is off. In order to ensure that the zero-reporting specification requirements are met, all alarm information is alarmed to both the user mobile terminal and the smart home cloud operation platform through the network and the short message, and the alarm information is encoded by a specific function to achieve the artificial intelligence and automatic processing requirements of the operation platform.

Regarding the fingerprint sensor, the usual user can open the system operation interface by fingerprint identity, or can define different fingers as different alarm levels in an emergency, and automatically alarm to the cloud service station or the user mobile terminal. About environmental sensors, including CO/CO2/PM2.5/smoke/gas sensor/formaldehyde sensor, when the environmental sensor related indicators exceed the standard, the system automatically uploads the indoor excess data to the property management center or cloud service platform and user mobile terminal. Or open the indoor windows, exhaust new fans, etc. The environmental sensor also includes a temperature and humidity sensor. When the indoor temperature and humidity exceed the standard, the system automatically uploads the indoor over-standard data to the cloud service platform and the user mobile terminal or linkage to turn on the air conditioner, humidify and dehumidify. The environmental sensor also includes a light sensor that automatically turns on the interior lights and curtains as the user moves indoors and the light dims. In addition, regarding the human body sensor, when the human body approaches, the system can select to trigger a switch from the art display to the operation main interface. Regarding the infrared sensor, when the user opens the door at night, the system detects that the user opens the door, the system automatically turns on the home mode and greets the user with voice, and the user can also voice the device to tell the user's own needs.

In the robot apparatus according to an embodiment of the present invention, the main control module is further configured to acquire the position information and the posture information of the user according to the 3D image of the user captured by the shooting module in the game mode, and according to the position information and The attitude information controls the display module.

In this embodiment, the robot device is installed and installed through the built-in 3D interactive game software and the 3D binocular camera, combined with the video analysis software and the 3D naked-eye display structure 3D interactive game function, and can also be purchased by the user to expand the purchased 3D interactive game device and device. The 3D interactive game software is used together to implement the 3D interactive game function, and the extended interactive device can be interconnected with the robot through multiple interfaces such as Bluetooth, HDMI, and WIFI. For example, the robot device collects the azimuth movement and change of the user's body part on the user's stereo video stream through the binocular camera, and corresponds to the virtual user in the display screen. When the user hands out the punch, the virtual user character also punches, when the user lifts the foot Then the virtual user character is also lifted, and when the user retreats, the virtual user character is also retired, etc., realizing the behavior of the real user and the virtual user character, and the virtual game scene such as punching and falling objects realizes the 3D interactive game function. This not only attracts users to invest and consume, but also allows users to enjoy happiness and enjoyment in interaction. Every household usually does not have the general rigid demand for 3D TV to play 3D interactive games or watch 3D videos. The robots that come with the house are equipped with this function, so only users need to invest a small amount of money to realize 3D interactive functions. The demand is very attractive.

In the robot apparatus according to an embodiment of the present invention, the main control module is further configured to send the 3D image and the voice information of the user captured by the shooting module to the remote teacher's terminal in real time through the network module in the distance education mode. And receiving, by the network module, the 3D image and voice information of the teacher to implement distance education.

In this embodiment, the robotic device integrates multi-disciplinary development achievements and represents the forefront of high-tech development. Robot education involves multiple fields of information technology. It incorporates a variety of advanced technologies, and the teaching of robotic devices will be given to users. The information technology curriculum has added vitality and has become an excellent platform for cultivating the comprehensive ability and information literacy of primary and secondary school students. It can make children learn theoretical knowledge more easily, exercise their willpower, stimulate their interest in learning and learning ability; education and learning adapt to the user group is suitable for all ages.

In the robot apparatus according to an embodiment of the present invention, the robot apparatus reserves a visual doorbell interface, and the user can purchase a wired or wireless video doorbell to interconnect with the robot apparatus to implement an out-of-door call, monitoring, and alarm detection function. The call function is implemented as follows: the visitor comes to the door and presses the video doorbell button, the display of the robot device automatically displays the image of the visitor, and a call sound is issued to remind the user that the visitor has arrived. The visual doorbell call data is automatically pushed to the user's mobile terminal by the robot device to remind the user that the visitor has arrived outside the door. The realization process of the monitoring function is: the user is in the indoor voice "small ball, small ball, I want to see if there is anyone outside", and the real-time monitoring image of the video doorbell camera is automatically displayed on the display of the robot device. The process of detecting the alarm function is: when someone comes to the video doorbell, even if the video doorbell is not pressed, the system will automatically record the image or picture of the current outsider, and when the data is recorded, it will be automatically pushed to the user. terminal.

In the robot apparatus according to an embodiment of the present invention, the implementation process of the indoor extension is:

When the user approaches the unit door machine, when the unit door machine recognizes that the user is a registered user, the unit door is opened, and then the registered user's robot device is automatically notified, and the home preparation mode is automatically turned on when the indoor state is unmanned. The indoor air conditioner and the household appliance are turned on according to the user's preference environment, or the indoors are automatically voiced to remind the indoor relatives when the person is in the state, and the user has returned to the building unit door. Wherein, the unit door machine can identify the user's identity through the voiceprint or video or the authorized user's Bluetooth beacon. Specifically, the user opens the door through the voice with the voiceprint recognition, such as "small ball, small ball, help me." Open the door", automatically open the unit door when it is recognized as a registered user. For another example, the user opens the door through the built-in 3D binocular camera of the unit, and opens the unit door when it is recognized as a registered user.

When the visitor calls the indoor robot through the unit door machine, if the indoor user is not at home, the call information is automatically pushed to the user's mobile terminal, and the user can perform real-time voice intercom and open the door with the visitor through the mobile terminal. The robot device not only supports new line access such as network cable and optical fiber, but also supports any two-core broadband carrier signal access or SIM card wireless and WIFI wireless access, realizing the data on the basis of the old project without changing the existing transmission line. Communication function.

In the robot apparatus according to an embodiment of the invention, the video monitoring function is implemented as follows: the robot apparatus is installed with multiple cameras. For example, the top camera is mainly used for video monitoring or photographing when the alarm is linked, and the binocular camera simultaneously takes the user's 3D stereo image. It is also possible to take a user's 3D stereoscopic image together with multiple cameras. Users can customize time monitoring and playback, and actively push real-time monitoring images or photos to the user's mobile terminal and smart home cloud operation platform when the alarm is called for help the user and the platform to confirm the indoor situation. In addition, the user can also manually rotate the camera flapper camera to monitor the camera normally to ensure user privacy requirements.

In summary, the robot device is a smart home general manager robot, which opens up a new mode of operation for smart home popularization, specifically:

1. Establish an intercom extension robot main assembly that just needs to be replaced. Using visual intercom, indoor alarm and other just-needed intelligent systems as the entry point, the intelligent and powerful device comprehensively replaces and optimizes the internal intercom extension and alarm gateway, and expands all other intelligent system functions required by users to meet users. Achieve smart family needs.

2. Promote the benign development of smart families by adopting a combination strategy of “sending first and then sucking” on real estate. Under the condition that long-term operation of multi-system and multi-platform can recover the input cost target, attracting real estate investment in the early stage; attracting and guiding users to actively consume under the goal that users can buy practical services and experience after spending small money. Only by mobilizing users to just consume, can we really promote the popularization and application development of smart families.

The intercom extension intelligent robot integrates the core functions of the smart home. When the user purchases a house, the real-time interactive intercom intelligent robot cannot integrate the peripheral expansion device into one device and send it to the user, such as the video doorbell front end and lighting control. Panel, air conditioning control panel, electric curtain, smart socket, Bluetooth phone headset, wired headset, 3D rear view camera, 3D interactive game device, wireless alarm detector, gas detector, indoor positioning Bluetooth beacon, indoor surveillance camera, background Music ceiling speakers, mobile terminal holographic display devices, VR glasses and other expansion devices require users to purchase. Because the core function device already exists, and the system expands the function, the system can complete the setting by voice, which is simple and practical. Users only need to invest a small amount of money to purchase hardware to achieve the required smart functions, so it is aimed at attracting users to consume.

The robot device has built-in indoor and outdoor alarm operation platform, art display, artificial intelligence assistant, 3D fitting, 3D interactive game, remote consultation, education and learning, 3D video phone and other cloud operation charging platform software, cloud monitoring, cloud intercom, The basic free operation software such as cloud home control is available for users. With these off-the-shelf functions of the device, it guides and attracts users to invest a small amount of money to purchase the monthly or annual usage rights of the software to realize the full functionality of the smart home.

3. To promote the popularization and application of smart home systems through effective value-added operations to benefit multiple parties. For the user, investing a small amount of money to purchase the intelligent intelligent hardware and the built-in charge of the novel smart home extension software usage right outside the device, the smart home service is convenient, comfortable, enjoyable, fast, artificial intelligence; for the developer, the early stage Investing funds per household to match the extension intelligent robot, that is, to enhance the value of real estate, but also to establish a large database of real estate group-level household users, to decide business investment according to big data and provide other special services for users, and can also be divided into users with product vendors. The profit of the indoor expansion intelligent products can also charge the operating fee for the charging operation platform running on the device. Through these late charging, the previous input cost can be earned back and create profit. For the property, the interactive intelligent robot supports the PON optical fiber transmission. The failure rate is extremely low, the maintenance amount is very small, and the workload of the property is reduced. The large database of household users at the property group level can be established, and the commercial investment and other special services can be provided according to big data; the user expands the intelligent hardware although the system Simple setup, but user It is difficult to install by yourself, so the property electrician can assume this role. After installation, it can also be responsible for simple maintenance such as replacing equipment. It can also charge operating expenses for the toll operating platform running on the device; through these methods, it can create continuous profits for the property. Improve the property and user interaction and service satisfaction; for the product supplier, the interactive intelligent robot of the intercom is powerful, the operation mode is novel, and it is easy to be accepted and popularized by users, properties, developers and other parties, so it can be quickly mass-produced. The related component supply chain can also receive a large number of orders to promote the rapid development of the entire industry chain; the cost naturally decreases after mass production, creating more profit space for the company; for the operation platform, through the intercom remote intelligent robot as the operational hardware front-end platform The service can be implemented to every user in each family; at the same time, the establishment of a large database based on each user of each family across real estate is the real big data, and can provide users with more featured services according to big data. Improve user experience, happiness, safety Sense, comfort and convenience; for the merchant, through the intercom extension intelligent robot for the commodity sales hardware front-end platform, you can find the real demand ontology for all kinds of goods; at the same time establish a large database based on each user of each family, according to Big data provides users with more featured products.

Finally, it should be noted that the robot device adopts standardized photo frame design, high-fidelity display technology, integrated multi-signal multi-system, artificial intelligence, human-computer interaction, rich value-added services, and general software extension applications for later users, such as WeChat. , QQ, securities investment, etc.; simple installation and commissioning, good user experience; modular design, convenient fault repair; cloud service platform can also provide users with special needs through accurate and rapid analysis and judgment of big data, that is, with the basic functions of mobile phones . In addition, the robot device also has the functions of visual intercom and indoor alarm gateway, smart home hub function, robot perception/learning/analysis and execution functions, 3D interaction/communication/games, and art appreciation/music appreciation. Features, health testing and service features, and more. The system and the device actively mobilize the real estate pre-investment and the user's active consumption kinetic energy through the combination strategy of “first investment and then profit” for the real estate, and systematically solve all the intelligent needs of the user's family, and To create a steady stream of value and profit for real estate, property, businesses, and platforms, to make the whole smart home and smart community popular and applicable, and to do their part to realize the dream of smart city, smart China, safe China, and healthy China.

The invention also constructs a smart home cloud service system, which is mainly composed of a user mobile terminal APP, a robot device, an indoor intelligent device, an art trading platform, an artificial intelligence assistant platform, a distance education platform, a health and remote consultation service platform, and the like. Service platform, 24-hour smart home cloud operation platform, property management center, 110, 119, 120 alarm and rescue center and insurance company.

The user mobile terminal APP mainly uses the fingerprint recognition of the smart phone, the microphone array to recognize the voice and other mobile terminal sensors, and realizes the different alarm level alarm alarms and local custom voice output by using the software algorithm, and the art display push and transaction. Mobile phone indoor positioning, automatic scene control, video intercom, active and passive video surveillance, multi-mode door opening, videophone, health management, distance education, community service, life service, human-computer interaction, free operation control or manual control .

The robot device is the general manager of the indoor intelligent system, and can maintain data interconnection with the user mobile terminal, artificial intelligence TV, etc., together with the property management platform and the smart home cloud operation platform to build a real resident smart life, smart family, smart community .

Smart Home Cloud Operation Platform mainly provides users with residential indoor multi-signal Internet alarm, outdoor user mobile alarm, rescue and other security management, information consultation, insurance, art display and transaction, education and learning, 3D video telephony, artificial intelligence assistant, 3D Interactive games, 3D fitting, automatic configuration library establishment, health testing service management and other services. It mainly includes video intelligence and recognition analysis module, voice voiceprint analysis module, picture analysis module, GPS positioning analysis module, Wifi and Bluetooth positioning information analysis module, center manual parallel operation software, art display push module, education learning module, artificial intelligence assistant. Module, 3D game module, 3D fitting module, 3D video phone and other value-added service push module, operation data recording module, large-screen splicing display module, data group module, network security module, artificial intelligence automatic service module, three major operators communication Module, public security system communication module, medical system communication module, health data module, UPS power supply system module, precision air conditioning group and so on. The platform receives the intercom extension intelligent robot to compile the user's service requirements into specific pre-defined functions, and then pushes them to the cloud service platform through SMS and network. The cloud service platform automatically decodes various service requests and related data automatically, and the data is automatically processed. After that, the platform divides the data into different types and levels and compiles them into specific pre-defined functions, and pushes them to the intercom extension intelligent robot, the user mobile terminal, the user emergency contact APP, the property center platform of the user's location, and the user through the network. The devices and organizations of the related service users such as the 110, 119 and 120 alarm center software in the real-time location allow the users to obtain the required services and guarantees to comprehensively improve the level of service users and enhance the user experience.

The community property management center platform mainly provides indoor automatic alarm and rescue security management, video surveillance, video intercom, extended function equipment installation and maintenance, O2O, life service, community service, information consultation, health service management for group real estate users. And a management platform for outdoor security services. It can be a single community property management center, or a multi-community property service group, which mainly includes video intelligence and identification analysis module, voice voiceprint analysis module, picture analysis module, Wifi and Bluetooth positioning information analysis module, and center manual parallel operation software. , operation data recording module, large screen splicing display module, data group module, network security module, community intelligent integration platform, community property operation platform, artificial intelligence automatic service module, operator communication module, public security system communication module, UPS power supply system Module, precision air conditioning group, etc. The platform receives the robot device to compile the user's service requirements into specific predefined functions, and then pushes them to the cloud service platform through SMS and network. The cloud service platform automatically decodes various service requests and related data automatically. After the data is automatically processed, the platform Divide the data into different types and levels and compile them into specific pre-defined functions, and push them to the intercom extension intelligent robot, user mobile terminal, user emergency contact APP, the property center platform where the user is located, and the user real-time location. The 110, 119 and 120 alarm center software and other related service users' devices and institutions. At the same time, the platform will automatically display the demand information and display the voice alarm, remind the duty security to timely grasp the residents' alarm and other service needs, and arrange the nearest security to the site. Residents' alarm and service needs. If the nearest security site has already handled the needs of residents' services, the security guards on duty should report the implementation and false positives through software feedback, so that the platform can carry out subsequent management work. All user demand information groups are synchronized with community information, which plays a role of unified management, and also plays a role in supervising the quality and frequency of service of community managers. Let users get the services and guarantees needed to improve the level of service users and enhance the user experience.

The 110/119/120 alarm center receives a specific predefined function from the smart home and property management cloud service platform network to quickly decode the user name, address, contact information, emergency contacts, family members, real-time geographic location. , alarm type, image analysis platform results, site environment, peripheral equipment, motion trajectory, user health data and other information, plus video platform analysis results, live voice platform analysis results, and other clues of the initial case of the platform, alarm The center software will automatically display the alarm information and voice alarm to remind the police to timely grasp the residents' alarm needs, and quickly dispatch the police force to rescue the user and call the evidence afterwards.

The smart home cloud service system of the invention has the following characteristics: (1) system aspect: integrated multi-technology, multi-signal, multi-network, multi-interface, multi-sensor, multi-function, multi-system, microphone array voice input, etc., for smart families The core foundation supports users to expand their smart home functions. (2) Hardware: Adopt the most advanced intelligent CPU/MCU chip and large memory chip to meet the core computing power and speed requirements of system application for a long time; (3) Appearance: adopt standardized photo frame design, ie It meets the requirements of post-value-added operation services, avoids the waste of resources and pressure caused by frequent appearance competition, and greatly enhances the quantity and quality of the internal content of the device to meet the soft needs of users; at the same time, it is modular in design and convenient for fault repair. (4) Just need to enter the entrance: Looking at the indoor intelligent system, except for the video intercom and alarm system, the system requirements are optional and optional, and the intercom and alarm are the real estate investment system, not Users need to invest; selective users can choose you or choose him, the demand is unstable and continuous. Therefore, the patented device design is the entry point for replacing the rigid requirement of the indoor intercom extension, integrating the rigid demand functions such as intercom and alarm, and also integrating video surveillance, music and broadcast appreciation, environmental monitoring, automatic scene, man-machine Optional functions such as interaction and fingerprint recognition. (5) Investment and consumption: In the past, investment in residential intelligent systems was generally a one-time investment by developers. There was no value-added income, and there were problems and failures that could not be dealt with. The only purpose was to meet the standard requirements of residential buildings. It is not necessary to repay this; to grasp this just-needed design, the function of this patented device is to replace the traditional Chinese intelligent device that is just a versatile intelligent device. However, the complete function of the robot and the realization of the extended software function also require the user to invest in construction, thus playing a guiding role. In order to attract users to invest and consume, the selective demand of users is just needed, thus promoting the sound development of the entire industry chain. (6) User experience: The patented device is a device that conforms to the characteristics of innovation, cross-border integration, reshaping structure, openness, and connection of all Internet features; integration of different systems, signals, interfaces, and brand smart devices after hardware connection, users and The device human-computer interaction voice can quickly complete the system integration; other software applications on the device operation platform are consistent with the user smartphone software application, and the user will quickly get started and skillfully apply, thus having a good user experience. (7) Operational value-added inspection: The patented device is like a built-in airport. On the device operation platform, not only can the traditional intelligent function be realized, but also the personal Internet security alarm operation, art appreciation, artificial intelligence assistant, 3D can be realized. Fitting, 3D interactive games, 3D video and voice calls, health testing and services, education and learning, exchange shopping and many other soft value-added services. This device consumption is sent to the owner by the developer, so the owner user will choose the software and hardware service that he needs according to his own preferences; the value-added operation platform service selected by the user can create value, user, real estate, property. The platform, the merchants can all take the necessary value-added services, and the value created is continuous, so that the entire industry chain of the smart system can form a virtuous circle.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any tampering, equivalent substitution, improvement, etc., within the spirit and scope of the invention are intended to be included within the scope of the appended claims.

Claims

The invention relates to an intercommunication intelligent robot device, which is connected with a door machine and a management center, and includes a network module, a shooting module, a display module and a first power amplifier module, and is characterized in that:

a storage module, configured to store, in the protocol library, a communication protocol corresponding to multiple different device types in advance;

a microphone array, configured to receive a device configuration command input by a user by using a voice, where the device configuration command includes a device brand of the smart device to be configured, a device model, and a device name specified by the user; and the manual array is disposed in front of the microphone array ;

a main control module, configured to perform voiceprint recognition on a device configuration command received by the microphone array in a device configuration mode, to obtain a voiceprint feature of the user, and determine the acquired voiceprint feature and a preset sound When the pattern features are consistent, the device brand, the device model, and the device name of the smart device are identified from the device configuration command, and the smart device is searched for and loaded from the protocol library according to the identified device brand and device model. a communication protocol corresponding to the device, and acquiring the device identifier of the smart device by using the communication protocol, to establish an association relationship between the device name, the device identifier, and the communication protocol of the smart device; and for controlling the first power amplifier The module plays configuration process information and configuration result information.
The intercom extension intelligent robot apparatus according to claim 1, wherein

The main control module is further configured to enter a pre-home mode when the user sent by the preset unit door machine enters the unit door information; when the user enters the door information, enters the home mode; When the user leaves the home to close the information, enter the home away mode.
The intercom extension intelligent robot apparatus according to claim 2, wherein

The main control module is further configured to: when the determining that the preset condition is met, controlling the display module to display the artwork image according to the preset play mode, wherein the preset condition is that the preset distance is detected in the home mode No human body appears inside, or an artwork display instruction input by the user is received.
The intercom extension intelligent robot apparatus according to claim 1, wherein the photographing module comprises at least one set of binocular cameras and at least one user-expanded back camera, and the back camera is opposite to the binocular camera. And the movable shutter of the movable connection is disposed in front of the lens of the binocular camera and the back camera, and

The main control module is further configured to combine the image captured by the back camera with the image captured by the binocular camera to form a 360-degree panoramic 3D image.
The intercom extension intelligent robot apparatus according to claim 4, wherein

The main control module is further configured to perform image analysis on the 3D image of the user image captured by the shooting module in the artificial intelligence assistant mode to obtain the current hairstyle information, makeup information, clothing information of the user, and according to the prior The stored plurality of image template information determines defect information and improvement information of the current image of the user, and outputs defect information and improvement information of the current image of the user through the display module or the first power amplifier module.
The intercom extension intelligent robot apparatus according to claim 1, wherein

The main control module is further configured to receive, in the fitting mode, the user selects a specified clothing from the plurality of clothing image information, and integrates the body parameter information input by the user with the specified clothing to generate a fitting effect. 3D image;

The display module is configured to display a 3D image of the fitting effect.
The intercom extension intelligent robot apparatus according to claim 1, further comprising an FM frequency modulation module and a second power amplifier module, and

The microphone array is further configured to receive a specified music or broadcast input by a user by voice;

The main control module is further configured to: after identifying the specified music or broadcast, search for a corresponding music file from the Internet or a plurality of pre-stored music files, or frequency the FM FM module to a designated channel, And controlling the first power amplifier module or the second power amplifier module to play the music file or the broadcast information of the corresponding channel.
The intercom extension intelligent robot apparatus according to claim 4, wherein

The main control module is further configured to send the 3D image and voice information of the user captured by the shooting module to the specified in real time through the network module after establishing a connection with the designated contact in the video telephony mode. a contact mobile terminal or a walkie-talkie intelligent robot device, and a 3D image and voice information of the designated contact transmitted by the mobile terminal or the intercom extension intelligent robot device receiving the designated contact through the network module, And controlling the display module to display the received 3D image and controlling the first power amplifier module or an external earphone to play the voice information to implement a 3D holographic video call with the designated contact.
The intercom extension intelligent robot apparatus according to claim 4, further comprising a health detecting rod embedded on the casing, and

The health detecting rod is configured to detect health information of the user;

The main control module is further configured to record the health information detected by the user each time in the health check mode, and analyze the health change information of the user according to the health information in the preset time period, and when the abnormality is determined, The network module is pushed to the designated mobile terminal or the smart home cloud operation platform; and is also used to send the 3D image and voice information of the user captured by the shooting module to the remote doctor through the network module in the remote consultation mode. And receiving the prescription information and the medical order information sent by the remote doctor through the network module.
The intercom extension intelligent robot apparatus according to claim 4, further comprising a fingerprint sensor, and

The storage module is further configured to store, in the fingerprint database, a plurality of fingerprint information set by the user and an alarm type corresponding to each fingerprint information in advance;

The fingerprint sensor is configured to receive fingerprint information input by a user;

An environmental sensor for detecting current environmental information;

The main control module is further configured to: when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, determine an alarm type corresponding to the input fingerprint information, and obtain current monitoring information and/or user health information and / or environmental information, and generate alarm information, and send the alarm information to the corresponding property management center or cloud operation platform or alarm center or designated mobile terminal through the network module.
The intercom extension intelligent robot apparatus according to claim 4, wherein

The main control module is further configured to acquire location information and posture information of the user according to the 3D image of the user captured by the shooting module in the game mode, and control the display according to the location information and the posture information. Module.
The intercom extension intelligent robot apparatus according to claim 1, wherein

The microphone array is further configured to receive a device control instruction input by a user through voice, where the device control instruction includes a device name and a control instruction of the smart device to be controlled;

The main control module is further configured to perform voiceprint recognition on a device control command received by the microphone array to obtain a voiceprint feature of the user, and when determining that the acquired voiceprint feature is consistent with a preset voiceprint feature, Identifying, by the device control instruction, a device name and a control instruction of the smart device, determining a communication protocol corresponding to the smart device according to the identified device name, and using the communication protocol to use the control command Send to the corresponding smart device, so that the corresponding smart device executes the corresponding control command.
The intercom extension intelligent robot apparatus according to claim 4, wherein

The main control module is further configured to send, in the distance education mode, the 3D image and the voice information of the user captured by the shooting module to the remote teacher's terminal in real time through the network module, and receive through the network module The teacher's 3D image and voice information to achieve distance education.