WO2019232719A1 - Artistic intelligence television apparatus - Google Patents

Artistic intelligence television apparatus Download PDF

Info

Publication number
WO2019232719A1
WO2019232719A1 PCT/CN2018/090126 CN2018090126W WO2019232719A1 WO 2019232719 A1 WO2019232719 A1 WO 2019232719A1 CN 2018090126 W CN2018090126 W CN 2018090126W WO 2019232719 A1 WO2019232719 A1 WO 2019232719A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
information
user
image
smart
Prior art date
Application number
PCT/CN2018/090126
Other languages
French (fr)
Chinese (zh)
Inventor
李修球
Original Assignee
Li Xiuqiu
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Li Xiuqiu filed Critical Li Xiuqiu
Priority to PCT/CN2018/090126 priority Critical patent/WO2019232719A1/en
Publication of WO2019232719A1 publication Critical patent/WO2019232719A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning

Definitions

  • the invention relates to the fields of smart home, electronic hardware, artificial intelligence and software, and in particular to an artistic smart TV device.
  • the TV has gone through nearly a century of development history.
  • the TV display has developed from black and white CRT, color CRT, rear projection, PDP, LCD, LED, OLED, etc., but the basic role of the TV has not changed substantially, mainly Still: get information; kill time; home entertainment; serve the country and government; advertising.
  • TVs can attract users due to their large screen advantages and the content of online HD TVs, many users have bought smart TV is just watching TV programs and cannot attract users to increase the stay time in the living room.
  • mobile phone content is more abundant and users spend less and less time in the living room. Therefore, the current smart TV lacks interaction with users. Lack of stickiness to users.
  • the technical problem to be solved by the present invention is that the prior art smart TV has the defect of lacking sticky consumption demand for users.
  • the technical solution adopted by the present invention to solve its technical problems is to construct an artistic smart TV device and communicate with the smart home cloud service platform and smart home system.
  • the artistic smart TV device includes multiple functional modules, and the functions
  • the module includes a main control module and a display module, a power amplifier module, a storage module, a network module, and a shooting module respectively connected to the main control module; and,
  • a main control module configured to find a corresponding art image from the storage module or the Internet through the network module when determining that a trigger condition is satisfied, and control the display module to display a corresponding art according to a preset playback mode Image; when it is judged that the close condition is met, close the currently playing art image and enter standby mode; among them,
  • the trigger condition includes at least one of the following: receiving a playback instruction of a corresponding art image input by a user; the current mode is a home mode;
  • the shutdown condition includes at least one of the following: a shutdown instruction input by a user is received; the current mode is a home away mode; the current time is within a preset sleep period; and the video information of the guest sent by the smart home system is received.
  • the main control module is further configured to find commentary information corresponding to the artistic image from the storage module or the Internet through the network module when the artistic image is displayed, and control the power amplifier
  • the module plays the commentary information; and is also used to output a replacement prompt message through the power amplifier module when it is determined that the currently displayed art image has not been replaced for more than a preset time.
  • the shooting module includes at least one set of binocular cameras, and
  • the main control module is further configured to synthesize an image captured by the binocular camera into a 3D image, and, when receiving a transplant instruction input by a user, process the currently played art image into a 3D art scene, and 3D images are ported into the 3D art scene.
  • the functional module further includes a laser sensor and / or an external red sensor, and,
  • the main control module is further configured to analyze the user image captured by the binocular camera and the distance information detected by the laser sensor and / or the outer red sensor, and obtain the user's motion and posture information.
  • the motion and attitude information described above is used to control the corresponding function modules.
  • the main control module is further configured to process the multi-screen interactive information received through the network module, and control the display module and the power amplifier module to play the multi-screen interactive information.
  • the functional module further includes an array infrared detection module, and
  • the main control module is further configured to, when displaying an artistic image or a dormant state, if it is determined according to a detection result of the array infrared detection module that the user moves to a specific position and stays in the specific position for a time longer than a first preset When the value is reached, a first voice prompt is output through the power amplifier module.
  • a second voice prompt is output through the power amplifier module; and is also used to automatically turn off when the TV determines that the user has left the specific position to exceed a third preset value based on the detection result of the array infrared detection module after the TV is turned on Or enter the sleep mode; it is also used to determine if the user's motion trajectory stops according to the detection result of the array infrared detection module, and when the stop time exceeds a fourth preset value, open the corresponding function module in cooperation, and pass the power amplifier The module outputs a fourth voice prompt.
  • the functional module further includes an FM module, and
  • the main control module is further configured to find a corresponding music file from the storage module or the Internet through the network module when receiving a playback instruction of a corresponding music or broadcast input by a user, or
  • the FM module tunes to a designated channel and controls the power amplifier module to play the music file or broadcast information of a corresponding channel.
  • the main control module is further configured to perform image analysis on the 3D image of the user captured by the binocular camera when receiving the image guidance instruction input by the user to obtain the current image information of the user, and according to Multiple image template information stored in advance determines the defect information and improvement information of the user's current image, and outputs the defect information and improvement information of the user's current image through the power amplifier module, wherein the image information includes hairstyle information, makeup information, Clothing information.
  • the main control module is further configured to receive a user's selection of a specified clothing from a plurality of clothing image information when receiving a dressing instruction input by the user, and compare the body parameter information previously input by the user with the specified clothing
  • the integration is performed to generate a 3D image of the fitting effect
  • the display module is controlled to display the 3D image of the fitting effect.
  • the main control module is further configured to obtain position information and posture information of the user according to the 3D image of the user captured by the binocular camera when receiving a game instruction input by the user, and according to the position information And the posture information controls the display module and / or the power amplifier module; and is further configured to obtain an image of a specific plane drawing through the shooting module, and convert the image into a 3D image, and further, convert the 3D image of the user Or plane drawing 3D images are loaded in the corresponding game scene.
  • the main control module is further configured to pass the 3D image and voice information of the user captured by the binocular camera through the camera after establishing a connection with a designated contact when receiving a video phone instruction input by a user.
  • the network module sends to the mobile terminal or smart TV device of the designated contact in real time, and receives the 3D image of the designated contact sent by the mobile terminal or smart TV device of the designated contact via the network module, and Voice information, and controlling the display module to display the received 3D image and the power amplifier module to play the voice information to implement a 3D holographic video call with the designated contact.
  • the main control module is further configured to send the 3D image and voice information of the user captured by the binocular camera to the terminal of the remote teacher in real time through the network module in the remote education mode, and pass the The network module receives the 3D image and voice information of the teacher to realize real-time distance education.
  • the functional module further includes a microphone array, and
  • the microphone array is configured to receive a control instruction of a corresponding smart device input by a user through voice.
  • the smart device includes an art smart TV device and / or a smart home appliance device, and the smart home appliance device and the art smart TV device Connected through the interface module;
  • the main control module is configured to perform voiceprint recognition on a control instruction received by the microphone array to obtain a voiceprint feature of the user, and when it is determined that the acquired voiceprint feature is consistent with a preset voiceprint feature, Determine the identifier and instruction information of the intelligent device to be controlled according to the control instruction, and send the instruction information to the corresponding intelligent device; it is also used to receive a user's door opening instruction sent by the unit door phone, according to a preset
  • the home preparation mode acquires the identification and instruction information of the smart device to be controlled, and sends the instruction information to the corresponding smart device.
  • the main control module is further configured to translate the received voice information when a translation instruction is received, and output the translation information through the display module or the power amplifier module.
  • the functional module further includes a health detection sensor provided on the housing or connected through the interface module, and,
  • the health detection sensor is configured to detect health information of a user, and the health information includes body temperature, heart rate, blood oxygen, blood pressure trend, and pulse wave;
  • the main control module is further configured to record the health information detected by the health detection sensor in a health check mode, and form an electronic health file with the health and diagnostic information checked by the user in the hospital, and further, to store the health information And the electronic health file is pushed to the smart home cloud service platform or the terminal of the remote doctor through the network module.
  • the functional module further includes a fingerprint sensor and / or an environmental sensor; and,
  • the fingerprint sensor is configured to receive fingerprint information input by a user
  • the environmental sensor is configured to detect current environmental parameter information
  • the main control module is further configured to perform user identity authentication according to the input fingerprint information, and enter a corresponding operation interface when the authentication is passed; and is further used to determine when the current environmental parameter information meets a preset condition ,
  • the linkage starts the corresponding smart device, and sends the current environmental parameter information to the corresponding property management center or smart home cloud service platform or alarm center or a designated mobile terminal.
  • the shooting module further includes a surveillance camera, and
  • the storage module is further configured to store a plurality of fingerprint information set by a user and an alarm type corresponding to each fingerprint information in advance;
  • the monitoring camera is used to obtain monitoring information
  • the main control module is further configured to determine an alarm type corresponding to the input fingerprint information when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, and obtain current monitoring information and / or user health information and And / or environmental parameter information, and generate alarm information, and send the alarm information to a corresponding property management center or smart home cloud service platform or alarm center or a designated mobile terminal through the network module.
  • a monitoring module is further included, and
  • the monitoring module is configured to detect the power consumption characteristic information of each functional module in real time, and the power consumption characteristic information includes voltage information and current information;
  • the main control module is configured to determine the energy consumption information of the corresponding functional module according to the power consumption characteristic information, and send it to the smart home cloud service platform through the network module; and is also used to transmit the power consumption characteristic information Compare with the standard feature information of the corresponding functional module stored in advance, and determine the functional module that has failed or is about to fail according to the comparison result, and send it to the smart home cloud service platform through the network module.
  • the art smart TV can display images of works of art such as paintings and antiques to the user, which can not only increase the artistry of indoor life, but also cultivate the sentiment of residents, and enhance the residents' happiness and A sense of accomplishment. Moreover, for users who need to buy art, this is also a good way to understand art; for users who need to sell art, this is also a good way to promote and display their own art.
  • FIG. 1 is a logical structural diagram of a first embodiment of an artistic smart TV device according to the present invention
  • FIG. 2 is a logic structural diagram of a second embodiment of the art intelligent television device of the present invention.
  • the present invention constructs an artistic smart TV device.
  • the smart TV device (for example, a name is a small ball, hereinafter referred to as a device) can be connected with a smart home cloud service platform (hereinafter referred to as a platform), a smart home system, a property management center platform, and an alarm center. Platforms, etc.
  • the smart home system includes a door unit for a community, a door unit for a building, an outdoor door unit, an indoor unit, and a smart home device.
  • the device can also combine the Internet, big data, artificial intelligence, and the property management center platform, alarm center platform, and smart home cloud service platform that actively serve users, allowing users to enjoy wisdom Family brings safety, health, convenience, comfort, enjoyment, fastness, and comprehensive services of artificial intelligence.
  • FIG. 1 is a logical structural diagram of a first embodiment of a smart TV device according to the present invention.
  • the artistic smart TV device of this embodiment includes a plurality of functional modules, and the functional modules include a main control module 101 and a main control module 101 respectively connected to the main control module 101.
  • the main control module 101 is configured to find the corresponding art image from the storage module 104 or the Internet through the network module 105 when determining that the trigger condition is met, and control the display module 102 to preset
  • the corresponding art image is displayed in the playback mode; when it is judged that the closing condition is satisfied, the art image currently being played is closed, and the standby mode is entered.
  • the trigger condition includes at least one of the following: a playback instruction of a corresponding art image input by a user is received; and the current mode is a home mode.
  • the shutdown condition includes at least one of the following: a shutdown instruction input by the user is received; the current mode is away from home mode; the current time is within a preset sleep period; and a visitor video message sent by the smart home system is received.
  • the user may input a playback instruction or a shutdown instruction through a voice, and may also input a playback instruction or a shutdown instruction through an APP of a mobile terminal.
  • the art smart TV can display images of works of art such as calligraphy, paintings, and antiques to the user, which can not only increase the artistry of indoor life, but also cultivate the sentiment of residents, and enhance the happiness of residents. Sense and achievement. Moreover, for users who need to buy art, this is also a good way to understand art; for users who need to sell art, this is also a good way to promote and display their own art.
  • the user when an artistic image needs to be displayed on the device, the user can turn it on through voice or APP, or the smart home system detects that the user turns on the home mode and automatically starts displaying the artistic image.
  • the user can turn off by voice or APP, or when it is determined that the current mode is away from home mode or the current period is in a preset sleep period (for example, from 23:00 to 7 o'clock, 13 (From 15:00 to 15:00), automatically close the display of art images and enter the sleep energy-saving state, or, when a visitor arrives, the smart home system automatically switches the display of art images to visitors when a visitor's video information is sent to the device .
  • the user can operate the mobile APP to select his favorite art picture and push it to the device for display.
  • the user needs to enter the operation interface for operation, he can log in to the operation interface through human body sensing, fingerprint recognition, voice, and password.
  • the system alarm clock wakes up the user in the morning, the display resumes the classic art relic picture display.
  • the device will stay blank and stay in the energy-saving state until the next scene or demand triggers. It can also be detected by the array infrared detection module or shooting module that when the user is not in the living room, the device automatically blanks the screen to maintain the sleep energy-saving state.
  • the user's viewing of art images can be uploaded to the platform.
  • the platform can analyze the characteristics of user needs based on big data, provide targeted services, and help ordinary users analyze and judge the knowledge of purchasing art works.
  • the main control module 101 is further configured to, when displaying an artistic image, find out the explanatory information corresponding to the artistic image from the storage module 104 or the Internet through the network module 105, and control the power amplifier module 103 Play commentary information; also used to output replacement prompt information through the power amplifier module 103 when it is determined that the currently displayed art image has not been replaced for more than a preset time.
  • the device when the user needs to explain an artistic work, can explain the origin of each artistic photo, artistic characteristics, artistic connotation, market value, etc., to attract and improve the user's ideological understanding, life experience, and artistic accomplishment.
  • cultivate personal morality improve people's ideological understanding, cultivate sentiment, develop people's intelligence, increase wisdom, and broaden their understanding.
  • people can be entertained, and people's physical and mental health can be promoted.
  • the device will also periodically remind and automatically ask the user's preferences in order to replace the displayed art image.
  • the photographing module 113 includes at least one set of binocular cameras.
  • the main control module 101 is also used to synthesize the images captured by the binocular camera into a 3D image, and when receiving the transplant instruction input by the user, the currently played art image is processed into a 3D art scene, and the user's 3D image is transplanted Into a 3D art scene.
  • the binocular camera mainly uses the principle of human binocular stereo vision to capture users '3D images, and multiple cameras can be extended to capture users' 3D images together.
  • 3D images can be used for stereo video calls, 3D Stereo surveillance, artificial intelligence assistants, 3D fitting, interactive games, distance learning, remote consultation, video conference and other scene system applications.
  • the device or platform processes the artistic image, so that the artistic image can be turned into an active 3D artistic scene, and the 3D image of the user obtained in real time can be transplanted into the artistic scene, so that the user can communicate with the artistic scene.
  • Ancient art works through the experience, for example, the Qingming Shanghe map is converted into a 3D art scene, and the user's 3D image can walk in the art scene for a more realistic experience.
  • the main control module 101 is further configured to analyze the user image captured by the binocular camera and the distance information detected by the laser sensor 115 and / or an outer red sensor (not shown), and acquire The user's motion and posture information, and the corresponding function module is controlled according to the motion and posture information.
  • the binocular camera may also be combined with a laser sensor and / or an infrared sensor to form a virtual operation keyboard for a user to operate and control the corresponding function module through gestures or actions.
  • the main control module 101 is further configured to process the multi-screen interactive information received through the network module 105, and control the display module 102 and the power amplifier module 103 to play the multi-screen interactive information.
  • the device receives multi-screen interactive information from a mobile terminal such as a mobile phone or a PAD through a network module, and also displays and plays the screen transfer information of the user's mobile terminal.
  • a mobile terminal such as a mobile phone or a PAD
  • the specific application scenarios are: first, the voice wake-up device enters a multi-screen interactive state, leaving the device in a state to be connected; then, the user opens the multi-screen interactive software on the mobile terminal, searches for or adds the device directly; when the connection is successful, the user turns on
  • the software's wireless screen transfer function can transmit video images and sounds played on the mobile terminal to the device for display or playback.
  • the main control module 101 is further configured to, when displaying an artistic image or a dormant state, if it is determined according to the detection result of the array infrared detection module 107 that the user moves to a specific position and stays at the specific position for longer than When the first preset value is used, the first voice prompt is output through the power amplifier module 103.
  • the second voice prompt is output through the power amplifier module 103; it is also used to automatically turn off or enter the sleep mode if the user determines that the user has left a specific position exceeding a third preset value based on the detection result of the array infrared detection module 107 ; Also used to determine if the user's motion trajectory stops according to the detection result of the array infrared detection module 107 and the stop time exceeds a fourth preset value, and the corresponding function module is activated in conjunction, and a fourth voice prompt is output through the power amplifier module 103 .
  • the array infrared detection module 107 can be embedded in the device and emit infrared signals through the detection hole, so that the surface temperature of the object can be detected without touching the measured object, and the object's temperature can be determined. Movement trajectory, quantity, posture (standing and lying down), etc.
  • a specific application scenario is, for example, setting a sofa at a specific position.
  • the device automatically prompts the user whether or not they need to watch TV; when the user leaves or When leaving home or sleeping mode, the device automatically turns off the TV or sleeps; when the user goes home to turn on the home mode, the device wakes up to enter the artistic display state; when the elderly watch the TV on the sofa opposite the TV for a long time, the device will remind the elderly to pay attention to the activity regularly Protect your body or eyesight; when the elderly is sitting or lying for a long time, use the temperature, voice, and video of the elderly to determine whether the elderly are in a normal state and send the current emergency situation to the relatives or caregivers or hospitals in order to promptly treat the elderly Carry out a rescue.
  • TVs are generally one of the household's favorite appliances, and they are also just needed.
  • Traditional TVs or conventional smart TVs do not have related sensing, safety, and health detection functions. Therefore, in order to care for the elderly or care for children in the family, users need to add multiple smart devices, which is uneconomical, inconvenient to manage, and affects interior decoration. effect.
  • This device integrates a variety of sensors and detectors, and provides intelligent detection and analysis of information and push, safety, health, and escort services in the living room or bedroom for the care of the elderly and children. It is the most important intelligence to solve the aging society and civilized society. One of the devices.
  • the main control module 101 is further configured to find the corresponding music file from the storage module 104 or the Internet through the network module 105 when receiving the corresponding music or broadcast playback instruction input by the user.
  • the FM module 106 is frequency-modulated to a specified channel
  • the power amplifier module 103 is controlled to play a music file or broadcast information of a corresponding channel.
  • the power amplifier module 103 is preferably a high-power power amplifier module with two-channel audio and stereo output, which can meet the needs of home users for background music and broadcast appreciation.
  • the user can select his favorite music and FM FM station for playback and appreciation through the human-machine interactive voice and software menu modes of the device and the mobile terminal. For example, "Small ball, small ball, I want to listen to Jackie Chan singing as a self-improvement song.” After the device recognizes the user's voice command, the device automatically plays the corresponding song. When the home mode is activated, the device can automatically play the music that did not finish last time, or it can replay the user's favorite music.
  • the main control module 101 is further configured to perform image analysis on the 3D image of the user captured by the binocular camera when receiving the image guidance instruction input by the user to obtain the current image information of the user.
  • the defect information and improvement information of the current image of the user are determined according to multiple image template information stored in advance, and the defect information and improvement information of the current image of the user are output through the power amplifier module, wherein the image information includes hairstyle information, makeup information, and clothing information .
  • the device can also be combined with the device's environmental sensors, cameras, and other virtual assistants that help individuals complete multiple tasks or services, and provide users with a new human-computer interaction service assistant. Based on this, a large number of service assistants can also be implemented.
  • Platform operation application Provide users with air tickets, shopping, taxi trips, image design, appointment registration and so on.
  • the main control module 101 is further configured to, when receiving the fitting instruction input by the user, receive the user to select the specified clothing from the plurality of clothing image information, and input the body parameter information previously input by the user Integrate with the specified clothing to generate a 3D image of the fitting effect, and control the display module to display the 3D image of the fitting effect.
  • the device has built-in 3D fitting software.
  • various body parameters such as leg length, arm length, hairstyle, skin tone, etc.
  • the user can choose clothes that have created a 3D model at will, and then try on the process. You can change the angle at will, and see the fitting effect from every angle through the 3D display. After trying it on, you can save and share, or change your own style, color, etc., to save unnecessary trouble caused by shopping in physical stores.
  • the main control module 101 is further configured to obtain position information and posture information of the user according to the 3D image of the user captured by the binocular camera when receiving a game instruction input by the user, and according to the position information And attitude information to control the display module 102 and / or the power amplifier module 103; it is also used to obtain an image of a specific plane drawing through the photographing module 113, and convert the image into a 3D image, and load a 3D image of the user or a 3D image of the plane drawing In the corresponding game scene.
  • the device analyzes the user's stereo video stream collected by the binocular camera, and analyzes the bones, gestures, azimuth movements and changes of the user's body parts, corresponding to the virtual characters in the display screen.
  • the user character also punches, when the user lifts his foot, the virtual user character also lifts his foot, when the user backs up, the virtual user character also backs up, when the user moves left and right, the virtual character also moves left and right, when the user jumps, the virtual character also jumps, etc.
  • virtual game scenes such as punching falling objects, moving objects, grabbing or hitting gestures to achieve 3D interactive gaming functions.
  • the input device can also be scanned by the user for special pictures of plants and animals or printed pictures you like.
  • the device automatically converts the input pictures into 3D images in the device through software algorithms.
  • the user can record the characteristics of each animal or plant or want to say If the user touches the screen and touches the animal and plant display range in the device, they will automatically speak the sound recorded by the user's notice, which can provide a platform for users to display and interact.
  • the main control module 101 is further configured to, upon receiving a videophone instruction input by a user, establish a connection with a designated contact, and then 3D image and voice information of the user captured by the binocular camera. Real-time sending to the mobile terminal or device of the designated contact via the network module 105, and receiving the 3D image and voice information of the designated contact sent by the mobile terminal or device of the designated contact via the network module 105, and controlling the display module 102 to display the The received 3D image and power amplifier module 103 plays voice information to implement a 3D holographic video call with a designated contact.
  • the device comes with a large display screen and multiple cameras to capture the user's 3D stereoscopic images, so that 3D video communication between the user and the user can be realized, and the user can expand the back camera and multiple cameras in front to capture the user's 3D Together with the user's VR glasses and the holographic 3D software and device of the user's mobile terminal, the stereo image realizes the user's VR stereo live video call and the user's mobile 3D holographic video call.
  • the user can also listen to the other party's voice through the user's extended Bluetooth headset or wired headset.
  • Users can communicate in 3D VR visualization, 3D holographic visualization, voice, text, and pictures in multiple ways, and also have pictures and texts, an intuitive image, and a good experience.
  • the main control module 101 is further configured to send the 3D image and voice information of the user captured by the binocular camera to the terminal of the remote teacher in real time through the network module in the remote education mode, and through the network The module receives the teacher's 3D image and voice information to achieve remote real-time education.
  • the remote teaching function of the device can make it easier for children to learn theoretical knowledge, exercise their willpower, and stimulate their learning interest and learning ability.
  • Educational learning adapts to user groups suitable for all ages, such as video online teaching, voice reading or interactive teaching, and English environment. This will add vitality to users' information technology courses and become an excellent platform for cultivating the comprehensive ability and information literacy of primary and secondary school students.
  • the microphone array 112 is configured to receive a control instruction of a corresponding smart device input by a user through voice.
  • the smart device includes an art smart TV device and / or a smart home appliance device. Furthermore, the smart home appliance device and the art smart TV device The devices are connected through the interface module 111.
  • the main control module 101 is configured to perform voiceprint recognition on the control instruction received by the microphone array 112 to obtain the voiceprint characteristics of the user, and when it is determined that the acquired voiceprint characteristics are consistent with the preset voiceprint characteristics, according to the control instruction Determine the identification and instruction information of the intelligent device to be controlled, and send the instruction information to the corresponding intelligent device; it is also used to obtain the to-be-controlled according to the preset home preparation mode when the user's door opening instruction sent by the unit door phone is received.
  • a specific application scenario is, for example, when a user opens a door on a building unit door through identity recognition, the device automatically turns on the home preparation mode, and turns on indoor air-conditioning and household appliances according to the user's preference environment requirements to improve the indoor environment; When the device detects that the user is approaching the TV, it can automatically greet the user and ask the user for service needs.
  • the built-in microphone array user's own voice can wake the system normally, other people without authorization cannot turn on the device; when the user visits, the user can temporarily open the open mode, and the unauthorized user can also control the authorization by voice
  • the home intelligent system within the control range, the whole house voiceprint human-machine interactive control structure can meet the rigid demand of popularized applications, reduce the investment threshold for users to popularize smart homes, and guide and attract users to expand other functions, investment and consumption. It also greatly improves the user experience and takes into account the privacy needs of users.
  • community services such as video intercom, video surveillance, home control, user extension system configuration and installation, different types of alarm help functions, environmental monitoring, music appreciation, art appreciation, remote door opening, and fault reporting and repair can be implemented.
  • Interactive games video phones, shopping and other living services, education and learning, health services and other functions.
  • the main control module 101 is further configured to translate the received voice information when receiving a translation instruction after being awakened, and output the translation information through the display module 102 or the power amplifier module 103.
  • the voice information to be translated may be voice information received by the microphone array, voice information played by the device, or guest voice information received by a door phone in a smart home system.
  • the translation information can be output from the power amplifier module in the form of voice, or it can be output from the reality module in the form of text.
  • the application scenario is, for example: "Small ball, I want to communicate with Korean friends", the device automatically turns on the Chinese-Korean language translation state.
  • the device After one person finishes adding "small ball” at the end of Chinese, the device will automatically translate Chinese into Korean voice And text; after another person speaks Korean at the end with the Korean "small ball” pronunciation or Chinese “small ball”, the device will automatically translate Korean into Chinese sounds and text. In this way, a foreign friend at home or video or voice communication with a remote foreign friend can smoothly communicate.
  • the health detection sensor 108 may be disposed inside the device, and the sensing part is exposed or external.
  • the health detection sensor 108 may also be connected to the main control module 101 through the corresponding interface module 111.
  • the health detection sensor 108 is used to detect the user's health information, and the health information includes body temperature, heart rate, blood oxygen, blood pressure trend, and pulse wave; the main control module 101 is also used to record the health detected by the health detection sensor in the health check mode. Health information, and form an electronic health file with the user's health and diagnostic information checked in the hospital, and push the health information and electronic health file to the smart home cloud service platform or the terminal of the remote doctor through the network module.
  • the device has a variety of built-in health detection sensors, and in the future, users can also expand the latest health detection sensors on the market.
  • the device can detect Enter the user's body temperature, heart rate, heart rate variability, blood oxygen, blood pressure trend, pulse wave chart and other on-site detection data, and go to the hospital to check and diagnose the health data when the user is ill, and enter the device through the device's remote consultation through the relevant interface.
  • the device analyzes and manages all data uniformly by the device, acting as a family smart nurse, establishing a health file for each household, and working with the platform to implement personalized health services such as health monitoring, tracking, consultation, reminders, and appointment registration. .
  • the fingerprint sensor 109 and the environment sensor 110 are disposed on the housing, and the fingerprint sensor 109 is used to receive fingerprint information input by a user; the environment sensor 110 is used to detect current environmental parameter information.
  • the main control module 110 is further configured to authenticate the identity of the user according to the input fingerprint information, and enters the corresponding operation interface when the authentication is passed; it is also used to determine whether the current environmental parameter information meets the preset conditions, and then activate the corresponding linkage. Intelligent device and sends the current environmental parameter information to the corresponding property management center or smart home cloud service platform or alarm center or designated mobile terminal.
  • the user can open the system operation interface through the fingerprint identity, or in an emergency, define different fingers as different alarm levels, and automatically alert the cloud service desk or the user's mobile terminal. Used for identity verification when paying for TV shopping.
  • the environmental sensors include: CO, CO2, PM2.5, smoke and gas sensors, temperature and humidity sensors, and light sensors.
  • the device automatically uploads the indoor excess data to the platform and the user's mobile terminal or opens the indoor windows and exhaust fans in conjunction; when the indoor temperature and humidity exceeds the standard, the device automatically uploads the indoor excess data to the platform And the user's mobile terminal or linked to turn on air conditioning, humidification and dehumidification, etc .; when the user is indoors, the light gradually dims, the device automatically turns on indoor lights and curtains.
  • a human body sensor can be set. For example, when the human body approaches, the device can choose to trigger the switch from the display of artistic images to the main interface of the operation; when the user returns home at night to open the door, the user is detected to enter the door and the device will automatically turn on. Home mode and voice greetings to users, users can also voice the device to their needs.
  • the storage module 104 is further configured to store a plurality of fingerprint information set by a user and an alarm type corresponding to each fingerprint information in advance; a monitoring camera is used to obtain monitoring information, and is preferably a 360-degree panoramic camera; The main control module 101 is further configured to determine an alarm type corresponding to the input fingerprint information when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, and obtain current monitoring information and / or user health information and / or Environmental parameter information, and generate alarm information, and send the alarm information to the corresponding property management center or smart home cloud service platform or alarm center or designated mobile terminal through the network module.
  • the specific application scenario is: Assume that the index finger is normally turned on, the middle finger is 120 alarm, the ring finger is holding alarm, the little finger is 119 alarm, etc.
  • the user does not need the voice alarm description content, and the alarm platform can quickly understand the user Ask for help, and when there is an alarm, the device also automatically pushes the authorized video, picture or recording of the alarm to the user's mobile terminal, property center and platform.
  • the device When the device alarms, it also customizes the local voice alarm or human-computer interaction to solve the indoor false alarm problem, avoids the actual problem of "wolf coming" every day, and allows the user to intuitively judge whether there is a false alarm; custom voice alarm or human-computer interaction It also lets the user know that the platform has been alerted or that the current alarm settings are working properly. If there is a false positive, the alarm will be cancelled as soon as possible. Defining a voice alarm in the armed state can also deter illegal intruders.
  • the user can customize time monitoring and playback, and actively push real-time monitoring images or photos to the user's mobile terminal and platform when an alarm occurs for help, so that the user and the platform can confirm the indoor situation.
  • users can also manually turn off the surveillance camera and microphone array 112, and manually turn the system on and off to self-aware, so as to remind the user to turn on or turn off when privacy is required; when the user is ready to go out or before going to bed at night,
  • the device will automatically remind the user to turn on the surveillance camera and microphone array to monitor the room and record as needed to ensure family safety and protect the privacy needs of the user.
  • the multi-interface design of the device is used to support multi-zone wired and wireless alarm signal access, which solves the problem of access to home alarm information for wired alarm devices that have been installed, and also solves the problem of not installing alarm devices and not wishing to damage the installation of wired alarm devices
  • the problem of installing wireless alarm devices in homes the device has a built-in battery to ensure that the alarm help information can be pushed to the user's mobile terminal and platform in the event of a power failure.
  • all alarm information is sent to the user's mobile terminal and platform simultaneously through the network and SMS.
  • the alarm information is encoded with a specific function to meet the platform's artificial intelligence and automated processing requirements.
  • the monitoring module 114 is used to detect the power consumption characteristic information of each functional module in real time, and the power consumption characteristic information includes voltage information and current information; the main control module 101 is used to determine the corresponding information according to the power consumption characteristic information.
  • the energy consumption information of the functional module is sent to the smart home cloud service platform through the network module 105; it is also used to compare the power consumption characteristic information with the standard characteristic information of the corresponding functional module stored in advance, and determine whether the The function module that has failed or is about to fail is sent to the smart home cloud service platform through the network module 105.
  • a standard energy consumption limit is set for each functional module.
  • the energy consumption exceeds the standard limit.
  • the device will push the energy consumption information of the device exceeding the standard daily or weekly, and prompt the user to pay the relevant cost of the energy consumption exceeding the standard. Therefore, the energy consumption charge can expand the device's value-added operation charges based on traffic and members.
  • the monitoring module detects minute changes in various factors such as voltage, current, and waveform of each functional module, and the device judges information such as power consumption and status of the device according to these power consumption characteristic information.
  • the monitoring module completes the statistical device characteristic data collection through the study of voltage, current, waveform and other factors in the normal working state of the robot, and obtains the normal parameter data standards of the device.
  • a parameter index of the device When a parameter index of the device is within a defined period of time, When it deviates from the standard data, it will prompt the user that a certain functional module or the entire machine has failed. Please troubleshoot it in time.
  • the platform can analyze the faults of the device through the feedback of the big data to improve and optimize the device design.
  • the device adopts a modular design. If a function module of the device is judged to be faulty, the corresponding module of the user device can be replaced by the property service personnel.
  • each function module is provided on both sides, and components with high heat and interference are designed on one side, and sensors and sensitive components are designed on the other side, which can ensure the realization of the user's traditional basic functions, and also Add many sensitive sensors such as environmental monitoring.
  • the middle position of the back of the device adopts a concave design, which mainly accommodates the space of the TV plane mounting bracket, so that the TV installation plane mounting bracket is on the same plane as the back of the TV, which is convenient for the device to be installed on the wall to achieve coordination with the interior decoration wall. The purpose of unity and save interior space.
  • the device integrates multiple signals and multiple systems, artificial intelligence, human-computer interaction, rich value-added services, and general consumer software and hardware to expand consumer applications, such as WeChat, QQ, securities investment, external speakers, etc., and simple installation and debugging, user experience Feeling good, the platform can also provide users with special needs through rapid and accurate analysis and judgment of big data.
  • the device also has the basic functions of a mobile phone, as well as the function of visual intercom and indoor rapid sub-category alarms. It also has the function of a smart home hub. It also has the functions of robot perception, learning, analysis and execution, and 3D interaction and communication. , Games and other functions, also has the function of art appreciation, music appreciation, but also has health detection and service functions. Provide users with a full range of intelligent services and experiences, and do their part to realize the dreams of smart home, smart community, smart city, smart China, safe China, and healthy China.
  • the invention also constructs a smart home system, which includes an artistic smart TV device, a mobile terminal, a smart home system, a smart home cloud service platform, a community property management center platform, and 110, 119, and 120 alarm centers.
  • the smart home cloud service platform includes art platform, artificial intelligence assistant platform, distance education platform, health and remote consultation service platform and other service platforms.
  • the mobile terminal it is equipped with APP software, which can use the fingerprint recognition of a smartphone, the microphone array to recognize voice, and other mobile terminal sensors, and use software algorithms to realize the use of fingerprints with different hand alarm levels for help alarms and local custom voice output, art Product display push and transaction, mobile phone indoor positioning, automatic scene control, video intercom, active and passive video surveillance, multi-door opening, video phone, health management, distance education, community service, life service, human-computer interaction without human operation Control or manual control.
  • APP software can use the fingerprint recognition of a smartphone, the microphone array to recognize voice, and other mobile terminal sensors, and use software algorithms to realize the use of fingerprints with different hand alarm levels for help alarms and local custom voice output, art Product display push and transaction, mobile phone indoor positioning, automatic scene control, video intercom, active and passive video surveillance, multi-door opening, video phone, health management, distance education, community service, life service, human-computer interaction without human operation Control or manual control.
  • artistic smart TV devices it integrates microphone array voice, identity recognition, human-computer interaction, indoor monitoring, video intercom and door opening, security alarm, 3D video phone, 3D fitting, interactive games, smart home, art Appreciation, music and broadcasting appreciation, education and learning, real-time translation, information consultation, living services, community services, environmental testing, remote consultation, health testing and services, etc., maintain data with user mobile terminals, intercom extension intelligent robots, etc. Interoperability, together with the property management platform and smart home cloud service platform, together build a real smart life, smart home and smart community for the residents.
  • the main control module is an intelligent CPU / MCU core group, including memory, storage, encryption chip, and so on.
  • the multi-bus interface is mainly used to solve the protocol communication connection problem of indoor intelligent bus system.
  • 315MHz and 433MHz wireless interfaces mainly solve the problem that cables cannot be installed indoors. Users can wirelessly transmit alarm signals to the device by installing a wireless alarm front-end device on the bedroom or door, so that the device converts the alarm signals into Internet signals and pushes them to the platform and users.
  • Mobile terminal The DI interface mainly solves the self-safety detection inputs such as indoor digital alarm signal access and device tamper resistance. At the same time, the device also converts the alarm signal into an Internet signal.
  • the DO interface mainly solves the problem of outputting related equipment such as warning lights and sirens when the alarm is output, so as to achieve the purpose of alerting illegal intruders and alerting users to illegal intruders.
  • Custom sound local sound output mainly solves human-computer interaction, video intercom, value-added services, deterring illegal intruders and reminding users of false alarms when alarms or false alarms occur, in order to reduce the system's false alarm rate and confirm system processing Normal working condition.
  • the fingerprint input module solves identity authentication and normal operation, and defines different levels of alarm help information. Wireless home control signal access to solve the problem of smart home control applications where new and old residential users do not lay cables.
  • FM FM module mainly solves the needs of users to listen to FM radio through the device.
  • the storage module mainly solves the problem of data storage such as monitoring, pictures and music.
  • the Bluetooth module mainly provides functions such as Bluetooth beacons for automatic scenes and user expansion systems for data communication via Bluetooth.
  • the display module and the control module are mainly used to drive the display and control of the touch-screen LCD large screen; the audio coding module is mainly connected to the microphone voice array input to realize human-machine interactive voice input.
  • Pulse wave, blood red, heart rate, blood pressure and other medical sensors mainly solve the user's need to outsource related detection equipment, through the built-in module of the device to achieve the user's related health data collection, analysis and management, and push the relevant data to the user's mobile terminal And platform.
  • the monitoring module mainly checks the failure, early warning, and power consumption of the built-in function modules based on the voltage, current, and waveform of the device.
  • the WIFI interface mainly solves the problem that when the device cannot connect to the Internet by wire, it is connected to the Internet through the WIFI wireless router and the indoor router of the user, which solves the user wiring troubles and large cost investment;
  • the power amplifier module mainly solves the user's background music expansion needs, and users only need to buy ceiling Or the wall-mounted speaker is connected to this interface, and the favorite music can be played through manual operation or voice control of the device or the user's mobile terminal.
  • the SIM card module mainly solves the situation where the user does not have wired broadband and WIFI network, and connects to the Internet through the SIM card wireless network; when the alarm is triggered, the SIM card wireless network and wired network can also be defined to send alarm signals to the property management center and user mobile terminal at the same time. And smart home cloud service platform to ensure that alarm information is leaked to relevant people and service agencies.
  • the smart home cloud service platform mainly provides users with indoor multi-signal Internet alarms, outdoor user mobile alarms, rescue and other security management, information consulting, insurance, art display and trading, education and learning, 3D video calls, artificial intelligence Assistants, interactive games, 3D fitting modules, automatic configuration database establishment, health detection service management and other services.
  • Mainly includes video intelligence and recognition analysis module, voice voiceprint analysis module, picture analysis module, GPS positioning analysis module, Wifi and Bluetooth positioning information analysis module, central manual parallel operation software, art display push module, education and learning module, artificial intelligence assistant Modules, 3D game modules, 3D fitting modules, 3D video phones and other value-added service push modules, operation data recording modules, large-screen splicing display modules, data group modules, network security modules, artificial intelligence automatic service modules, and communications between the three major operators Modules, public security system communication modules, medical system communication modules, health data modules, UPS power supply system modules, precision air conditioning units and so on.
  • the device compiles the user's service requirements into specific pre-defined functions, and then pushes them to the platform via SMS and network.
  • the platform automatically and quickly decodes various service requests and related data. After the data is automatically processed, the platform divides the data into different types and levels. Then compile it into a specific predefined function and push it to the device, user mobile terminal, user emergency contact APP, user's property center platform, real-time 110, 119, and 120 alarm center software and other related services through the network. Users' devices and institutions allow users to get the services and guarantees they need to comprehensively improve the level of service users and enhance the user experience.
  • the community property management center platform mainly provides group real estate residential users with indoor automatic alarm, rescue and other security management, video monitoring, video intercom, installation and maintenance of extended function equipment, O2O, living services, community services, information consulting, Management platform for health service management and outdoor security services. It can be a single community property management center or a multiple community property service group. It mainly includes video intelligence and recognition analysis module, voice and voiceprint analysis module, picture analysis module, Wifi and Bluetooth positioning information analysis module, and central manual parallel operation software. , Operation data recording module, large-screen mosaic display module, data group module, network security module, community intelligent integration platform, community property operation platform, artificial intelligence automatic service module, operator communication module, public security system communication module, UPS power supply system Modules, precision air conditioning units and more.
  • the device compiles the user's service requirements into specific pre-defined functions, and then pushes them to the platform via SMS and network.
  • the platform automatically and quickly decodes various service requests and related data. After the data is automatically processed, the platform divides the data into different types and levels. Then compile it into a specific predefined function and push it to the artistic artificial intelligence TV yellow paper, the user's mobile terminal, the user's emergency contact APP, the user's property center platform, and the user's real-time 110, 119, and 120 alarms through the network.
  • Devices and institutions of related service users such as the center software, and the platform will automatically pop-up display the demand information and voice alarm to remind the security guard on duty to grasp the alarm and other service requirements of the residents in time, and arrange the nearest security to deal with the residents' alarm and service requirements on-site. If the nearest security site has already handled the residents' service needs, the on-duty security needs to feedback the implementation and false alarms through software in order for the platform to carry out subsequent management work.
  • All user demand information groups synchronize with community information, which not only plays the role of unified management, but also supervises the service quality and frequency of community management personnel. Let users get the services and guarantees they need to comprehensively improve the level of service users and enhance the user experience.
  • the 110, 119, and 120 alarm centers they received specific pre-defined functions pushed by the smart home and property management cloud service platform network, and quickly decoded the user name, address, contact information, emergency contacts, family members, real-time Geographical location, alarm type, picture analysis platform results, field environment, peripheral equipment, motion trajectory, user health data and other information, plus video platform analysis results, live voice platform analysis results, etc., as well as other clues about the platform's initial judgment
  • the alarm center software will automatically pop up the alarm display and voice alarm to remind the police to grasp the residents' alarm needs in a timely manner, and quickly dispatch police forces to the user for rescue and subsequent evidence call.

Abstract

The present invention relates to an artistic intelligence television apparatus, the artistic intelligence television apparatus comprising a plurality of functional modules, and the functional modules comprising a main control module and a display module, power amplification module, storage module, and network module which are respectively connected to the main control module; the main control module is used when determined that a trigger condition is met for searching for a corresponding artistic image from in the storage module or from the Internet by means of the network module, and controlling the display module to display the corresponding artistic image according to a preset playback mode.

Description

一种艺术智能电视装置Artistic intelligent television device 技术领域Technical field
本发明涉及智慧家居、电子硬件、人工智能及软件领域,尤其涉及一种艺术智能电视装置。The invention relates to the fields of smart home, electronic hardware, artificial intelligence and software, and in particular to an artistic smart TV device.
背景技术Background technique
电视机经历了近百年的发展历史,电视机显示屏从黑白CRT、彩色CRT、背投、PDP、LCD、LED、OLED等多个发展阶段,但电视机的基础作用并没有发生本质变化,主要还是:获取信息;消磨时间;家庭娱乐;为国家和政府服务;广告。随着人们的生活水平不断提高以及互联网时代的到来,人们的业余时间被手机占用了大部分,电视虽然因其大屏的优势以及在线高清电视的内容可以吸引用户,但是,很多用户买了智能电视也只是看一下电视节目,并无法吸引用户提升客厅停留时间,特别在移动互联网时代,手机的内容更丰富,用户越来越少时间停留在客厅了,因此,目前的智能电视缺少与用户互动,对用户缺乏黏性。The TV has gone through nearly a century of development history. The TV display has developed from black and white CRT, color CRT, rear projection, PDP, LCD, LED, OLED, etc., but the basic role of the TV has not changed substantially, mainly Still: get information; kill time; home entertainment; serve the country and government; advertising. With the continuous improvement of people's living standards and the advent of the Internet era, people spend most of their spare time on mobile phones. Although TVs can attract users due to their large screen advantages and the content of online HD TVs, many users have bought smart TV is just watching TV programs and cannot attract users to increase the stay time in the living room. Especially in the era of mobile Internet, mobile phone content is more abundant and users spend less and less time in the living room. Therefore, the current smart TV lacks interaction with users. Lack of stickiness to users.
另外,随着人民生活水平的提高,人们对书画、古董等艺术品的学习、鉴赏与装饰美观需求会越来越大,从而相关艺术品交易需求也越来越大。一方面,购买方没有好的途径去了解及学习与相关知识;另一方面,售卖方也没有好的途径为自己的艺术品做推广与展示。In addition, with the improvement of people's living standards, people's needs for the study, appreciation and decoration of artworks such as calligraphy, paintings and antiques will become greater and greater, and the demand for related art transactions will also increase. On the one hand, the buyer does not have a good way to understand and learn and related knowledge; on the other hand, the seller does not have a good way to promote and display their own art.
技术问题technical problem
本发明要解决的技术问题在于,现有技术的智能电视存在缺乏对用户的黏性消费需求的缺陷。The technical problem to be solved by the present invention is that the prior art smart TV has the defect of lacking sticky consumption demand for users.
技术解决方案Technical solutions
本发明解决其技术问题所采用的技术方案是:构造一种艺术智能电视装置,与智慧家庭云服务平台及智慧家庭系统通讯连接,所述艺术智能电视装置包括多个功能模块,且所述功能模块包括主控模块及分别与主控模块连接的显示模块、功放模块、存储模块、网络模块、拍摄模块;而且,The technical solution adopted by the present invention to solve its technical problems is to construct an artistic smart TV device and communicate with the smart home cloud service platform and smart home system. The artistic smart TV device includes multiple functional modules, and the functions The module includes a main control module and a display module, a power amplifier module, a storage module, a network module, and a shooting module respectively connected to the main control module; and,
主控模块,用于在判断满足触发条件时,从所述存储模块中或通过所述网络模块从互联网中查找出相应的艺术图像,并控制所述显示模块按预设播放模式显示相应的艺术图像;在判断满足关闭条件时,关闭当前正在播放的艺术图像,并进入待机模式;其中,A main control module, configured to find a corresponding art image from the storage module or the Internet through the network module when determining that a trigger condition is satisfied, and control the display module to display a corresponding art according to a preset playback mode Image; when it is judged that the close condition is met, close the currently playing art image and enter standby mode; among them,
所述触发条件包括下列中的至少一个:接收到用户输入的相应艺术图像的播放指令;当前模式为回家模式;The trigger condition includes at least one of the following: receiving a playback instruction of a corresponding art image input by a user; the current mode is a home mode;
所述关闭条件包括下列中的至少一个:接收到用户输入的关闭指令;当前模式为离家模式;当前时间在预设的睡眠时段内;接收到智慧家庭系统发送的访客视频信息。The shutdown condition includes at least one of the following: a shutdown instruction input by a user is received; the current mode is a home away mode; the current time is within a preset sleep period; and the video information of the guest sent by the smart home system is received.
优选地,所述主控模块,还用于在显示艺术图像时,从所述存储模块中或通过所述网络模块从互联网中查找出所述艺术图像所对应的解说信息,并控制所述功放模块播放所述解说信息;还用于在判断出当前所显示的艺术图像超过预设时间未更换时,通过所述功放模块输出更换提示信息。Preferably, the main control module is further configured to find commentary information corresponding to the artistic image from the storage module or the Internet through the network module when the artistic image is displayed, and control the power amplifier The module plays the commentary information; and is also used to output a replacement prompt message through the power amplifier module when it is determined that the currently displayed art image has not been replaced for more than a preset time.
优选地,所述拍摄模块包括至少一组双目摄像头,而且,Preferably, the shooting module includes at least one set of binocular cameras, and
所述主控模块,还用于将所述双目摄像头所拍摄的图像合成3D图像,而且,在接收到用户输入的移植指令时,将当前播放的艺术图像处理成3D艺术场景,并将用户的3D图像移植到所述3D艺术场景中。The main control module is further configured to synthesize an image captured by the binocular camera into a 3D image, and, when receiving a transplant instruction input by a user, process the currently played art image into a 3D art scene, and 3D images are ported into the 3D art scene.
优选地,所述功能模块还包括激光传感器和/或外红传感器,而且,Preferably, the functional module further includes a laser sensor and / or an external red sensor, and,
所述主控模块,还用于对所述双目摄像头所拍摄的用户图像及激光传感器和/或外红传感器所探测的距离信息进行分析,并获取用户的动作和姿态信息,而且,根据所述动作和姿态信息对相应功能模块进行操控。The main control module is further configured to analyze the user image captured by the binocular camera and the distance information detected by the laser sensor and / or the outer red sensor, and obtain the user's motion and posture information. The motion and attitude information described above is used to control the corresponding function modules.
优选地,所述主控模块,还用于对通过所述网络模块接收的多屏互动信息进行处理,并控制所述显示模块和所述功放模块播放所述多屏互动信息。Preferably, the main control module is further configured to process the multi-screen interactive information received through the network module, and control the display module and the power amplifier module to play the multi-screen interactive information.
优选地,所述功能模块还包括阵列红外检测模块,而且,Preferably, the functional module further includes an array infrared detection module, and
所述主控模块,还用于在显示艺术图像或休眠状态时,若根据所述阵列红外检测模块的检测结果判断出用户移动到特定位置且在所述特定位置停留的时间超过第一预设值时,通过所述功放模块输出第一语音提示;还用于在电视开启后,若根据所述阵列红外检测模块的检测结果判断出用户在所述特定位置停留的时间超过第二预设值时,通过所述功放模块输出第二语音提示;还用于在电视开启后,若根据所述阵列红外检测模块的检测结果判断出用户离开所述特定位置超过第三预设值时,自动关闭或进入休眠模式;还用于若根据所述阵列红外检测模块的检测结果判断出用户的运动轨迹停止,且停止时间超过第四预设值时,联动开启相应的功能模块,并通过所述功放模块输出第四语音提示。The main control module is further configured to, when displaying an artistic image or a dormant state, if it is determined according to a detection result of the array infrared detection module that the user moves to a specific position and stays in the specific position for a time longer than a first preset When the value is reached, a first voice prompt is output through the power amplifier module. It is also used to determine that, after the television is turned on, according to the detection result of the array infrared detection module, the user stays at the specific position for a time longer than a second preset value A second voice prompt is output through the power amplifier module; and is also used to automatically turn off when the TV determines that the user has left the specific position to exceed a third preset value based on the detection result of the array infrared detection module after the TV is turned on Or enter the sleep mode; it is also used to determine if the user's motion trajectory stops according to the detection result of the array infrared detection module, and when the stop time exceeds a fourth preset value, open the corresponding function module in cooperation, and pass the power amplifier The module outputs a fourth voice prompt.
优选地,所述功能模块还包括FM模块,而且,Preferably, the functional module further includes an FM module, and
所述主控模块,还用于在接收到用户输入的相应音乐或广播的播放指令时,从所述存储模块中或通过所述网络模块从互联网中查找出相应的音乐文件,或,将所述FM模块调频到指定频道,并控制所述功放模块播放所述音乐文件或相应频道的广播信息。The main control module is further configured to find a corresponding music file from the storage module or the Internet through the network module when receiving a playback instruction of a corresponding music or broadcast input by a user, or The FM module tunes to a designated channel and controls the power amplifier module to play the music file or broadcast information of a corresponding channel.
优选地,所述主控模块,还用于在接收到用户输入的形象指导指令时,对所述双目摄像头所拍摄的用户的3D图像进行图像分析,以获取用户当前的形象信息,并根据预先所存储的多个形象模板信息确定用户当前形象的缺陷信息及改进信息,且通过所述功放模块输出用户当前形象的缺陷信息及改进信息,其中,所述形象信息包括发型信息、妆容信息、衣着信息。Preferably, the main control module is further configured to perform image analysis on the 3D image of the user captured by the binocular camera when receiving the image guidance instruction input by the user to obtain the current image information of the user, and according to Multiple image template information stored in advance determines the defect information and improvement information of the user's current image, and outputs the defect information and improvement information of the user's current image through the power amplifier module, wherein the image information includes hairstyle information, makeup information, Clothing information.
优选地,所述主控模块,还用于在接收到用户输入的试衣指令时,接收用户从多个服装图像信息中选择指定的服装,并将用户预先输入的身体参数信息与指定的服装进行整合,以生成试衣效果的3D图像,而且,控制所述显示模块显示所述试衣效果的3D图像。Preferably, the main control module is further configured to receive a user's selection of a specified clothing from a plurality of clothing image information when receiving a dressing instruction input by the user, and compare the body parameter information previously input by the user with the specified clothing The integration is performed to generate a 3D image of the fitting effect, and the display module is controlled to display the 3D image of the fitting effect.
优选地,所述主控模块,还用于在接收到用户输入的游戏指令时,根据所述双目摄像头所拍摄的用户的3D图像获取用户的位置信息及姿态信息,并根据所述位置信息及所述姿态信息控制所述显示模块和/或所述功放模块;还用于通过所述拍摄模块获取特定平面画的图像,并将所述图像转换成3D图像,而且,将用户的3D图像或平面画的3D图像加载在相应的游戏场景中。Preferably, the main control module is further configured to obtain position information and posture information of the user according to the 3D image of the user captured by the binocular camera when receiving a game instruction input by the user, and according to the position information And the posture information controls the display module and / or the power amplifier module; and is further configured to obtain an image of a specific plane drawing through the shooting module, and convert the image into a 3D image, and further, convert the 3D image of the user Or plane drawing 3D images are loaded in the corresponding game scene.
优选地,所述主控模块,还用于在接收到用户输入的视频电话指令时,在与指定联系人建立连接后,将所述双目摄像头所拍摄的用户的3D图像及语音信息通过所述网络模块实时发送至所述指定联系人的移动终端或智能电视装置,及通过所述网络模块接收所述指定联系人的移动终端或智能电视装置所发送的所述指定联系人的3D图像及语音信息,并控制所述显示模块显示所接收的所述3D图像及所述功放模块播放所述语音信息,以实现与所述指定联系人的3D全息视频通话。Preferably, the main control module is further configured to pass the 3D image and voice information of the user captured by the binocular camera through the camera after establishing a connection with a designated contact when receiving a video phone instruction input by a user. The network module sends to the mobile terminal or smart TV device of the designated contact in real time, and receives the 3D image of the designated contact sent by the mobile terminal or smart TV device of the designated contact via the network module, and Voice information, and controlling the display module to display the received 3D image and the power amplifier module to play the voice information to implement a 3D holographic video call with the designated contact.
优选地,所述主控模块,还用于在远程教育模式下,将所述双目摄像头所拍摄的用户的3D图像及语音信息通过所述网络模块实时发送至远程老师的终端,并通过所述网络模块接收所述老师的3D图像及语音信息,以实现实时远程教育。Preferably, the main control module is further configured to send the 3D image and voice information of the user captured by the binocular camera to the terminal of the remote teacher in real time through the network module in the remote education mode, and pass the The network module receives the 3D image and voice information of the teacher to realize real-time distance education.
优选地,所述功能模块还包括麦克风阵列,而且,Preferably, the functional module further includes a microphone array, and
所述麦克风阵列,用于接收用户通过语音输入的相应智能装置的控制指令,所述智能装置包括艺术智能电视装置和/或智能家电装置,而且,所述智能家电装置与所述艺术智能电视装置通过所述接口模块相连;The microphone array is configured to receive a control instruction of a corresponding smart device input by a user through voice. The smart device includes an art smart TV device and / or a smart home appliance device, and the smart home appliance device and the art smart TV device Connected through the interface module;
所述主控模块,用于对所述麦克风阵列所接收的控制指令进行声纹识别,以获取用户的声纹特征,并在判断出所获取的声纹特征与预先设置的声纹特征一致时,根据所述控制指令确定待控制的智能装置的标识及指令信息,并将所述指令信息发送至相应的智能装置;还用于在收到单元门口机发送的用户开门指令时,按照预设的回家预备模式获取待控制的智能装置的标识及指令信息,并将所述指令信息发送至相应的智能装置。The main control module is configured to perform voiceprint recognition on a control instruction received by the microphone array to obtain a voiceprint feature of the user, and when it is determined that the acquired voiceprint feature is consistent with a preset voiceprint feature, Determine the identifier and instruction information of the intelligent device to be controlled according to the control instruction, and send the instruction information to the corresponding intelligent device; it is also used to receive a user's door opening instruction sent by the unit door phone, according to a preset The home preparation mode acquires the identification and instruction information of the smart device to be controlled, and sends the instruction information to the corresponding smart device.
优选地,所述主控模块,还用于在收到翻译指令时,对所接收的语音信息进行翻译,并通过所述显示模块或所述功放模块输出翻译信息。Preferably, the main control module is further configured to translate the received voice information when a translation instruction is received, and output the translation information through the display module or the power amplifier module.
优选地,所述功能模块还包括设置在壳体上或通过所述接口模块连接的健康检测传感器,而且,Preferably, the functional module further includes a health detection sensor provided on the housing or connected through the interface module, and,
所述健康检测传感器,用于检测用户的健康信息,所述健康信息包括体温、心率、血氧、血压趋势、脉搏波;The health detection sensor is configured to detect health information of a user, and the health information includes body temperature, heart rate, blood oxygen, blood pressure trend, and pulse wave;
所述主控模块,还用于在健康检查模式下,记录所述健康检测传感器所检测的健康信息,并与用户在医院检查的健康与诊断信息形成电子健康档案,而且,将所述健康信息及所述电子健康档案通过所述网络模块推送至智慧家庭云服务平台或远程医生的终端。The main control module is further configured to record the health information detected by the health detection sensor in a health check mode, and form an electronic health file with the health and diagnostic information checked by the user in the hospital, and further, to store the health information And the electronic health file is pushed to the smart home cloud service platform or the terminal of the remote doctor through the network module.
优选地,所述功能模块还包括指纹传感器和/或环境传感器;而且,Preferably, the functional module further includes a fingerprint sensor and / or an environmental sensor; and,
所述指纹传感器,用于接收用户输入的指纹信息;The fingerprint sensor is configured to receive fingerprint information input by a user;
所述环境传感器,用于检测当前的环境参数信息;The environmental sensor is configured to detect current environmental parameter information;
所述主控模块,还用于根据所输入的指纹信息进行用户身份的认证,并在认证通过时,进入相应的操作界面;还用于在判断所述当前的环境参数信息满足预设条件时,联动开启相应的智能装置,并将所述当前的环境参数信息发送至相应的物业管理中心或智慧家庭云服务平台或报警中心或指定的移动终端。The main control module is further configured to perform user identity authentication according to the input fingerprint information, and enter a corresponding operation interface when the authentication is passed; and is further used to determine when the current environmental parameter information meets a preset condition , The linkage starts the corresponding smart device, and sends the current environmental parameter information to the corresponding property management center or smart home cloud service platform or alarm center or a designated mobile terminal.
优选地,所述拍摄模块还包括监控摄像头,而且,Preferably, the shooting module further includes a surveillance camera, and
所述存储模块,还用于预先存储用户设置的多个指纹信息及每个指纹信息所对应的报警类型;The storage module is further configured to store a plurality of fingerprint information set by a user and an alarm type corresponding to each fingerprint information in advance;
所述监控摄像头,用于获取监控信息;The monitoring camera is used to obtain monitoring information;
所述主控模块,还用于在判断出所输入的指纹信息与预先存储的指纹信息一致时,确定所输入的指纹信息所对应的报警类型,并获取当前的监控信息和/或用户健康信息和/或环境参数信息,并生成报警信息,且通过所述网络模块将所述报警信息发送至相应的物业管理中心或智慧家庭云服务平台或报警中心或指定的移动终端。The main control module is further configured to determine an alarm type corresponding to the input fingerprint information when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, and obtain current monitoring information and / or user health information and And / or environmental parameter information, and generate alarm information, and send the alarm information to a corresponding property management center or smart home cloud service platform or alarm center or a designated mobile terminal through the network module.
优选地,还包括监测模块,而且,Preferably, a monitoring module is further included, and
所述监测模块,用于实时检测每个功能模块的用电特征信息,所述用电特征信息包括电压信息、电流信息;The monitoring module is configured to detect the power consumption characteristic information of each functional module in real time, and the power consumption characteristic information includes voltage information and current information;
所述主控模块,用于根据所述用电特征信息确定相应功能模块的能耗信息,并将其通过所述网络模块发送至智慧家庭云服务平台;还用于将所述用电特征信息与预先存储的相应功能模块的标准特征信息进行比较,并根据比较结果确定已经发生故障或将要发生故障的功能模块,且将其通过所述网络模块发送至智慧家庭云服务平台。The main control module is configured to determine the energy consumption information of the corresponding functional module according to the power consumption characteristic information, and send it to the smart home cloud service platform through the network module; and is also used to transmit the power consumption characteristic information Compare with the standard feature information of the corresponding functional module stored in advance, and determine the functional module that has failed or is about to fail according to the comparison result, and send it to the smart home cloud service platform through the network module.
有益效果Beneficial effect
实施本发明的技术方案,在符合触发条件时,艺术智能电视可将书画、古董等艺术品的图像展示给用户,既可增加室内生活的艺术性,也可陶冶居民情操,提升居民的幸福感与成就感。而且,对有购买艺术品需求的用户来说,这也是了解艺术品的一个好途径;对于有售卖艺术品需求的用户来说,这也是推广与展示自己艺术品的一个好途径。When the technical solution of the present invention is implemented, when the trigger conditions are met, the art smart TV can display images of works of art such as paintings and antiques to the user, which can not only increase the artistry of indoor life, but also cultivate the sentiment of residents, and enhance the residents' happiness and A sense of accomplishment. Moreover, for users who need to buy art, this is also a good way to understand art; for users who need to sell art, this is also a good way to promote and display their own art.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。附图中:In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without paying creative labor. In the drawings:
图1是本发明艺术智能电视装置实施例一的逻辑结构图;FIG. 1 is a logical structural diagram of a first embodiment of an artistic smart TV device according to the present invention;
图2是本发明艺术智能电视装置实施例二的逻辑结构图。FIG. 2 is a logic structural diagram of a second embodiment of the art intelligent television device of the present invention.
本发明的实施方式Embodiments of the invention
本发明构造一种艺术智能电视装置,该智能电视装置(例如,名字为小球,以下简称装置)可与智慧家庭云服务平台(以下简称平台)、智慧家庭系统、物业管理中心平台、报警中心平台等实现互通互联。其中,智慧家庭系统包括小区门口机、单元楼门口机、室外门口机、室内机及智能家居装置。因此,该装置除了实现基本的电视节目观看的功能外,还可结合互联网、大数据、人工智能以及主动服务于用户的物业管理中心平台、报警中心平台及智慧家庭云服务平台,让用户享受智慧家庭带来的安全、健康、方便、舒适、享受、快捷、人工智能的周全服务。The present invention constructs an artistic smart TV device. The smart TV device (for example, a name is a small ball, hereinafter referred to as a device) can be connected with a smart home cloud service platform (hereinafter referred to as a platform), a smart home system, a property management center platform, and an alarm center. Platforms, etc. Among them, the smart home system includes a door unit for a community, a door unit for a building, an outdoor door unit, an indoor unit, and a smart home device. Therefore, in addition to the basic TV program watching function, the device can also combine the Internet, big data, artificial intelligence, and the property management center platform, alarm center platform, and smart home cloud service platform that actively serve users, allowing users to enjoy wisdom Family brings safety, health, convenience, comfort, enjoyment, fastness, and comprehensive services of artificial intelligence.
图1是本发明智能电视装置实施例一的逻辑结构图,该实施例的艺术智能电视装置包括多个功能模块,而且,该些功能模块包括主控模块101及分别与主控模块101连接的显示模块102、功放模块103、存储模块104、网络模块105、FM模块106、阵列红外检测模块107、健康检测传感器108、指纹传感器109、环境传感器110、接口模块111、麦克风阵列112、拍摄模块113、监控模块114和激光传感器115。FIG. 1 is a logical structural diagram of a first embodiment of a smart TV device according to the present invention. The artistic smart TV device of this embodiment includes a plurality of functional modules, and the functional modules include a main control module 101 and a main control module 101 respectively connected to the main control module 101. Display module 102, power amplifier module 103, storage module 104, network module 105, FM module 106, array infrared detection module 107, health detection sensor 108, fingerprint sensor 109, environmental sensor 110, interface module 111, microphone array 112, shooting module 113 , Monitoring module 114 and laser sensor 115.
在本发明的一个实施例中,主控模块101用于在判断满足触发条件时,从存储模块104中或通过网络模块105从互联网中查找出相应的艺术图像,并控制显示模块102按预设播放模式显示相应的艺术图像;在判断满足关闭条件时,关闭当前正在播放的艺术图像,并进入待机模式。其中,触发条件包括下列中的至少一个:接收到用户输入的相应艺术图像的播放指令;当前模式为回家模式。关闭条件包括下列中的至少一个:接收到用户输入的关闭指令;当前模式为离家模式;当前时间在预设的睡眠时段内;接收到智慧家庭系统发送的访客视频信息。具体地,用户可通过语音输入播放指令或关闭指令,也可通过移动终端的APP输入播放指令或关闭指令。In an embodiment of the present invention, the main control module 101 is configured to find the corresponding art image from the storage module 104 or the Internet through the network module 105 when determining that the trigger condition is met, and control the display module 102 to preset The corresponding art image is displayed in the playback mode; when it is judged that the closing condition is satisfied, the art image currently being played is closed, and the standby mode is entered. The trigger condition includes at least one of the following: a playback instruction of a corresponding art image input by a user is received; and the current mode is a home mode. The shutdown condition includes at least one of the following: a shutdown instruction input by the user is received; the current mode is away from home mode; the current time is within a preset sleep period; and a visitor video message sent by the smart home system is received. Specifically, the user may input a playback instruction or a shutdown instruction through a voice, and may also input a playback instruction or a shutdown instruction through an APP of a mobile terminal.
在该实施例中,在符合触发条件时,艺术智能电视可将书画、古董等艺术品的图像在电视上展示给用户,既可增加室内生活的艺术性,也可陶冶居民情操,提升居民的幸福感与成就感。而且,对有购买艺术品需求的用户来说,这也是了解艺术品的一个好途径;对于有售卖艺术品需求的用户来说,这也是推广和展示自己艺术品的一个好途径。在一些具体例子中,当需要在装置上展示艺术图像时,用户可通过语音或APP开启,或者,智慧家庭系统探测到用户回家时开启回家模式,自动开启艺术图像的展示。当不需要在装置上展示艺术图像时,用户可通过语音或APP关闭,或者,在判断出当前模式为离家模式时或当前时段在预设的睡眠时段(例如23点至7点时段,13点至15点时段)时,自动关闭艺术图像的展示,并进入休眠节能状态,或者,在有访客到来时,智慧家庭系统将访客视频信息发送至装置时,自动将艺术图像的显示切换为访客。具体地:用户可以手机APP操作选择自己喜好的艺术画推送到装置上显示,也可以通过语音告诉装置,“小球、小球,我想看蒙娜丽莎画像”,装置自动显示蒙娜丽莎画像,并记录喜好艺术画数据;当开启回家模式时,显示模块会根据室内光线亮度开启适当的屏幕亮度来显示用户喜好的艺术画或经典文物图片。当用户需要进入操作界面操作时,可通过人体感应、指纹识别、语音、密码方式登录操作界面。早上系统闹钟叫醒用户时,显示屏恢复艺术画经典文物图片显示。如果用户考虑省电,可以直接跟装置讲,“小球、小球,你不用展示自己了”,装置就会黑屏保持休眠节能状态直至下一个场景或需求触发。也可以通过阵列红外检测模块或拍摄模块检测没有用户在客厅时,装置自动会黑屏保持休眠节能状态。另外,用户观看艺术图像的记录可上传至平台,而且,平台还可根据大数据分析用户需求特点,有针对性的提供相关服务,以及,帮普通用户分析判断购买艺术作品的知识。In this embodiment, when the trigger conditions are met, the art smart TV can display images of works of art such as calligraphy, paintings, and antiques to the user, which can not only increase the artistry of indoor life, but also cultivate the sentiment of residents, and enhance the happiness of residents. Sense and achievement. Moreover, for users who need to buy art, this is also a good way to understand art; for users who need to sell art, this is also a good way to promote and display their own art. In some specific examples, when an artistic image needs to be displayed on the device, the user can turn it on through voice or APP, or the smart home system detects that the user turns on the home mode and automatically starts displaying the artistic image. When it is not necessary to display artistic images on the device, the user can turn off by voice or APP, or when it is determined that the current mode is away from home mode or the current period is in a preset sleep period (for example, from 23:00 to 7 o'clock, 13 (From 15:00 to 15:00), automatically close the display of art images and enter the sleep energy-saving state, or, when a visitor arrives, the smart home system automatically switches the display of art images to visitors when a visitor's video information is sent to the device . Specifically: The user can operate the mobile APP to select his favorite art picture and push it to the device for display. He can also tell the device by voice, "small ball, small ball, I want to see the portrait of Mona Lisa", and the device automatically displays Mona Li Sha portrait, and record favorite art painting data; when the home mode is turned on, the display module will turn on the appropriate screen brightness according to the indoor light brightness to display the user's favorite art painting or classic cultural relic picture. When the user needs to enter the operation interface for operation, he can log in to the operation interface through human body sensing, fingerprint recognition, voice, and password. When the system alarm clock wakes up the user in the morning, the display resumes the classic art relic picture display. If the user is thinking about saving power, he can directly talk to the device, "Small ball, small ball, you don't need to show yourself", the device will stay blank and stay in the energy-saving state until the next scene or demand triggers. It can also be detected by the array infrared detection module or shooting module that when the user is not in the living room, the device automatically blanks the screen to maintain the sleep energy-saving state. In addition, the user's viewing of art images can be uploaded to the platform. In addition, the platform can analyze the characteristics of user needs based on big data, provide targeted services, and help ordinary users analyze and judge the knowledge of purchasing art works.
在本发明的一个实施例中,主控模块101还用于在显示艺术图像时,从存储模块104中或通过网络模块105从互联网中查找出艺术图像所对应的解说信息,并控制功放模块103播放解说信息;还用于在判断出当前所显示的艺术图像超过预设时间未更换时,通过功放模块103输出更换提示信息。In an embodiment of the present invention, the main control module 101 is further configured to, when displaying an artistic image, find out the explanatory information corresponding to the artistic image from the storage module 104 or the Internet through the network module 105, and control the power amplifier module 103 Play commentary information; also used to output replacement prompt information through the power amplifier module 103 when it is determined that the currently displayed art image has not been replaced for more than a preset time.
在该实施例中,当用户需要讲解艺术作品时,装置可语音讲解每个艺术照的来由、艺术特点、艺术内涵、市场价值等,吸引和提高用户的思想认识、生活经验、艺术修养,以满足提高用户的审美能力,培养个人品德,提高人们思想认识,陶冶情操,开发人们的智力,增加智慧,拓宽认识。通过这种积极的娱乐方式,能娱情怡神,促进人们的身心健康等。另外,如果展示的艺术图像长期不更换,装置还会定期提醒,还可自动语音询问用户的喜好,以便更换所展示的艺术图像。In this embodiment, when the user needs to explain an artistic work, the device can explain the origin of each artistic photo, artistic characteristics, artistic connotation, market value, etc., to attract and improve the user's ideological understanding, life experience, and artistic accomplishment. In order to meet the needs of improving users' aesthetic ability, cultivate personal morality, improve people's ideological understanding, cultivate sentiment, develop people's intelligence, increase wisdom, and broaden their understanding. Through this active form of entertainment, people can be entertained, and people's physical and mental health can be promoted. In addition, if the displayed art image is not replaced for a long period of time, the device will also periodically remind and automatically ask the user's preferences in order to replace the displayed art image.
在本发明的一个实施例中,拍摄模块113包括至少一组双目摄像头。主控模块101还用于将双目摄像头所拍摄的图像合成3D图像,而且,在接收到用户输入的移植指令时,将当前播放的艺术图像处理成3D艺术场景,并将用户的3D图像移植到3D艺术场景中。关于双目摄像头,还需说明的是,双目摄像头主要利用人的双眼立体视觉原理,摄取用户3D影像,也可扩展多个摄像头一起摄取用户3D的影像,3D影像可用于立体视频电话、3D立体监控、人工智能助理、3D试衣、互动游戏、远程教学、远程问诊、视频会议等其它场景系统应用。In one embodiment of the present invention, the photographing module 113 includes at least one set of binocular cameras. The main control module 101 is also used to synthesize the images captured by the binocular camera into a 3D image, and when receiving the transplant instruction input by the user, the currently played art image is processed into a 3D art scene, and the user's 3D image is transplanted Into a 3D art scene. Regarding the binocular camera, it should also be noted that the binocular camera mainly uses the principle of human binocular stereo vision to capture users '3D images, and multiple cameras can be extended to capture users' 3D images together. 3D images can be used for stereo video calls, 3D Stereo surveillance, artificial intelligence assistants, 3D fitting, interactive games, distance learning, remote consultation, video conference and other scene system applications.
在该实施例中,装置或平台对艺术图像进行加工处理,可让艺术图像变成活动的3D艺术场景,而且,还可以将实时获取的用户的3D图像移植到艺术场景中去,让用户与古代艺术品进行穿越式的体验,例如,将清明上河图转换成3D艺术场景,用户的3D图像可行走在该艺术场景中,以进行更真实的体验。In this embodiment, the device or platform processes the artistic image, so that the artistic image can be turned into an active 3D artistic scene, and the 3D image of the user obtained in real time can be transplanted into the artistic scene, so that the user can communicate with the artistic scene. Ancient art works through the experience, for example, the Qingming Shanghe map is converted into a 3D art scene, and the user's 3D image can walk in the art scene for a more realistic experience.
在本发明的一个实施例中,主控模块101还用于对双目摄像头所拍摄的用户图像及激光传感器115和/或外红传感器(未示出)所探测的距离信息进行分析,并获取用户的动作和姿态信息,而且,根据动作和姿态信息对相应功能模块进行操控。In an embodiment of the present invention, the main control module 101 is further configured to analyze the user image captured by the binocular camera and the distance information detected by the laser sensor 115 and / or an outer red sensor (not shown), and acquire The user's motion and posture information, and the corresponding function module is controlled according to the motion and posture information.
在该实施例中,双目摄像头还可以结合激光传感器和/或红外传感器,形成虚拟操作键盘,供用户通过姿态或动作来对相应功能模块进行操作与控制。In this embodiment, the binocular camera may also be combined with a laser sensor and / or an infrared sensor to form a virtual operation keyboard for a user to operate and control the corresponding function module through gestures or actions.
在本发明的一个实施例中,主控模块101还用于对通过网络模块105接收的多屏互动信息进行处理,并控制显示模块102和功放模块103播放多屏互动信息。In an embodiment of the present invention, the main control module 101 is further configured to process the multi-screen interactive information received through the network module 105, and control the display module 102 and the power amplifier module 103 to play the multi-screen interactive information.
在该实施例中,装置通过网络模块从手机或PAD等移动终端接收多屏互动信息,而且还用户移动终端的传屏信息进行显示与播放。具体应用场景为:首先,语音唤醒装置进入多屏互动状态,使装置处于待连接状态;然后,用户在移动终端上打开多屏互动软件,搜索或直接添加该装置;当连接成功后,用户开启软件的无线传屏功能,就可以把移动终端上播放视频画面和声音传输到装置上进行显示或播放了。In this embodiment, the device receives multi-screen interactive information from a mobile terminal such as a mobile phone or a PAD through a network module, and also displays and plays the screen transfer information of the user's mobile terminal. The specific application scenarios are: first, the voice wake-up device enters a multi-screen interactive state, leaving the device in a state to be connected; then, the user opens the multi-screen interactive software on the mobile terminal, searches for or adds the device directly; when the connection is successful, the user turns on The software's wireless screen transfer function can transmit video images and sounds played on the mobile terminal to the device for display or playback.
在本发明的一个实施例中,主控模块101还用于在显示艺术图像或休眠状态时,若根据阵列红外检测模块107的检测结果判断出用户移动到特定位置且在特定位置停留的时间超过第一预设值时,通过功放模块103输出第一语音提示;还用于在电视开启后,若根据阵列红外检测模块107的检测结果判断出用户在特定位置停留的时间超过第二预设值时,通过功放模块103输出第二语音提示;还用于在电视开启后,若根据阵列红外检测模块107的检测结果判断出用户离开特定位置超过第三预设值时,自动关闭或进入休眠模式;还用于若根据阵列红外检测模块107的检测结果判断出用户的运动轨迹停止,且停止时间超过第四预设值时,联动开启相应的功能模块,并通过功放模块103输出第四语音提示。关于阵列红外检测模块107,需说明的是,其可内嵌在装置内部,并通过探测孔发射出红外信号,从而可在不接触被测物体的前提下探测物体表面的温度,进而确定物体的运动轨迹、数量、姿态(站立与卧倒)等。In an embodiment of the present invention, the main control module 101 is further configured to, when displaying an artistic image or a dormant state, if it is determined according to the detection result of the array infrared detection module 107 that the user moves to a specific position and stays at the specific position for longer than When the first preset value is used, the first voice prompt is output through the power amplifier module 103. It is also used to determine that, after the TV is turned on, according to the detection result of the array infrared detection module 107, the user stays at a specific position for a longer time than the second preset value When the second voice prompt is output through the power amplifier module 103; it is also used to automatically turn off or enter the sleep mode if the user determines that the user has left a specific position exceeding a third preset value based on the detection result of the array infrared detection module 107 ; Also used to determine if the user's motion trajectory stops according to the detection result of the array infrared detection module 107 and the stop time exceeds a fourth preset value, and the corresponding function module is activated in conjunction, and a fourth voice prompt is output through the power amplifier module 103 . Regarding the array infrared detection module 107, it should be noted that it can be embedded in the device and emit infrared signals through the detection hole, so that the surface temperature of the object can be detected without touching the measured object, and the object's temperature can be determined. Movement trajectory, quantity, posture (standing and lying down), etc.
在该实施例中,具体应用场景例如为:在特定位置设置沙发,当用户在电视对面沙发坐下后达到自定义时间阀值时,装置自动语音提示用户是否需要看电视;当用户全部离开或离家或就寝模式时,装置自动关闭电视或休眠;当用户回家开启回家模式时,装置唤醒进入艺术显示状态;当老人长时间在电视对面沙发看电视时,装置会定时提醒老人注意活动身体或保护视力;当老人长时间坐立或躺卧时,结合老人体温、语音、视频来判断老人是否处于正常状态,并将当前紧急状态发送给相关亲人或护理人员或医院,以便及时对老人进行抢救。电视一般是家庭最喜爱的家用电器之一,同时也是刚需家用电器。传统的电视或常规智能电视,因没有相关感知、安全和健康检测功能,因此为实现关爱老人或看护家庭小孩,用户需要增加多个智能设备,即不经济,也不方便管理,还影响室内装饰效果。本装置集成多种传感与检测器,在客厅或卧室为关爱老人与小孩提供智慧地探测分析信息及推送、安全、健康、陪护等多项服务,是解决老龄社会和文明社会最重要的智能设备之一。In this embodiment, a specific application scenario is, for example, setting a sofa at a specific position. When the user reaches a custom time threshold after sitting on the sofa opposite to the TV, the device automatically prompts the user whether or not they need to watch TV; when the user leaves or When leaving home or sleeping mode, the device automatically turns off the TV or sleeps; when the user goes home to turn on the home mode, the device wakes up to enter the artistic display state; when the elderly watch the TV on the sofa opposite the TV for a long time, the device will remind the elderly to pay attention to the activity regularly Protect your body or eyesight; when the elderly is sitting or lying for a long time, use the temperature, voice, and video of the elderly to determine whether the elderly are in a normal state and send the current emergency situation to the relatives or caregivers or hospitals in order to promptly treat the elderly Carry out a rescue. Televisions are generally one of the household's favorite appliances, and they are also just needed. Traditional TVs or conventional smart TVs do not have related sensing, safety, and health detection functions. Therefore, in order to care for the elderly or care for children in the family, users need to add multiple smart devices, which is uneconomical, inconvenient to manage, and affects interior decoration. effect. This device integrates a variety of sensors and detectors, and provides intelligent detection and analysis of information and push, safety, health, and escort services in the living room or bedroom for the care of the elderly and children. It is the most important intelligence to solve the aging society and civilized society. One of the devices.
在本发明的一个实施例中,主控模块101还用于在接收到用户输入的相应音乐或广播的播放指令时,从存储模块104中或通过网络模块105从互联网中查找出相应的音乐文件,或,将FM模块106调频到指定频道,并控制功放模块103播放音乐文件或相应频道的广播信息。功放模块103优选为双声道音频、立体声输出的大功率功放模块,可满足一般用户家用背景音乐与广播欣赏需求。In an embodiment of the present invention, the main control module 101 is further configured to find the corresponding music file from the storage module 104 or the Internet through the network module 105 when receiving the corresponding music or broadcast playback instruction input by the user. Or, the FM module 106 is frequency-modulated to a specified channel, and the power amplifier module 103 is controlled to play a music file or broadcast information of a corresponding channel. The power amplifier module 103 is preferably a high-power power amplifier module with two-channel audio and stereo output, which can meet the needs of home users for background music and broadcast appreciation.
在该实施例中,用户可以通过装置和移动终端的人机交互语音和软件菜单方式选择自己喜欢的音乐和FM调频台进行播放欣赏。例如“小球,小球,我想听成龙演唱的男儿当自强歌”,装置识别到用户语音指令后,自动播放对应歌曲。回家模式启动时,装置可以自动播放上次没有播放完的音乐,也可以重新播放用户的喜好音乐。In this embodiment, the user can select his favorite music and FM FM station for playback and appreciation through the human-machine interactive voice and software menu modes of the device and the mobile terminal. For example, "Small ball, small ball, I want to listen to Jackie Chan singing as a self-improvement song." After the device recognizes the user's voice command, the device automatically plays the corresponding song. When the home mode is activated, the device can automatically play the music that did not finish last time, or it can replay the user's favorite music.
在本发明的一个实施例中,主控模块101还用于在接收到用户输入的形象指导指令时,对双目摄像头所拍摄的用户的3D图像进行图像分析,以获取用户当前的形象信息,并根据预先所存储的多个形象模板信息确定用户当前形象的缺陷信息及改进信息,且通过功放模块输出用户当前形象的缺陷信息及改进信息,其中,形象信息包括发型信息、妆容信息、衣着信息。In an embodiment of the present invention, the main control module 101 is further configured to perform image analysis on the 3D image of the user captured by the binocular camera when receiving the image guidance instruction input by the user to obtain the current image information of the user. The defect information and improvement information of the current image of the user are determined according to multiple image template information stored in advance, and the defect information and improvement information of the current image of the user are output through the power amplifier module, wherein the image information includes hairstyle information, makeup information, and clothing information .
在该实施例中,装置还可结合装置的环境传感器、摄像机等帮助个人完成多项任务或服务的虚拟助理,为用户提供全新人机交互方式的服务助理,并在此基础上还可以实现大量的平台运营应用。为用户提供如订机票、购物、出行打车、形象设计、预约挂号等等。In this embodiment, the device can also be combined with the device's environmental sensors, cameras, and other virtual assistants that help individuals complete multiple tasks or services, and provide users with a new human-computer interaction service assistant. Based on this, a large number of service assistants can also be implemented. Platform operation application. Provide users with air tickets, shopping, taxi trips, image design, appointment registration and so on.
下面说明作为虚拟助理的几个应用场景:例如,用户早上出门前,站在装置前语音告诉装置,“小球,小球,今天要去见一个重要客户,我要怎么注意一下自己的形象呢?”装置根据双目摄像头摄取用户3D影像分析用户有没有梳头、理胡须,穿的什么衣服,然后装置会告诉用户该如何注意着装,发型及化妆,并在实时更换衣服时予以指导等。再例如,用户做饭时才发现没有盐了,站在装置前语音告诉装置,“小球,小球,我要买一包盐(装置回复“已帮您在附近商店找到三个品牌盐,分别价格是……,请问您需要那个品牌”)”,用户告诉装置“我要海盐1号(装置回复:已为您购买海盐1号,请您授权支付)”,用户通过装置指纹认证后完成系统支付后,只需要在家等待送货人送盐上门了。再例如,早上用户出门前询问装置,“小球、小球,今天天气怎么样?(装置回复:今天阴天有小雨,温度10度,室外PM2.5值210属重度污染,请出门带雨具,穿防寒外套,并带好口罩)”。用户冬天闭户在家取暖,装置感知长时间闭户导致室内CO2、空气干燥时,装置语音提醒用户“目前室内CO2超标,请打开窗户(窗户没有自动窗,也没有新风系统的用户,有新风的用户可以联动自动开启新风换气)”;或“目前室内相对湿度低于20%,请开启加湿器或在室内放一盆水,注意饮水补充水分”(没有联动加湿器的用户)等服务用户场景。The following describes several application scenarios as a virtual assistant: For example, before the user goes out in the morning, he stands in front of the device and tells the device, "Small ball, small ball. I want to meet an important customer today. How can I pay attention to my image? ? ”The device analyzes whether the user combs his hair, trims his beard, or what clothes he wears based on the 3D image captured by the binocular camera. Then the device will tell the user how to pay attention to the dress, hairstyle, and makeup, and provide guidance when changing clothes in real time. For another example, when the user notices that there is no salt when cooking, standing in front of the device and telling the device, "Small ball, small ball, I want to buy a pack of salt (the device reply" has helped you find three brands of salt in nearby stores, respectively The price is ..., which brand do you need? "), The user told the device" I want Haiyan No. 1 (device response: I have purchased Haiyan No. 1 for you, please authorize payment) ", the user completes the system after passing the device fingerprint authentication After paying, you just need to wait for the delivery person to deliver the salt at home. For another example, the user asks the device before going out in the morning, "Small ball, small ball, how is the weather today? (Device response: Today is cloudy with a light rain, the temperature is 10 degrees, and the outdoor PM2.5 value of 210 is severe pollution. Please go out with rain gear , Wear a cold jacket and wear a mask). " When the user closes the house to warm up at home in winter, when the device senses that the indoor CO2 and air are dry for a long time, the device voice reminds the user that "the current indoor CO2 exceeds the standard, please open the window (the window has no automatic window, and there is no fresh air system. Users can link to automatically turn on the fresh air for ventilation) "or" the current indoor relative humidity is less than 20%, please turn on the humidifier or put a basin of water indoors, pay attention to drinking water to add moisture "(users without linked humidifier) and other service users Scenes.
在本发明的一个实施例中,主控模块101还用于在接收到用户输入的试衣指令时,接收用户从多个服装图像信息中选择指定的服装,并将用户预先输入的身体参数信息与指定的服装进行整合,以生成试衣效果的3D图像,而且,控制显示模块显示试衣效果的3D图像。In an embodiment of the present invention, the main control module 101 is further configured to, when receiving the fitting instruction input by the user, receive the user to select the specified clothing from the plurality of clothing image information, and input the body parameter information previously input by the user Integrate with the specified clothing to generate a 3D image of the fitting effect, and control the display module to display the 3D image of the fitting effect.
在该实施例中,装置内置3D试衣软件,根据用户输入身体各个参数,比如腿长、胳臂长、发型、肤色等,用户随意选择创建好3D模型的衣服,即可试穿,试穿过程中,可以随意变化角度,通过3D显示屏从每一个角度看到试衣效果。在试穿好了之后,可以保存分享,也可以随意变换自己的风格、颜色等,以节省在实体店购物带来的不必要的麻烦。In this embodiment, the device has built-in 3D fitting software. According to the user's input of various body parameters, such as leg length, arm length, hairstyle, skin tone, etc., the user can choose clothes that have created a 3D model at will, and then try on the process. You can change the angle at will, and see the fitting effect from every angle through the 3D display. After trying it on, you can save and share, or change your own style, color, etc., to save unnecessary trouble caused by shopping in physical stores.
在本发明的一个实施例中,主控模块101还用于在接收到用户输入的游戏指令时,根据双目摄像头所拍摄的用户的3D图像获取用户的位置信息及姿态信息,并根据位置信息及姿态信息控制显示模块102和/或功放模块103;还用于通过拍摄模块113获取特定平面画的图像,并将图像转换成3D图像,而且,将用户的3D图像或平面画的3D图像加载在相应的游戏场景中。In an embodiment of the present invention, the main control module 101 is further configured to obtain position information and posture information of the user according to the 3D image of the user captured by the binocular camera when receiving a game instruction input by the user, and according to the position information And attitude information to control the display module 102 and / or the power amplifier module 103; it is also used to obtain an image of a specific plane drawing through the photographing module 113, and convert the image into a 3D image, and load a 3D image of the user or a 3D image of the plane drawing In the corresponding game scene.
在该实施例中,装置通过双目摄像头采集到的用户立体视频流,并分析用户身体部位的骨骼、手势、方位移动及变化,与显示屏中的虚拟人物对应,当用户手出拳则虚拟用户人物也出拳,当用户抬脚则虚拟用户人物也抬脚,当用户退后则虚拟用户人物也退后,当用户左右移动则虚拟人物也左右移动,当用户跳时虚拟人物也跳等等,实现现实用户与虚拟人物行为同步,再加上虚拟游戏场景如拳打下落物、移动接物、手势抓起或打击等实现3D互动游戏功能。还可以将用户绘制的动植特图画或喜欢的印刷图画扫描输入装置,装置通过软件算法自动将输入图画转换成装置内的3D图像,并且用户可自己录制每个动植物的特性或想要说的话,当用户触屏接触到装置内的动植物显示范围时,它们会自动说出用户预告录制的声音,可以给用户提供展示和交互的平台。装置通过附带有这些功能,不需要用户投入大量资金就实现3D互动功能的需求是很有吸引力的。In this embodiment, the device analyzes the user's stereo video stream collected by the binocular camera, and analyzes the bones, gestures, azimuth movements and changes of the user's body parts, corresponding to the virtual characters in the display screen. The user character also punches, when the user lifts his foot, the virtual user character also lifts his foot, when the user backs up, the virtual user character also backs up, when the user moves left and right, the virtual character also moves left and right, when the user jumps, the virtual character also jumps, etc. To achieve real-time user and virtual character synchronization, coupled with virtual game scenes such as punching falling objects, moving objects, grabbing or hitting gestures to achieve 3D interactive gaming functions. The input device can also be scanned by the user for special pictures of plants and animals or printed pictures you like. The device automatically converts the input pictures into 3D images in the device through software algorithms. The user can record the characteristics of each animal or plant or want to say If the user touches the screen and touches the animal and plant display range in the device, they will automatically speak the sound recorded by the user's notice, which can provide a platform for users to display and interact. By having these functions attached to the device, the need to implement 3D interactive functions without the user having to invest a lot of money is very attractive.
在本发明的一个实施例中,主控模块101还用于在接收到用户输入的视频电话指令时,在与指定联系人建立连接后,将双目摄像头所拍摄的用户的3D图像及语音信息通过网络模块105实时发送至指定联系人的移动终端或装置,及通过网络模块105接收指定联系人的移动终端或装置所发送的指定联系人的3D图像及语音信息,并控制显示模块102显示所接收的3D图像及功放模块103播放语音信息,以实现与指定联系人的3D全息视频通话。In an embodiment of the present invention, the main control module 101 is further configured to, upon receiving a videophone instruction input by a user, establish a connection with a designated contact, and then 3D image and voice information of the user captured by the binocular camera. Real-time sending to the mobile terminal or device of the designated contact via the network module 105, and receiving the 3D image and voice information of the designated contact sent by the mobile terminal or device of the designated contact via the network module 105, and controlling the display module 102 to display the The received 3D image and power amplifier module 103 plays voice information to implement a 3D holographic video call with a designated contact.
在该实施例中,装置自带超大显示屏 + 多摄像头摄取用户3D立体影像,因此可以现实用户与用户之间的3D视频交流,还可以通过用户扩展背部摄像头与前面的多个摄像头摄取用户3D立体影像与用户VR眼镜以及用户移动终端全息3D软件及装置一起,实现用户VR立体现场视频通话与用户移动端3D全息视频通话。当用户有保密通话需求时,用户还可以通过用户扩展的蓝牙耳机或有线耳机来听取对方声音。用户之间可以实现的3D VR可视、3D全息可视、语音、文字、图片等多方式交流,并且还图文并茂,形象直观,体验感好。In this embodiment, the device comes with a large display screen and multiple cameras to capture the user's 3D stereoscopic images, so that 3D video communication between the user and the user can be realized, and the user can expand the back camera and multiple cameras in front to capture the user's 3D Together with the user's VR glasses and the holographic 3D software and device of the user's mobile terminal, the stereo image realizes the user's VR stereo live video call and the user's mobile 3D holographic video call. When the user needs a confidential call, the user can also listen to the other party's voice through the user's extended Bluetooth headset or wired headset. Users can communicate in 3D VR visualization, 3D holographic visualization, voice, text, and pictures in multiple ways, and also have pictures and texts, an intuitive image, and a good experience.
在本发明的一个实施例中,主控模块101还用于在远程教育模式下,将双目摄像头所拍摄的用户的3D图像及语音信息通过网络模块实时发送至远程老师的终端,并通过网络模块接收老师的3D图像及语音信息,以实现远程实时教育。In an embodiment of the present invention, the main control module 101 is further configured to send the 3D image and voice information of the user captured by the binocular camera to the terminal of the remote teacher in real time through the network module in the remote education mode, and through the network The module receives the teacher's 3D image and voice information to achieve remote real-time education.
在该实施例中,装置的远程教学功能可让孩子更轻松的学习理论知识,锻炼孩子的意志力,激发孩子的学习兴趣和学习能力。教育学习适应用户群体适合全年龄阶段,例如可以视频在线教学,可以语音跟读或互动教学,可以营造英语环境等。这将给用户的信息技术课程增添活力,成为培养中小学生综合能力、信息素养的优秀平台。In this embodiment, the remote teaching function of the device can make it easier for children to learn theoretical knowledge, exercise their willpower, and stimulate their learning interest and learning ability. Educational learning adapts to user groups suitable for all ages, such as video online teaching, voice reading or interactive teaching, and English environment. This will add vitality to users' information technology courses and become an excellent platform for cultivating the comprehensive ability and information literacy of primary and secondary school students.
在本发明的一个实施例中,麦克风阵列112用于接收用户通过语音输入的相应智能装置的控制指令,智能装置包括艺术智能电视装置和/或智能家电装置,而且,智能家电装置与艺术智能电视装置通过接口模块111相连。主控模块101用于对麦克风阵列112所接收的控制指令进行声纹识别,以获取用户的声纹特征,并在判断出所获取的声纹特征与预先设置的声纹特征一致时,根据控制指令确定待控制的智能装置的标识及指令信息,并将指令信息发送至相应的智能装置;还用于在收到单元门口机发送的用户开门指令时,按照预设的回家预备模式获取待控制的智能装置的标识及指令信息,并将指令信息发送至相应的智能装置。In one embodiment of the present invention, the microphone array 112 is configured to receive a control instruction of a corresponding smart device input by a user through voice. The smart device includes an art smart TV device and / or a smart home appliance device. Furthermore, the smart home appliance device and the art smart TV device The devices are connected through the interface module 111. The main control module 101 is configured to perform voiceprint recognition on the control instruction received by the microphone array 112 to obtain the voiceprint characteristics of the user, and when it is determined that the acquired voiceprint characteristics are consistent with the preset voiceprint characteristics, according to the control instruction Determine the identification and instruction information of the intelligent device to be controlled, and send the instruction information to the corresponding intelligent device; it is also used to obtain the to-be-controlled according to the preset home preparation mode when the user's door opening instruction sent by the unit door phone is received. The smart device's identification and instruction information, and send the instruction information to the corresponding smart device.
在该实施例中,具体应用场景例如为:当用户在大楼单元门通过身份识别开门后,对装置自动开启回家预备模式,根据用户的喜好环境要求开启室内空调及家用电器,改善室内环境;当装置探测到用户走近电视时,可自动语音问候用户和询问用户的服务需求。再例如,由于装置内置的麦克风阵列用户本人语音才能正常唤醒系统,没有授权的其它人是无法开启装置的;当用户有访客来访时,用户可以临时开启开放模式,没有授权用户也可以语音控制授权控制范围内的家居智能系统,这种全宅声纹人机交互控制结构,可满足普及化应用的刚性需求,减少用户普及智慧家庭的投资门槛,又能引导与吸引用户扩展其它功能投资消费,还大大提高用户操作体验感,并兼顾用户隐私需求等。另外,通过人机交互可以实现可视对讲、视频监控、家居控制、用户扩展系统的配置安装、不同类别报警求助功能、环境监测、音乐欣赏、艺术鉴赏、远程开门、故障报修等社区服务、互动游戏、视频电话、购物等生活服务、教育学习、健康服务等功能。In this embodiment, a specific application scenario is, for example, when a user opens a door on a building unit door through identity recognition, the device automatically turns on the home preparation mode, and turns on indoor air-conditioning and household appliances according to the user's preference environment requirements to improve the indoor environment; When the device detects that the user is approaching the TV, it can automatically greet the user and ask the user for service needs. For another example, because the built-in microphone array user's own voice can wake the system normally, other people without authorization cannot turn on the device; when the user visits, the user can temporarily open the open mode, and the unauthorized user can also control the authorization by voice The home intelligent system within the control range, the whole house voiceprint human-machine interactive control structure, can meet the rigid demand of popularized applications, reduce the investment threshold for users to popularize smart homes, and guide and attract users to expand other functions, investment and consumption. It also greatly improves the user experience and takes into account the privacy needs of users. In addition, through human-computer interaction, community services such as video intercom, video surveillance, home control, user extension system configuration and installation, different types of alarm help functions, environmental monitoring, music appreciation, art appreciation, remote door opening, and fault reporting and repair can be implemented. Interactive games, video phones, shopping and other living services, education and learning, health services and other functions.
在本发明的一个实施例中,主控模块101还用于被唤醒后接在收到翻译指令时,对所接收的语音信息进行翻译,并通过显示模块102或功放模块103输出翻译信息。在该实施例中,待翻译的语音信息可为麦克风阵列接收的语音信息,也可为装置播放的语音信息,或者为智慧家庭系统中门口机接收的访客语音信息。而且,翻译信息可通过语音形式从功放模块中输出,也可通过文字形式从现实模块中输出。应用场景例如为: “小球,我想与韩国朋友交流”,装置自动开启中韩语言互译状态,一个人说完中文结尾加上“小球”后,装置会自动将中文翻译成韩文语音与文字;另一个人说完韩文结尾加上韩文的“小球”发音或中文“小球”后,装置会自动将韩文翻译成中文声音与文字。这样家里来了外国朋友或与远程外国朋友视频或语音就可以顺利进行交流了。In an embodiment of the present invention, the main control module 101 is further configured to translate the received voice information when receiving a translation instruction after being awakened, and output the translation information through the display module 102 or the power amplifier module 103. In this embodiment, the voice information to be translated may be voice information received by the microphone array, voice information played by the device, or guest voice information received by a door phone in a smart home system. Moreover, the translation information can be output from the power amplifier module in the form of voice, or it can be output from the reality module in the form of text. The application scenario is, for example: "Small ball, I want to communicate with Korean friends", the device automatically turns on the Chinese-Korean language translation state. After one person finishes adding "small ball" at the end of Chinese, the device will automatically translate Chinese into Korean voice And text; after another person speaks Korean at the end with the Korean "small ball" pronunciation or Chinese "small ball", the device will automatically translate Korean into Chinese sounds and text. In this way, a foreign friend at home or video or voice communication with a remote foreign friend can smoothly communicate.
在本发明的一个实施例中,健康检测传感器108可设置在装置内部,且传感部位外露或外置,当然,健康检测传感器108也可通过相应接口模块111与主控模块101相连。而且,健康检测传感器108用于检测用户的健康信息,健康信息包括体温、心率、血氧、血压趋势、脉搏波;主控模块101还用于在健康检查模式下,记录健康检测传感器所检测的健康信息,并与用户在医院检查的健康与诊断信息形成电子健康档案,而且,将健康信息及电子健康档案通过网络模块推送至智慧家庭云服务平台或远程医生的终端。In one embodiment of the present invention, the health detection sensor 108 may be disposed inside the device, and the sensing part is exposed or external. Of course, the health detection sensor 108 may also be connected to the main control module 101 through the corresponding interface module 111. In addition, the health detection sensor 108 is used to detect the user's health information, and the health information includes body temperature, heart rate, blood oxygen, blood pressure trend, and pulse wave; the main control module 101 is also used to record the health detected by the health detection sensor in the health check mode. Health information, and form an electronic health file with the user's health and diagnostic information checked in the hospital, and push the health information and electronic health file to the smart home cloud service platform or the terminal of the remote doctor through the network module.
在该实施例中,首先说明的是,虽然现在市场上很多穿戴设备带有健康检测传感器,但首先用户得自己去买这些穿戴设备,其次穿戴设备检测到的数据只有自己知道,其三穿戴设备检测到的数据需要移动到电脑或云端,因此要想普及化智慧健康还存在居多不确定因素。而在该实施例中,装置内置多种健康检测传感器,并且将来用户还可扩展市场上的最新健康检测传感器,用户使用时只需靠近或身体部位直接接触装置的健康检测传感器,装置即可检测到用户的体温、心率、心率变异、血氧、血压趋势、脉搏波图等现场检测数据,与用户生病时去医院检查诊断的健康数据、通过装置远程问诊的数据一起通过相关接口输入装置,由装置统一对所有数据进行分析与管理,起到家庭智慧护士的作用,建立每户居民健康档案,并与平台一起,对用户实施健康监控、跟踪、咨询、提醒、预约挂号等个性化健康服务。In this embodiment, it is first explained that although many wearable devices on the market now have health detection sensors, first users have to buy these wearable devices themselves, secondly the data detected by the wearable devices is only known to them, and the three wearable devices The detected data needs to be moved to a computer or the cloud, so there are still many uncertain factors to popularize smart health. In this embodiment, the device has a variety of built-in health detection sensors, and in the future, users can also expand the latest health detection sensors on the market. When users use them, they only need to be close to or directly touch the body's health detection sensors, and the device can detect Enter the user's body temperature, heart rate, heart rate variability, blood oxygen, blood pressure trend, pulse wave chart and other on-site detection data, and go to the hospital to check and diagnose the health data when the user is ill, and enter the device through the device's remote consultation through the relevant interface. The device analyzes and manages all data uniformly by the device, acting as a family smart nurse, establishing a health file for each household, and working with the platform to implement personalized health services such as health monitoring, tracking, consultation, reminders, and appointment registration. .
在本发明的一个实施例中,指纹传感器109和环境传感器110设置在壳体上,而且,指纹传感器109用于接收用户输入的指纹信息;环境传感器110用于检测当前的环境参数信息。主控模块110还用于根据所输入的指纹信息进行用户身份的认证,并在认证通过时,进入相应的操作界面;还用于在判断当前的环境参数信息满足预设条件时,联动开启相应的智能装置,并将当前的环境参数信息发送至相应的物业管理中心或智慧家庭云服务平台或报警中心或指定的移动终端。In one embodiment of the present invention, the fingerprint sensor 109 and the environment sensor 110 are disposed on the housing, and the fingerprint sensor 109 is used to receive fingerprint information input by a user; the environment sensor 110 is used to detect current environmental parameter information. The main control module 110 is further configured to authenticate the identity of the user according to the input fingerprint information, and enters the corresponding operation interface when the authentication is passed; it is also used to determine whether the current environmental parameter information meets the preset conditions, and then activate the corresponding linkage. Intelligent device and sends the current environmental parameter information to the corresponding property management center or smart home cloud service platform or alarm center or designated mobile terminal.
在该实施例中,关于指纹传感,用户可以通过指纹身份开启系统操作界面,也可以在紧急时,定义不同手指为不同报警级别,自动向云服务台或用户移动终端报警,还可以通过用户电视购物支付时身份认证用。关于环境传感器,其包括有:CO、CO2、PM2.5、烟雾及燃气传感器、温湿度传感器、光照传感器。而且,当室内传感器相关指标超标时,装置自动将室内超标数据上传至平台及用户移动终端或联动开启室内窗户、排新风机等;当室内温湿度超标时,装置自动将室内超标数据上传至平台及用户移动终端或联动开启空调、加湿抽湿等;当用户在室内活动,光线逐渐变暗时,装置自动开启室内灯光和窗帘。另外,还可设置人体传感器,例如,当人体靠近时,装置可选择触发从艺术图像的显示到操作主界面的切换;当用户夜晚回家开门时,探测到用户开门进入,装置会自动开启回家模式并语音问候用户,用户也可以语音告诉装置自己的需求。In this embodiment, with regard to fingerprint sensing, the user can open the system operation interface through the fingerprint identity, or in an emergency, define different fingers as different alarm levels, and automatically alert the cloud service desk or the user's mobile terminal. Used for identity verification when paying for TV shopping. The environmental sensors include: CO, CO2, PM2.5, smoke and gas sensors, temperature and humidity sensors, and light sensors. Moreover, when the indoor sensor-related indicators exceed the standard, the device automatically uploads the indoor excess data to the platform and the user's mobile terminal or opens the indoor windows and exhaust fans in conjunction; when the indoor temperature and humidity exceeds the standard, the device automatically uploads the indoor excess data to the platform And the user's mobile terminal or linked to turn on air conditioning, humidification and dehumidification, etc .; when the user is indoors, the light gradually dims, the device automatically turns on indoor lights and curtains. In addition, a human body sensor can be set. For example, when the human body approaches, the device can choose to trigger the switch from the display of artistic images to the main interface of the operation; when the user returns home at night to open the door, the user is detected to enter the door and the device will automatically turn on. Home mode and voice greetings to users, users can also voice the device to their needs.
在本发明的一个实施例中,存储模块104还用于预先存储用户设置的多个指纹信息及每个指纹信息所对应的报警类型;监控摄像头用于获取监控信息,优选为360度全景摄像头;主控模块101还用于在判断出所输入的指纹信息与预先存储的指纹信息一致时,确定所输入的指纹信息所对应的报警类型,并获取当前的监控信息和/或用户健康信息和/或环境参数信息,并生成报警信息,且通过网络模块将报警信息发送至相应的物业管理中心或智慧家庭云服务平台或报警中心或指定的移动终端。In one embodiment of the present invention, the storage module 104 is further configured to store a plurality of fingerprint information set by a user and an alarm type corresponding to each fingerprint information in advance; a monitoring camera is used to obtain monitoring information, and is preferably a 360-degree panoramic camera; The main control module 101 is further configured to determine an alarm type corresponding to the input fingerprint information when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, and obtain current monitoring information and / or user health information and / or Environmental parameter information, and generate alarm information, and send the alarm information to the corresponding property management center or smart home cloud service platform or alarm center or designated mobile terminal through the network module.
在该实施例中,具体应用场景为:假设定义食指为正常开机,中指为120报警,无名指为挟持报警,小指为119报警等,用户不需求语音报警说明内容,即可让报警平台快速了解用户求助需求,并且当有报警时,装置还自动将报警已授权的视频、图片或录音主动推送到用户移动端、物业中心和平台。装置在报警的同时本地还自定义语音报警或人机交互来解决室内误报问题,避免天天“狼来了”的实际问题,让用户直观判断是否存在误报警;自定义语音报警或人机交互还可以让用户知道已经向平台报警或了解当前报警设置工作正常。如有误报则尽快撤消报警,而在布防状态下定义语音报警还可以阻吓非法入侵者。另外,用户可以自定义时间监视与回放,以及发生报警求助时主动推送实时监视图像或相片至用户移动终端及平台,以便用户与平台确认室内情况。考虑到用户隐私,用户还可以手动关闭监控摄像头与麦克风阵列112,并且手动开与关状态系统自我感知,以便布防时提醒用户开启或有隐私要求时关闭;当用户准备出门前或晚上睡觉前,装置会自动语音提醒用户开启监控摄像头与麦克风阵列,以便对室内进行监控与根据需要进行录音,以保障家庭安全,同时保护用户隐私需求;装置内部设置多个传感器,当用户非法拆装设备时,也会自动向物业中心及平台报警,以保障设备安全。In this embodiment, the specific application scenario is: Assume that the index finger is normally turned on, the middle finger is 120 alarm, the ring finger is holding alarm, the little finger is 119 alarm, etc. The user does not need the voice alarm description content, and the alarm platform can quickly understand the user Ask for help, and when there is an alarm, the device also automatically pushes the authorized video, picture or recording of the alarm to the user's mobile terminal, property center and platform. When the device alarms, it also customizes the local voice alarm or human-computer interaction to solve the indoor false alarm problem, avoids the actual problem of "wolf coming" every day, and allows the user to intuitively judge whether there is a false alarm; custom voice alarm or human-computer interaction It also lets the user know that the platform has been alerted or that the current alarm settings are working properly. If there is a false positive, the alarm will be cancelled as soon as possible. Defining a voice alarm in the armed state can also deter illegal intruders. In addition, the user can customize time monitoring and playback, and actively push real-time monitoring images or photos to the user's mobile terminal and platform when an alarm occurs for help, so that the user and the platform can confirm the indoor situation. In consideration of user privacy, users can also manually turn off the surveillance camera and microphone array 112, and manually turn the system on and off to self-aware, so as to remind the user to turn on or turn off when privacy is required; when the user is ready to go out or before going to bed at night, The device will automatically remind the user to turn on the surveillance camera and microphone array to monitor the room and record as needed to ensure family safety and protect the privacy needs of the user. There are multiple sensors inside the device. When the user illegally disassembles the device, It will also automatically report to the property center and platform to ensure the safety of the equipment.
另外,利用装置多接口设计,支持多防区有线、无线报警信号接入,解决已经安装有线报警设备的家庭报警信息接入问题,也解决了没有安装报警设备,又不想破坏装修安装有线报警设备的家庭安装无线报警设备的问题;装置内置电池,保证断电时报警求助信息能正常推送到用户移动端和平台。为保证满足零漏报的规范要求,所有报警信息均通过网络与短信同时向用户移动终端及平台报警,且报警信息采用特定函数编码,以达到平台人工智能及自动化处理要求In addition, the multi-interface design of the device is used to support multi-zone wired and wireless alarm signal access, which solves the problem of access to home alarm information for wired alarm devices that have been installed, and also solves the problem of not installing alarm devices and not wishing to damage the installation of wired alarm devices The problem of installing wireless alarm devices in homes; the device has a built-in battery to ensure that the alarm help information can be pushed to the user's mobile terminal and platform in the event of a power failure. In order to ensure that the requirements of zero false negatives are met, all alarm information is sent to the user's mobile terminal and platform simultaneously through the network and SMS. The alarm information is encoded with a specific function to meet the platform's artificial intelligence and automated processing requirements.
在本发明的一个实施例中,监测模块114用于实时检测每个功能模块的用电特征信息,用电特征信息包括电压信息、电流信息;主控模块101用于根据用电特征信息确定相应功能模块的能耗信息,并将其通过网络模块105发送至智慧家庭云服务平台;还用于将用电特征信息与预先存储的相应功能模块的标准特征信息进行比较,并根据比较结果确定已经发生故障或将要发生故障的功能模块,且将其通过网络模块105发送至智慧家庭云服务平台。常规非大功率消耗能源的功能使用情况下,每个功能模块设置一个标准能耗限定值,当用户大量使用如双目摄像头、功放模块等大功率能耗部件或功能模块导致能耗超过标准限定值后,装置会每天或每周推送装置超标的能耗信息,并提示用户缴纳超标能耗的相关费用,因此,通过能源消耗收费可以扩展装置靠流量及会员进行的增值运营收费。In one embodiment of the present invention, the monitoring module 114 is used to detect the power consumption characteristic information of each functional module in real time, and the power consumption characteristic information includes voltage information and current information; the main control module 101 is used to determine the corresponding information according to the power consumption characteristic information. The energy consumption information of the functional module is sent to the smart home cloud service platform through the network module 105; it is also used to compare the power consumption characteristic information with the standard characteristic information of the corresponding functional module stored in advance, and determine whether the The function module that has failed or is about to fail is sent to the smart home cloud service platform through the network module 105. In the case of conventional non-high-power energy-consuming functions, a standard energy consumption limit is set for each functional module. When users use a large number of high-power energy-consuming components such as binocular cameras, power amplifier modules or functional modules, the energy consumption exceeds the standard limit. After the value is set, the device will push the energy consumption information of the device exceeding the standard daily or weekly, and prompt the user to pay the relevant cost of the energy consumption exceeding the standard. Therefore, the energy consumption charge can expand the device's value-added operation charges based on traffic and members.
在该实施例中,监控模块通过检测各个功能模块的电压、电流、波形等多种因素的微量变化,装置根据这些用电特征信息判断设备功耗、状态等信息。监控模块通过对机器人正常工作状态下的电压、电流、波形等多种因素的学习完成统计装置特征数据收集,得出装置正常的相关参数数据标准,当装置某个参数指标在定义的一段时间内处于偏离标准数据时,会提示用户装置某个功能模块或整机已经出现故障,请及时排除故障,同时平台也可以通过反馈的大数据分析装置故障点通病,以改善和优化装置设计。另外,装置采用模块化设计,如果判断装置的某个功能模块出现故障,可以通过物业服务人员上门将用户装置相应模块进行更换。In this embodiment, the monitoring module detects minute changes in various factors such as voltage, current, and waveform of each functional module, and the device judges information such as power consumption and status of the device according to these power consumption characteristic information. The monitoring module completes the statistical device characteristic data collection through the study of voltage, current, waveform and other factors in the normal working state of the robot, and obtains the normal parameter data standards of the device. When a parameter index of the device is within a defined period of time, When it deviates from the standard data, it will prompt the user that a certain functional module or the entire machine has failed. Please troubleshoot it in time. At the same time, the platform can analyze the faults of the device through the feedback of the big data to improve and optimize the device design. In addition, the device adopts a modular design. If a function module of the device is judged to be faulty, the corresponding module of the user device can be replaced by the property service personnel.
进一步地,在装置内,各个功能模块两边设置,将发热与干扰大的部件设计在一边,将传感器、敏感度高的部件设计在另一边,即可保证用户传统基本功能实现的同时,还可增加如环境监测等众多敏感高的传感器。而且,装置背面中间位置采用凹限设计,主要容纳电视平面安装支架空间,以达到电视安装平面安装支架后与电视背面在同一个平面上,方便装置贴墙安装,以达到与室内装饰墙面协调统一,节约室内空间的目的。同时,装置整合多信号多系统、人工智能、人机交互、丰富的增值业务以及后期用户一般性软硬件扩展消费应用,如微信、QQ、证券投资、外接音箱等、且安装调试简单,用户体验感好,平台还可通过大数据精准快速地分析与判断为用户提供特色需求。此外,装置还具有手机的基本功能,也具有可视对讲及室内快速分类别报警的作用,也具有智能家居中枢功能,也具有机器人感知、学习、分析与执行的功能,具有3D互动、交流、游戏等功能,也具有艺术鉴赏、音乐欣赏的功能,还具有健康检测及服务功能等。为用户提供全方位的智能服务与体验,为实现智慧家庭、智慧社区、智慧城市、智慧中国、平安中国、健康中国梦想而尽自己一份力。Further, in the device, each function module is provided on both sides, and components with high heat and interference are designed on one side, and sensors and sensitive components are designed on the other side, which can ensure the realization of the user's traditional basic functions, and also Add many sensitive sensors such as environmental monitoring. In addition, the middle position of the back of the device adopts a concave design, which mainly accommodates the space of the TV plane mounting bracket, so that the TV installation plane mounting bracket is on the same plane as the back of the TV, which is convenient for the device to be installed on the wall to achieve coordination with the interior decoration wall. The purpose of unity and save interior space. At the same time, the device integrates multiple signals and multiple systems, artificial intelligence, human-computer interaction, rich value-added services, and general consumer software and hardware to expand consumer applications, such as WeChat, QQ, securities investment, external speakers, etc., and simple installation and debugging, user experience Feeling good, the platform can also provide users with special needs through rapid and accurate analysis and judgment of big data. In addition, the device also has the basic functions of a mobile phone, as well as the function of visual intercom and indoor rapid sub-category alarms. It also has the function of a smart home hub. It also has the functions of robot perception, learning, analysis and execution, and 3D interaction and communication. , Games and other functions, also has the function of art appreciation, music appreciation, but also has health detection and service functions. Provide users with a full range of intelligent services and experiences, and do their part to realize the dreams of smart home, smart community, smart city, smart China, safe China, and healthy China.
本发明还构造一种智慧家庭系统,其包括艺术智能电视装置、移动终端、智慧家庭系统、智慧家庭云服务平台、社区物业管理中心平台、110、119、120报警中心。其中,智慧家庭云服务平台包括有艺术品交易平台、人工智能助理平台、远程教育平台、健康及远程问诊服务平台等服务平台。The invention also constructs a smart home system, which includes an artistic smart TV device, a mobile terminal, a smart home system, a smart home cloud service platform, a community property management center platform, and 110, 119, and 120 alarm centers. Among them, the smart home cloud service platform includes art platform, artificial intelligence assistant platform, distance education platform, health and remote consultation service platform and other service platforms.
关于移动终端,其安装有APP软件,其可利用智能手机的指纹识别、麦克风阵列识别语音以及其它移动终端传感器,通过软件算法实现非常用手指纹不同报警级别求助报警及本地自定义语音输出,艺术品展示推送与交易,手机室内定位,自动场景控制,可视对讲,主被动视频监控,多方式开门,可视电话,健康管理、远程教育,社区服务,生活服务,人机交互免人为操作控制或手动控制等功能。As for the mobile terminal, it is equipped with APP software, which can use the fingerprint recognition of a smartphone, the microphone array to recognize voice, and other mobile terminal sensors, and use software algorithms to realize the use of fingerprints with different hand alarm levels for help alarms and local custom voice output, art Product display push and transaction, mobile phone indoor positioning, automatic scene control, video intercom, active and passive video surveillance, multi-door opening, video phone, health management, distance education, community service, life service, human-computer interaction without human operation Control or manual control.
关于艺术智能电视装置,其集麦克风阵列语音、身份识别、人机交互、室内监控、可视对讲及开单元门、安防报警、3D可视电话、3D试衣、互动游戏、智能家居、艺术鉴赏、音乐及广播欣赏、教育学习、实时翻译、信息咨询、生活服务、社区服务、环境检测、远程问诊、健康检测及服务等多系统,与用户移动终端、对讲分机智能机器人等保持数据互联互通,加上物业管理平台及智慧家庭云服务平台一起构建实现真正的居民智慧生活、智慧家庭、智慧社区。Regarding artistic smart TV devices, it integrates microphone array voice, identity recognition, human-computer interaction, indoor monitoring, video intercom and door opening, security alarm, 3D video phone, 3D fitting, interactive games, smart home, art Appreciation, music and broadcasting appreciation, education and learning, real-time translation, information consultation, living services, community services, environmental testing, remote consultation, health testing and services, etc., maintain data with user mobile terminals, intercom extension intelligent robots, etc. Interoperability, together with the property management platform and smart home cloud service platform, together build a real smart life, smart home and smart community for the residents.
下面结合图2说明该艺术智能电视装置的结构:The following describes the structure of the artistic smart TV device with reference to FIG. 2:
在该艺术智能电视装置中,主控模块为智能CPU/MCU 核心组,包括内存、存储器、加密芯片等。多总线接口主要是解决室内智能总线系统协议通讯对接问题。315MHz和433MHz无线接口主要解决室内无法敷设线缆的项目,用户在卧室或门上面安装无线报警前端设备即可将报警信号无线传输给装置,以便装置将报警信号转化为互联网信号推送到平台及用户移动终端。 DI接口主要解决室内开关量报警信号接入以及装置防拆等自身安全检测输入,同时装置还将报警信号转化为互联网信号。DO接口主要解决装置在报警时输出例如警灯、警号等相关设备输出问题,以达到警示非法入侵者和本地声光提醒用户有非法入侵者进入的目的。自定义音响本地声音输出主要解决人机交互、可视对讲、增值服务、发生报警或误报时,阻吓非法入侵者和提醒用户存在误报警的情况,以降低系统误报率,确认系统处理正常工作状态。指纹输入模块解决身份认证及正常操作,定义不同级别报警求助信息。无线家居控制信号接入,解决新老住宅用户不敷设线缆的智能家居控制应用问题。CO、CO2、PM2.5、红外探测器、人体感应探测器、温湿度传感器、光照度传感器、烟感和燃气探测器等环境传感器。FM调频模块主要解决用户通过装置收听调频广播的需求。存储模块主要解决监控、图片、音乐等数据存储问题。蓝牙模块主要为自动场景提供蓝牙信标以及用户扩展系统通过蓝牙进行数据通讯等功能。显示模块与控制模块一起主要是驱动触控液晶大屏的显示与控制;音频编码模块主要连接麦克风语音阵列输入,实现人机交互语音输入。脉搏波、血红、心率、血压等多种医用传感器,主要解决用户不用外购相关检测设备,通过装置内置模块来实现用户相关健康数据的采集、分析与管理,并将相关数据推送到用户移动终端和平台。监控模块主要根据装置的电压、电流、波型来检查装置内置的功能模块故障、预警及整机功耗等。WIFI接口主要解决装置无法有线接入互联网时,通过WIFI无线与用户室内路由器连接到互联网,解决用户布线烦恼及成本投入大的问题;功放模块主要解决用户背景音乐扩展需要,用户只需要购买吸顶或壁挂音箱接入该接口,通过装置或用户移动终端的手动操作或语音控制即可播放自己喜欢的音乐。SIM卡模块主要解决当用户没有有线宽带和WIFI网络的情况,通过SIM卡无线网络与互联网进行连接;报警时还可以定义SIM卡无线网络与有线网络同时并发报警信号至物业管理中心、用户移动终端和智慧家庭云服务平台,以保障报警信息无漏被推送到相关人与服务机构。In this artistic smart TV device, the main control module is an intelligent CPU / MCU core group, including memory, storage, encryption chip, and so on. The multi-bus interface is mainly used to solve the protocol communication connection problem of indoor intelligent bus system. 315MHz and 433MHz wireless interfaces mainly solve the problem that cables cannot be installed indoors. Users can wirelessly transmit alarm signals to the device by installing a wireless alarm front-end device on the bedroom or door, so that the device converts the alarm signals into Internet signals and pushes them to the platform and users. Mobile terminal. The DI interface mainly solves the self-safety detection inputs such as indoor digital alarm signal access and device tamper resistance. At the same time, the device also converts the alarm signal into an Internet signal. The DO interface mainly solves the problem of outputting related equipment such as warning lights and sirens when the alarm is output, so as to achieve the purpose of alerting illegal intruders and alerting users to illegal intruders. Custom sound local sound output mainly solves human-computer interaction, video intercom, value-added services, deterring illegal intruders and reminding users of false alarms when alarms or false alarms occur, in order to reduce the system's false alarm rate and confirm system processing Normal working condition. The fingerprint input module solves identity authentication and normal operation, and defines different levels of alarm help information. Wireless home control signal access to solve the problem of smart home control applications where new and old residential users do not lay cables. CO, CO2, PM2.5, infrared detectors, human sensor detectors, temperature and humidity sensors, light sensor, smoke and gas detectors and other environmental sensors. FM FM module mainly solves the needs of users to listen to FM radio through the device. The storage module mainly solves the problem of data storage such as monitoring, pictures and music. The Bluetooth module mainly provides functions such as Bluetooth beacons for automatic scenes and user expansion systems for data communication via Bluetooth. The display module and the control module are mainly used to drive the display and control of the touch-screen LCD large screen; the audio coding module is mainly connected to the microphone voice array input to realize human-machine interactive voice input. Pulse wave, blood red, heart rate, blood pressure and other medical sensors, mainly solve the user's need to outsource related detection equipment, through the built-in module of the device to achieve the user's related health data collection, analysis and management, and push the relevant data to the user's mobile terminal And platform. The monitoring module mainly checks the failure, early warning, and power consumption of the built-in function modules based on the voltage, current, and waveform of the device. The WIFI interface mainly solves the problem that when the device cannot connect to the Internet by wire, it is connected to the Internet through the WIFI wireless router and the indoor router of the user, which solves the user wiring troubles and large cost investment; the power amplifier module mainly solves the user's background music expansion needs, and users only need to buy ceiling Or the wall-mounted speaker is connected to this interface, and the favorite music can be played through manual operation or voice control of the device or the user's mobile terminal. The SIM card module mainly solves the situation where the user does not have wired broadband and WIFI network, and connects to the Internet through the SIM card wireless network; when the alarm is triggered, the SIM card wireless network and wired network can also be defined to send alarm signals to the property management center and user mobile terminal at the same time. And smart home cloud service platform to ensure that alarm information is leaked to relevant people and service agencies.
关于智慧家庭云服务平台,其主要为用户提供住宅室内多信号互联网报警、室外用户移动报警、救援等安全管理、信息咨询、保险、艺术品展示及交易、教育与学习、3D视频电话、人工智能助理、互动游戏、3D试衣模块、自动配置库建立、健康检测服务管理等服务。主要包括视频智能与识别分析模块、语音声纹分析模块、图片分析模块、GPS定位分析模块、Wifi与蓝牙定位信息分析模块、中心人工并行操作软件、艺术展示推送模块、教育学习模块、人工智能助理模块、3D游戏模块、3D试衣模块、3D视频电话等增值业务推送模块、操作数据记录模块、大屏拼接显示模块、数据组模块、网络安全模块、人工智能自动服务模块、三大运营商通讯模块、公安系统通讯模块、医疗系统通讯模块、健康数据模块、UPS供电系统模块、精密空调组等等组成。装置将用户的服务需求编译成特定预先定义好的函数,再通过短信和网络推送到平台,平台自动快速解码各类服务请求及相关数据,数据自动处理后,平台将数据分成不同的类型与等级再编译成特定预先定义好的函数,通过网络推送给装置、用户移动终端、用户紧急联系人APP、用户所在位置的物业中心平台、用户实时所在地域的110、119及120报警中心软件等相关服务用户的装置与机构,让用户得到所需要的服务与保障,以全面提升服务用户的水平,提升用户体验感。As for the smart home cloud service platform, it mainly provides users with indoor multi-signal Internet alarms, outdoor user mobile alarms, rescue and other security management, information consulting, insurance, art display and trading, education and learning, 3D video calls, artificial intelligence Assistants, interactive games, 3D fitting modules, automatic configuration database establishment, health detection service management and other services. Mainly includes video intelligence and recognition analysis module, voice voiceprint analysis module, picture analysis module, GPS positioning analysis module, Wifi and Bluetooth positioning information analysis module, central manual parallel operation software, art display push module, education and learning module, artificial intelligence assistant Modules, 3D game modules, 3D fitting modules, 3D video phones and other value-added service push modules, operation data recording modules, large-screen splicing display modules, data group modules, network security modules, artificial intelligence automatic service modules, and communications between the three major operators Modules, public security system communication modules, medical system communication modules, health data modules, UPS power supply system modules, precision air conditioning units and so on. The device compiles the user's service requirements into specific pre-defined functions, and then pushes them to the platform via SMS and network. The platform automatically and quickly decodes various service requests and related data. After the data is automatically processed, the platform divides the data into different types and levels. Then compile it into a specific predefined function and push it to the device, user mobile terminal, user emergency contact APP, user's property center platform, real-time 110, 119, and 120 alarm center software and other related services through the network. Users' devices and institutions allow users to get the services and guarantees they need to comprehensively improve the level of service users and enhance the user experience.
关于社区物业管理中心平台,其主要为集团地产住宅用户提供室内自动报警、救援等安全管理、视频监控、可视对讲、扩展功能设备安装及维护、O2O、生活服务、社区服务、信息咨询、健康服务管理及室外安全服务的管理平台。可以是单个社区物业管理中心,也可是多个社区的物业服务集团,主要包括视频智能与识别分析模块、语音声纹分析模块、图片分析模块、Wifi与蓝牙定位信息分析模块、中心人工并行操作软件、操作数据记录模块、大屏拼接显示模块、数据组模块、网络安全模块、社区智能化集成平台、社区物业运营平台、人工智能自动服务模块、运营商通讯模块、公安系统通讯模块、UPS供电系统模块、精密空调组等等组成。装置将用户的服务需求编译成特定预先定义好的函数,再通过短信和网络推送到平台,平台自动快速解码各类服务请求及相关数据,数据自动处理后,平台将数据分成不同的类型与等级再编译成特定预先定义好的函数,通过网络推送给艺术人工智能电视黄纸、用户移动终端、用户紧急联系人APP、用户所在位置的物业中心平台、用户实时所在地域的110、119及120报警中心软件等相关服务用户的装置与机构,同时平台会将需求信息自动弹屏显示和语音报警,提醒值班保安及时掌握居民报警及其它服务需求,安排就近保安去现场处理居民报警及服务需求问题。如就近保安现场已经处理居民服务需求,值班保安需通过软件反馈执行情况及误报情况,以便平台进行后续管理工作。所有用户需求信息集团与社区信息同步,即起到统一管理的作用,也起到监督各社区管理人员服务质量、频率等作用。让用户得到所需要的服务与保障,以全面提升服务用户的水平,提升用户体验感。Regarding the community property management center platform, it mainly provides group real estate residential users with indoor automatic alarm, rescue and other security management, video monitoring, video intercom, installation and maintenance of extended function equipment, O2O, living services, community services, information consulting, Management platform for health service management and outdoor security services. It can be a single community property management center or a multiple community property service group. It mainly includes video intelligence and recognition analysis module, voice and voiceprint analysis module, picture analysis module, Wifi and Bluetooth positioning information analysis module, and central manual parallel operation software. , Operation data recording module, large-screen mosaic display module, data group module, network security module, community intelligent integration platform, community property operation platform, artificial intelligence automatic service module, operator communication module, public security system communication module, UPS power supply system Modules, precision air conditioning units and more. The device compiles the user's service requirements into specific pre-defined functions, and then pushes them to the platform via SMS and network. The platform automatically and quickly decodes various service requests and related data. After the data is automatically processed, the platform divides the data into different types and levels. Then compile it into a specific predefined function and push it to the artistic artificial intelligence TV yellow paper, the user's mobile terminal, the user's emergency contact APP, the user's property center platform, and the user's real-time 110, 119, and 120 alarms through the network. Devices and institutions of related service users such as the center software, and the platform will automatically pop-up display the demand information and voice alarm to remind the security guard on duty to grasp the alarm and other service requirements of the residents in time, and arrange the nearest security to deal with the residents' alarm and service requirements on-site. If the nearest security site has already handled the residents' service needs, the on-duty security needs to feedback the implementation and false alarms through software in order for the platform to carry out subsequent management work. All user demand information groups synchronize with community information, which not only plays the role of unified management, but also supervises the service quality and frequency of community management personnel. Let users get the services and guarantees they need to comprehensively improve the level of service users and enhance the user experience.
关于110、119、120报警中心,其接收到智慧家庭和物业管理云服务平台网络推送来的特定预先定义好的函数,快速解码出用户名称、住址、联系方式、紧急联系人、家庭成员、实时地域位置、报警类型、图片分析平台结果、现场环境、周边设备、运动轨迹、用户健康数据等信息,再加上视频平台分析结果、现场语音平台分析结果等,以及平台初判案件的其它线索资料,报警中心软件会将报警信息自动弹屏显示和语音报警,提醒值警察及时掌握居民报警需求,并快速派出警力对用户进行救援及事后证据调用。Regarding the 110, 119, and 120 alarm centers, they received specific pre-defined functions pushed by the smart home and property management cloud service platform network, and quickly decoded the user name, address, contact information, emergency contacts, family members, real-time Geographical location, alarm type, picture analysis platform results, field environment, peripheral equipment, motion trajectory, user health data and other information, plus video platform analysis results, live voice platform analysis results, etc., as well as other clues about the platform's initial judgment The alarm center software will automatically pop up the alarm display and voice alarm to remind the police to grasp the residents' alarm needs in a timely manner, and quickly dispatch police forces to the user for rescue and subsequent evidence call.
以上仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何纂改、等同替换、改进等,均应包含在本发明的权利要求范围之内。The above are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall be included in the scope of the claims of the present invention.

Claims (18)

  1. 一种艺术智能电视装置,与智慧家庭云服务平台及智慧家庭系统通讯连接,其特征在于,所述艺术智能电视装置包括多个功能模块,且所述功能模块包括主控模块及分别与主控模块连接的显示模块、功放模块、存储模块、网络模块、拍摄模块、接口模块;而且,An art smart TV device is communicatively connected with a smart home cloud service platform and a smart home system. The art smart TV device includes a plurality of function modules, and the function modules include a main control module and a main control module respectively. The display module, power amplifier module, storage module, network module, shooting module, interface module connected to the module;
    主控模块,用于在判断满足触发条件时,从所述存储模块中或通过所述网络模块从互联网中查找出相应的艺术图像,并控制所述显示模块按预设播放模式显示相应的艺术图像;在判断满足关闭条件时,关闭当前正在播放的艺术图像,并进入待机模式;其中,A main control module, configured to find a corresponding art image from the storage module or the Internet through the network module when determining that a trigger condition is satisfied, and control the display module to display a corresponding art according to a preset playback mode Image; when it is judged that the close condition is met, close the currently playing art image and enter standby mode; among them,
    所述触发条件包括下列中的至少一个:接收到用户输入的相应艺术图像的播放指令;当前模式为回家模式;The trigger condition includes at least one of the following: receiving a playback instruction of a corresponding art image input by a user; the current mode is a home mode;
    所述关闭条件包括下列中的至少一个:接收到用户输入的关闭指令;当前模式为离家模式;当前时间在预设的睡眠时段内;接收到智慧家庭系统发送的访客视频信息。The shutdown condition includes at least one of the following: a shutdown instruction input by a user is received; the current mode is a home away mode; the current time is within a preset sleep period; and the video information of the guest sent by the smart home system is received.
  2. 根据权利要求1所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 1, wherein:
    所述主控模块,还用于在显示艺术图像时,从所述存储模块中或通过所述网络模块从互联网中查找出所述艺术图像所对应的解说信息,并控制所述功放模块播放所述解说信息;还用于在判断出当前所显示的艺术图像超过预设时间未更换时,通过所述功放模块输出更换提示信息。The main control module is further configured to, when displaying an artistic image, find out the explanatory information corresponding to the artistic image from the storage module or from the Internet through the network module, and control the power amplifier module to play the artistic image. Descriptive information; also used to output replacement prompt information through the power amplifier module when it is determined that the currently displayed art image has not been replaced for more than a preset time.
  3. 根据权利要求1所述的艺术智能电视装置,其特征在于,所述拍摄模块包括至少一组双目摄像头,而且,The artistic smart TV device according to claim 1, wherein the shooting module includes at least one set of binocular cameras, and
    所述主控模块,还用于将所述双目摄像头所拍摄的图像合成3D图像,而且,在接收到用户输入的移植指令时,将当前播放的艺术图像处理成3D艺术场景,并将用户的3D图像移植到所述3D艺术场景中。The main control module is further configured to synthesize an image captured by the binocular camera into a 3D image, and, when receiving a transplant instruction input by a user, process the currently played art image into a 3D art scene, and 3D images are ported into the 3D art scene.
  4. 根据权利要求3所述的艺术智能电视装置,其特征在于,所述功能模块还包括激光传感器和/或外红传感器,而且, The artistic smart TV device according to claim 3, wherein the functional module further comprises a laser sensor and / or an external red sensor, and
    所述主控模块,还用于对所述双目摄像头所拍摄的用户图像及激光传感器和/或外红传感器所探测的距离信息进行分析,并获取用户的动作和姿态信息,而且,根据所述动作和姿态信息对相应功能模块进行操控。The main control module is further configured to analyze the user image captured by the binocular camera and the distance information detected by the laser sensor and / or the outer red sensor, and obtain the user's motion and posture information. The motion and attitude information described above is used to control the corresponding function modules.
  5. 根据权利要求1所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 1, wherein:
    所述主控模块,还用于对通过所述网络模块接收的多屏互动信息进行处理,并控制所述显示模块和所述功放模块播放所述多屏互动信息。The main control module is further configured to process the multi-screen interactive information received through the network module, and control the display module and the power amplifier module to play the multi-screen interactive information.
  6. 根据权利要求1所述的艺术智能电视装置,其特征在于,所述功能模块还包括阵列红外检测模块,而且,The artistic smart TV device according to claim 1, wherein the functional module further comprises an array infrared detection module, and,
    所述主控模块,还用于在显示艺术图像或休眠状态时,若根据所述阵列红外检测模块的检测结果判断出用户移动到特定位置且在所述特定位置停留的时间超过第一预设值时,通过所述功放模块输出第一语音提示;还用于在电视开启后,若根据所述阵列红外检测模块的检测结果判断出用户在所述特定位置停留的时间超过第二预设值时,通过所述功放模块输出第二语音提示;还用于在电视开启后,若根据所述阵列红外检测模块的检测结果判断出用户离开所述特定位置超过第三预设值时,自动关闭或进入休眠模式;还用于若根据所述阵列红外检测模块的检测结果判断出用户的运动轨迹停止,且停止时间超过第四预设值时,联动开启相应的功能模块,并通过所述功放模块输出第四语音提示。The main control module is further configured to, when displaying an artistic image or a dormant state, if it is determined according to a detection result of the array infrared detection module that the user moves to a specific position and stays in the specific position for a time longer than a first preset When the value is reached, a first voice prompt is output through the power amplifier module. It is also used to determine that, after the television is turned on, according to the detection result of the array infrared detection module, the user stays at the specific position for a time longer than a second preset value A second voice prompt is output through the power amplifier module; and is also used to automatically turn off when the TV determines that the user has left the specific position to exceed a third preset value based on the detection result of the array infrared detection module after the TV is turned on Or enter the sleep mode; it is also used to determine if the user's motion trajectory stops according to the detection result of the array infrared detection module, and when the stop time exceeds a fourth preset value, open the corresponding function module in cooperation, and pass the power amplifier The module outputs a fourth voice prompt.
  7. 根据权利要求1所述的艺术智能电视装置,其特征在于,所述功能模块还包括FM模块,而且,The artistic smart TV device according to claim 1, wherein the function module further comprises an FM module, and
    所述主控模块,还用于在接收到用户输入的相应音乐或广播的播放指令时,从所述存储模块中或通过所述网络模块从互联网中查找出相应的音乐文件,或,将所述FM模块调频到指定频道,并控制所述功放模块播放所述音乐文件或相应频道的广播信息。The main control module is further configured to find a corresponding music file from the storage module or the Internet through the network module when receiving a playback instruction of a corresponding music or broadcast input by a user, or The FM module tunes to a designated channel and controls the power amplifier module to play the music file or broadcast information of a corresponding channel.
  8. 根据权利要求3所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 3, wherein:
    所述主控模块,还用于在接收到用户输入的形象指导指令时,对所述双目摄像头所拍摄的用户的3D图像进行图像分析,以获取用户当前的形象信息,并根据预先所存储的多个形象模板信息确定用户当前形象的缺陷信息及改进信息,且通过所述功放模块输出用户当前形象的缺陷信息及改进信息,其中,所述形象信息包括发型信息、妆容信息、衣着信息。The main control module is further configured to perform image analysis on the 3D image of the user captured by the binocular camera when receiving the image guidance instruction input by the user, so as to obtain the current image information of the user, and according to the pre-stored information The multiple image template information of the user determines defect information and improvement information of the current image of the user, and outputs defect information and improvement information of the current image of the user through the power amplifier module, wherein the image information includes hairstyle information, makeup information, and clothing information.
  9. 根据权利要求1所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 1, wherein:
    所述主控模块,还用于在接收到用户输入的试衣指令时,接收用户从多个服装图像信息中选择指定的服装,并将用户预先输入的身体参数信息与指定的服装进行整合,以生成试衣效果的3D图像,而且,控制所述显示模块显示所述试衣效果的3D图像。The main control module is further configured to, when receiving the fitting instruction input by the user, receive the user to select the specified clothing from the plurality of clothing image information, and integrate the body parameter information previously input by the user with the specified clothing, To generate a 3D image of the fitting effect, and controlling the display module to display the 3D image of the fitting effect.
  10. 根据权利要求3所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 3, wherein:
    所述主控模块,还用于在接收到用户输入的游戏指令时,根据所述双目摄像头所拍摄的用户的3D图像获取用户的位置信息及姿态信息,并根据所述位置信息及所述姿态信息控制所述显示模块和/或所述功放模块;还用于通过所述拍摄模块获取特定平面画的图像,并将所述图像转换成3D图像,而且,将用户的3D图像或平面画的3D图像加载在相应的游戏场景中。The main control module is further configured to obtain position information and posture information of the user according to the 3D image of the user captured by the binocular camera when receiving a game instruction input by the user, and according to the position information and the The attitude information controls the display module and / or the power amplifier module; and is also used to obtain an image of a specific plane drawing through the photographing module, and convert the image into a 3D image, and further, the user's 3D image or plane drawing 3D images are loaded in the corresponding game scene.
  11. 根据权利要求3所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 3, wherein:
    所述主控模块,还用于在接收到用户输入的视频电话指令时,在与指定联系人建立连接后,将所述双目摄像头所拍摄的用户的3D图像及语音信息通过所述网络模块实时发送至所述指定联系人的移动终端或智能电视装置,及通过所述网络模块接收所述指定联系人的移动终端或智能电视装置所发送的所述指定联系人的3D图像及语音信息,并控制所述显示模块显示所接收的所述3D图像及所述功放模块播放所述语音信息,以实现与所述指定联系人的3D全息视频通话。The main control module is further configured to pass a 3D image and voice information of the user captured by the binocular camera through the network module after establishing a connection with a designated contact when receiving a video call instruction input by a user. Sending to the mobile terminal or smart TV device of the designated contact in real time, and receiving the 3D image and voice information of the designated contact sent by the mobile terminal or smart TV device of the designated contact through the network module, And controlling the display module to display the received 3D image and the power amplifier module to play the voice information to implement a 3D holographic video call with the designated contact.
  12. 根据权利要求3所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 3, wherein:
    所述主控模块,还用于在远程教育模式下,将所述双目摄像头所拍摄的用户的3D图像及语音信息通过所述网络模块实时发送至远程老师的终端,并通过所述网络模块接收所述老师的3D图像及语音信息,以实现远程实时教育。The main control module is further configured to send the 3D image and voice information of the user captured by the binocular camera to the terminal of the remote teacher in real time through the network module in the distance education mode, and through the network module Receiving the 3D image and voice information of the teacher to realize remote real-time education.
  13. 根据权利要求1所述的艺术智能电视装置,其特征在于,所述功能模块还包括麦克风阵列,而且,The artistic smart TV device according to claim 1, wherein the functional module further comprises a microphone array, and
    所述麦克风阵列,用于接收用户通过语音输入的相应智能装置的控制指令,所述智能装置包括艺术智能电视装置和/或智能家电装置,而且,所述智能家电装置与所述艺术智能电视装置通过所述接口模块相连;The microphone array is configured to receive a control instruction of a corresponding smart device input by a user through voice. The smart device includes an art smart TV device and / or a smart home appliance device, and the smart home appliance device and the art smart TV device Connected through the interface module;
    所述主控模块,用于对所述麦克风阵列所接收的控制指令进行声纹识别,以获取用户的声纹特征,并在判断出所获取的声纹特征与预先设置的声纹特征一致时,根据所述控制指令确定待控制的智能装置的标识及指令信息,并将所述指令信息发送至相应的智能装置;还用于在收到单元门口机发送的用户开门指令时,按照预设的回家预备模式获取待控制的智能装置的标识及指令信息,并将所述指令信息发送至相应的智能装置。The main control module is configured to perform voiceprint recognition on a control instruction received by the microphone array to obtain a voiceprint feature of the user, and when it is determined that the acquired voiceprint feature is consistent with a preset voiceprint feature, Determine the identifier and instruction information of the intelligent device to be controlled according to the control instruction, and send the instruction information to the corresponding intelligent device; it is also used to receive a user's door opening instruction sent by the unit door phone, according to a preset The home preparation mode acquires the identification and instruction information of the smart device to be controlled, and sends the instruction information to the corresponding smart device.
  14. 根据权利要求11所述的艺术智能电视装置,其特征在于,The artistic smart TV device according to claim 11, wherein:
    所述主控模块,还用于在收到翻译指令时,对所接收的语音信息进行翻译,并通过所述显示模块或所述功放模块输出翻译信息。The main control module is further configured to translate the received voice information when a translation instruction is received, and output the translation information through the display module or the power amplifier module.
  15. 根据权利要求3所述的艺术智能电视装置,其特征在于,所述功能模块还包括设置在壳体上或通过所述接口模块连接的健康检测传感器,而且,The art smart TV device according to claim 3, wherein the functional module further comprises a health detection sensor provided on the housing or connected through the interface module, and,
    所述健康检测传感器,用于检测用户的健康信息,所述健康信息包括体温、心率、血氧、血压趋势、脉搏波;The health detection sensor is configured to detect health information of a user, and the health information includes body temperature, heart rate, blood oxygen, blood pressure trend, and pulse wave;
    所述主控模块,还用于在健康检查模式下,记录所述健康检测传感器所检测的健康信息,并与用户在医院检查的健康与诊断信息形成电子健康档案,而且,将所述健康信息及所述电子健康档案通过所述网络模块推送至智慧家庭云服务平台或远程医生的终端。The main control module is further configured to record the health information detected by the health detection sensor in a health check mode, and form an electronic health file with the health and diagnostic information checked by the user in the hospital, and further, to store the health information And the electronic health file is pushed to the smart home cloud service platform or the terminal of the remote doctor through the network module.
  16. 根据权利要求13所述的艺术智能电视装置,其特征在于,所述功能模块还包括指纹传感器和/或环境传感器;而且,The artistic smart TV device according to claim 13, wherein the functional module further comprises a fingerprint sensor and / or an environmental sensor; and,
    所述指纹传感器,用于接收用户输入的指纹信息;The fingerprint sensor is configured to receive fingerprint information input by a user;
    所述环境传感器,用于检测当前的环境参数信息;The environmental sensor is configured to detect current environmental parameter information;
    所述主控模块,还用于根据所输入的指纹信息进行用户身份的认证,并在认证通过时,进入相应的操作界面;还用于在判断所述当前的环境参数信息满足预设条件时,联动开启相应的智能装置,并将所述当前的环境参数信息发送至相应的物业管理中心或智慧家庭云服务平台或报警中心或指定的移动终端。The main control module is further configured to perform user identity authentication according to the input fingerprint information, and enter a corresponding operation interface when the authentication is passed; and is further used to determine when the current environmental parameter information meets a preset condition , The linkage starts the corresponding smart device, and sends the current environmental parameter information to the corresponding property management center or smart home cloud service platform or alarm center or a designated mobile terminal.
  17. 根据权利要求16所述的艺术智能电视装置,其特征在于,所述拍摄模块还包括监控摄像头,而且,The art smart TV device according to claim 16, wherein the shooting module further comprises a surveillance camera, and,
    所述存储模块,还用于预先存储用户设置的多个指纹信息及每个指纹信息所对应的报警类型;The storage module is further configured to store a plurality of fingerprint information set by a user and an alarm type corresponding to each fingerprint information in advance;
    所述监控摄像头,用于获取监控信息;The monitoring camera is used to obtain monitoring information;
    所述主控模块,还用于在判断出所输入的指纹信息与预先存储的指纹信息一致时,确定所输入的指纹信息所对应的报警类型,并获取当前的监控信息和/或用户健康信息和/或环境参数信息,并生成报警信息,且通过所述网络模块将所述报警信息发送至相应的物业管理中心或智慧家庭云服务平台或报警中心或指定的移动终端。The main control module is further configured to determine an alarm type corresponding to the input fingerprint information when it is determined that the input fingerprint information is consistent with the pre-stored fingerprint information, and obtain current monitoring information and / or user health information and And / or environmental parameter information, and generate alarm information, and send the alarm information to a corresponding property management center or smart home cloud service platform or alarm center or a designated mobile terminal through the network module.
  18. 根据权利要求1-17任一项所述的艺术智能电视装置,其特征在于,还包括监测模块,而且,The artistic smart TV device according to any one of claims 1-17, further comprising a monitoring module, and
    所述监测模块,用于实时检测每个功能模块的用电特征信息,所述用电特征信息包括电压信息、电流信息;The monitoring module is configured to detect the power consumption characteristic information of each functional module in real time, and the power consumption characteristic information includes voltage information and current information;
    所述主控模块,用于根据所述用电特征信息确定相应功能模块的能耗信息,并将其通过所述网络模块发送至智慧家庭云服务平台;还用于将所述用电特征信息与预先存储的相应功能模块的标准特征信息进行比较,并根据比较结果确定已经发生故障或将要发生故障的功能模块,且将其通过所述网络模块发送至智慧家庭云服务平台。The main control module is configured to determine the energy consumption information of the corresponding functional module according to the power consumption characteristic information, and send it to the smart home cloud service platform through the network module; and is also used to transmit the power consumption characteristic information Compare with the standard feature information of the corresponding functional module stored in advance, and determine the functional module that has failed or is about to fail according to the comparison result, and send it to the smart home cloud service platform through the network module.
PCT/CN2018/090126 2018-06-06 2018-06-06 Artistic intelligence television apparatus WO2019232719A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/090126 WO2019232719A1 (en) 2018-06-06 2018-06-06 Artistic intelligence television apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/090126 WO2019232719A1 (en) 2018-06-06 2018-06-06 Artistic intelligence television apparatus

Publications (1)

Publication Number Publication Date
WO2019232719A1 true WO2019232719A1 (en) 2019-12-12

Family

ID=68769721

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/090126 WO2019232719A1 (en) 2018-06-06 2018-06-06 Artistic intelligence television apparatus

Country Status (1)

Country Link
WO (1) WO2019232719A1 (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200525984A (en) * 2004-01-20 2005-08-01 Dbtel Inc Method to play the background sound with portable information terminal
CN101188715A (en) * 2007-12-06 2008-05-28 北京宽视软件技术有限公司 Display method for standby image and digital TV receiving device
CN102333237A (en) * 2011-10-28 2012-01-25 广东九联科技股份有限公司 Television-set-top-box-based information management system
CN103107925A (en) * 2011-11-10 2013-05-15 广东中大讯通信息有限公司 Digital family control system and method thereof
CN104579858A (en) * 2013-10-17 2015-04-29 三星电子(中国)研发中心 Visitor reminding method, device and system based on family network
US20170053210A1 (en) * 2015-08-17 2017-02-23 Ton Duc Thang University Smart home system
CN107145822A (en) * 2017-03-24 2017-09-08 深圳奥比中光科技有限公司 Deviate the method and system of user's body feeling interaction demarcation of depth camera
CN206508528U (en) * 2016-11-07 2017-09-22 浙江舜宇智能光学技术有限公司 Somatic sensation television game equipment
CN206671790U (en) * 2016-12-31 2017-11-24 广东博意建筑设计院有限公司 Smart home house keeper's central control system with learning functionality
CN108012172A (en) * 2017-12-20 2018-05-08 深圳市创行智能科技有限公司 The intelligent-induction control method and intelligent-induction box of a kind of display terminal
CN108924612A (en) * 2018-06-06 2018-11-30 李修球 A kind of art smart television device

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200525984A (en) * 2004-01-20 2005-08-01 Dbtel Inc Method to play the background sound with portable information terminal
CN101188715A (en) * 2007-12-06 2008-05-28 北京宽视软件技术有限公司 Display method for standby image and digital TV receiving device
CN102333237A (en) * 2011-10-28 2012-01-25 广东九联科技股份有限公司 Television-set-top-box-based information management system
CN103107925A (en) * 2011-11-10 2013-05-15 广东中大讯通信息有限公司 Digital family control system and method thereof
CN104579858A (en) * 2013-10-17 2015-04-29 三星电子(中国)研发中心 Visitor reminding method, device and system based on family network
US20170053210A1 (en) * 2015-08-17 2017-02-23 Ton Duc Thang University Smart home system
CN206508528U (en) * 2016-11-07 2017-09-22 浙江舜宇智能光学技术有限公司 Somatic sensation television game equipment
CN206671790U (en) * 2016-12-31 2017-11-24 广东博意建筑设计院有限公司 Smart home house keeper's central control system with learning functionality
CN107145822A (en) * 2017-03-24 2017-09-08 深圳奥比中光科技有限公司 Deviate the method and system of user's body feeling interaction demarcation of depth camera
CN108012172A (en) * 2017-12-20 2018-05-08 深圳市创行智能科技有限公司 The intelligent-induction control method and intelligent-induction box of a kind of display terminal
CN108924612A (en) * 2018-06-06 2018-11-30 李修球 A kind of art smart television device

Similar Documents

Publication Publication Date Title
CN108390859B (en) Intelligent robot device for intercom extension
CN109445288B (en) Implementation method for popularization and application of smart home
US11710387B2 (en) Systems and methods of detecting and responding to a visitor to a smart home environment
CN108924612A (en) A kind of art smart television device
US20220247978A1 (en) Systems and Methods of Detecting and Responding to a Visitor to a Smart Home Environment
CN108877126A (en) System, the method and apparatus of activity monitoring are carried out via house assistant
WO2019140697A1 (en) Interphone extension intelligent robot device
CN108111948A (en) The visual output that server at speech interface equipment provides
CN107980106B (en) Environmental control system
CN107544266A (en) Health Care Services robot
CN103763163A (en) Intelligent housing system based on ubiquitous network
CN106782559A (en) Smart home house keeper central control system and its control method with telecommunication control
CN106346487A (en) Interactive VR sand table show robot
CN106773766A (en) Smart home house keeper central control system and its control method with learning functionality
CN105874520A (en) Smart-home hazard detector providing context specific features and/or pre-alarm configurations
CN107526298A (en) Smart home service robot
CN108447153A (en) A kind of unit doorway intelligent robot
CN107688299A (en) A kind of anion intelligent domestic system and its operation method
CN107229262A (en) A kind of intelligent domestic system
JP2022546438A (en) Method, electronic device, server system, and program for providing event clips
CN108989162A (en) A kind of household intelligent robot steward system
CN107734213A (en) Intelligent domestic electronic installation and system
WO2020191755A1 (en) Implementation method for smart home and smart device
CN206671790U (en) Smart home house keeper's central control system with learning functionality
CN111897234A (en) Intelligent home control system based on 5G network

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18921967

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18921967

Country of ref document: EP

Kind code of ref document: A1