CN107396159B - Smart home broadcasting control system and method based on sleep state detection - Google Patents

Smart home broadcasting control system and method based on sleep state detection Download PDF

Info

Publication number
CN107396159B
CN107396159B CN201710727460.8A CN201710727460A CN107396159B CN 107396159 B CN107396159 B CN 107396159B CN 201710727460 A CN201710727460 A CN 201710727460A CN 107396159 B CN107396159 B CN 107396159B
Authority
CN
China
Prior art keywords
image
high definition
target
noise
scene image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710727460.8A
Other languages
Chinese (zh)
Other versions
CN107396159A (en
Inventor
张亚东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lanzhou Ruichuang Bodi Information Technology Co Ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201710727460.8A priority Critical patent/CN107396159B/en
Priority to CN201810300889.3A priority patent/CN108600806A/en
Priority to CN201711400498.0A priority patent/CN108134959A/en
Publication of CN107396159A publication Critical patent/CN107396159A/en
Application granted granted Critical
Publication of CN107396159B publication Critical patent/CN107396159B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4432Powering on the client, e.g. bootstrap loading using setup parameters being stored locally or received from the server

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Social Psychology (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Neurosurgery (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The present invention relates to a kind of smart home broadcasting control systems based on sleep state detection, including tv state detection device, image capture device, object detection apparatus, sleep state identification equipment and wireless control apparatus, drive signal is closed for when the current state of TV is TV opening state and receives the sleep control signal of sleep state identification equipment transmission, the switchgear of chain road direction TV to be sent by radio communication.The invention further relates to a kind of smart home control method for playing back based on sleep state detection.By means of the invention it is possible to when detecting that televiewer enters sleep state, TV is automatically closed.

Description

Smart home broadcasting control system and method based on sleep state detection
Technical field
The present invention relates to play control field more particularly to a kind of smart home broadcasting control based on sleep state detection System and method.
Background technology
Currently, TV is the most common household electrical appliance of every family.Telephotography is that the light image of scenery is focused on camera shooting On photosensitive (or light guide) target surface of pipe, the photoelectronic excitation of target surface each point or photoconductive situation of change are with the bright of light image each point Degree and it is different.When being scanned with electron beam to target surface, that is, an amplitude proportional is generated in the electric signal of each point scene light image brightness, is passed Being sent to makes the scanning beam of crt screen become with the power of input signal in television receiver.When with transmitting terminal synchronize sweep When retouching, the original image of transmission is shown on the screen of kinescope.
The process of television signal transmission distribution, for relaying the fact in other cities, generally from video camera, TV The heart or mobile control room, then through microwave relay link, transmitting station, finally to user's television receiver.In addition, telecasting satellite and electricity Cable television is also national respectively and the effective means of urban area property television transmission distribution.
However, in the prior art and there is no when viewing TV people to enter under slumber to still in the TV of broadcasting Interrupt the controlling mechanism of broadcasting, cause, into after sleep, be still to receive acoustically during watching TV as people The continuous impact of TV programme is still to visually experience the continuous change of indoor light formed because of the broadcasting of TV programme Change, so as to affect the ortho of people, while also consume unnecessary electric power.
Invention content
To solve the above-mentioned problems, the present invention provides a kind of smart homes based on sleep state detection to play control system System and method, for being TV opening state in the current state of TV and receiving the sleep of sleep state identification equipment transmission When controlling signal, the switchgear of chain road direction TV, which is sent, by radio communication closes drive signal, effectively prevents when viewing The people of TV enter under slumber to still happening the TV of broadcasting is uncontrollable.
According to an aspect of the present invention, a kind of smart home broadcasting control system detected based on sleep state is provided, The system comprises:
Tv state detection device is connect with the switchgear of TV, for the switch shape of the switchgear based on TV State determines the current state of TV, and the current state of TV includes TV opening state and TV closed state;Image Acquisition is set Standby, for carrying out image data acquiring to TV Week enveloping field scape to obtain high definition scene image, the high definition scene image divides Resolution is related to the complexity of TV Week enveloping field scape;Object detection apparatus, for determining mesh therein based on high definition scene image Mark whether the corresponding target of subgraph is human body target;Sleep state identification equipment, connect with object detection apparatus, for receiving It is determined as each target subgraph of human body target, the amplitude of variation of each target subgraph is determined based on time shaft, works as change When change amplitude is less than default variation amplitude, the current state for determining the human body target of corresponding target subgraph is sleep state, when When all current states for being determined as human body target are all sleep state, sleep control signal is sent out, otherwise sends out non-sleep control Signal processed;Wireless control apparatus is connect respectively with sleep state identification equipment and tv state detection device, in TV Current state is for TV opening state and when receiving sleep control signal, the switchgear of chain road direction TV by radio communication It sends and closes drive signal.
More specifically, described based in the smart home broadcasting control system of sleep state detection:The high definition scene The resolution ratio of image it is related to the complexity of TV Week enveloping field scape including:The complexity of TV Week enveloping field scape is higher, the high definition The resolution ratio of scene image is bigger, and the complexity of TV Week enveloping field scape is lower, and the resolution ratio of the high definition scene image is smaller;
Wherein, the resolution bits of the high definition scene image are between resolution ratio upper limit threshold and resolution limit threshold value.
More specifically, it is further included described based in the smart home broadcasting control system of sleep state detection:
Noise spot analytical equipment for receiving high definition scene image, carries out high definition scene image scene and judges to determine The distribution situation of pixel pixel value in high definition scene image, based on the distribution situation to each picture in high definition scene image Vegetarian refreshments is analyzed to determine whether into row pixel value as noise spot;
Noise region analytical equipment is connect with noise spot analytical equipment, for receiving point of the noise spot analytical equipment Analysis as a result, each noise spot in high definition scene image is formed multiple noise regions, determine each noise region area and Shape, and by the Area summing of each noise region to obtain the noise region gross area;
Starting device is filtered, is connect respectively with noise region analytical equipment and adaptive-filtering equipment, in noise range When the domain gross area is more than or equal to preset area threshold value, start adaptive-filtering equipment, be less than default face in the noise region gross area During product threshold value, adaptive-filtering equipment is closed, high definition scene image is input to image smoothing directly as pending image and is set It is standby;
Adaptive-filtering equipment is connect respectively with filtering starting device and image smoothing equipment, for starting by filtering After equipment starts, adaptive-filtering processing is carried out to high definition scene image to obtain pending image, and pending image is defeated Enter to image smoothing equipment;
The adaptive-filtering equipment includes region split cells, module selecting unit, filtering execution unit and image group Close unit, region split cells is used to receiving the shape of each noise region, the shape based on each noise region it is several What feature, multiple benchmark subregions are split by each noise region;Image smoothing equipment, respectively with adaptive-filtering equipment It is connected with filtering starting device, for obtaining smoothed image to the pending image received progress picture smooth treatment;
Wherein, the object detection apparatus is connect with image smoothing equipment, for determining multiple targets in smoothed image Subgraph determines the area of each target subgraph, by the area of each target subgraph divided by the area of smoothed image To obtain target area percentage, when target area percentage is fallen in the range of default human body area percentage, the mesh is determined It is human body target to mark the corresponding target of subgraph;
Wherein, in high definition scene image, the region except multiple noise regions is non-noise region;Wherein, height is cleared out a gathering place The distribution situation of pixel pixel value is included for region of each pixel in high definition scene image in scape image Determine the pixel value range that the pixel pixel value should belong to;
Wherein, the module selecting unit is connect with the region split cells, for each noise region, for Its each benchmark subregion after being split selects corresponding medium filtering template, the filtering execution unit and the module Selecting unit connects, for each noise region, each benchmark subregion after being split for it to be taken in selection Value filtering template performs medium filtering, to obtain each sub-regions filter pattern, and each sub-regions filter pattern is combined into Filtered noise region subgraph;Described image assembled unit is connect with the filtering execution unit, for receiving each make an uproar Sound area domain subgraph, and non-noise region combined with each noise region subgraph to obtain pending image;
Wherein, the shape of each benchmark subregion is rectangular, round or linear, when shape is rectangular, each base The size of quasi- subregion is 3 × 3,5 × 5 or 7 × 7, when shape is round, the radius of each benchmark subregion is 3 pixels, 5 pixels or 7 pixels, when shape is linear, each benchmark subregion is an one-dimensional pixel set.
More specifically, it is further included described based in the smart home broadcasting control system of sleep state detection:Static state is deposited Equipment is stored up, is connect with described image collecting device, for prestoring the resolution ratio upper limit threshold and the resolution limit Threshold value.
More specifically, it is further included described based in the smart home broadcasting control system of sleep state detection:Use shape Condition analytical equipment is connect with the switchgear of TV, for the switch based on the switchgear of TV in daily each period State determines the frequency of use of daily each period of TV;
Wherein, the behaviour in service analytical equipment is ranked up the frequency of use of daily each period, will use frequency Rate is more than or equal to the period of predeterminated frequency threshold value as frequent usage time interval, and frequency of use is less than predeterminated frequency threshold value Period matches as idle usage time interval, and by current time with daily each period, when current time and certain During one idle usage time interval matching, closing pre-warning signal is sent out;
Wherein, the screen of the behaviour in service analytical equipment and TV connects, and will close pre-warning signal and includes in TV To wait for the confirmation of TV user or deny on screen, the switchgear of TV is displayed up to default display in closing pre-warning signal Time threshold and cannot get TV user the input signal denied when, closing television.
According to another aspect of the present invention, it additionally provides a kind of smart home detected based on sleep state and plays controlling party Method, the method includes:
The current state of TV is determined based on the on off state of the switchgear of TV, the current state of TV includes TV Opening state and TV closed state;
Image data acquiring is carried out to TV Week enveloping field scape to obtain high definition scene image, point of the high definition scene image Resolution is related to the complexity of TV Week enveloping field scape;
Determine whether the corresponding target of target subgraph therein is human body target based on high definition scene image;
The each target subgraph for being determined as human body target is received, the change of each target subgraph is determined based on time shaft Change amplitude, when amplitude of variation is less than default variation amplitude, the current state for determining the human body target of corresponding target subgraph is Sleep state when all current states for being determined as human body target are all sleep state, send out sleep control signal, otherwise sends out Go out non-sleep control signal;
TV current state for TV opening state and when receiving sleep control signal, link by radio communication It is sent to the switchgear of TV and closes drive signal.
More specifically, described based in the smart home control method for playing back of sleep state detection:
The resolution ratio of the high definition scene image it is related to the complexity of TV Week enveloping field scape including:TV Week enveloping field scape Complexity is higher, and the resolution ratio of the high definition scene image is bigger, and the complexity of TV Week enveloping field scape is lower, the high definition scene The resolution ratio of image is smaller;
Wherein, the resolution bits of the high definition scene image are between resolution ratio upper limit threshold and resolution limit threshold value.
More specifically, it is further included described based in the smart home control method for playing back of sleep state detection:
High definition scene image is received, scene is carried out to high definition scene image and judges to determine pixel in high definition scene image The distribution situation of pixel value, based on the distribution situation to each pixel in high definition scene image into row pixel value analyze with Determine whether for noise spot;
The analysis result of the noise spot analytical equipment is received, noise spot each in high definition scene image is formed into multiple make an uproar Sound area domain, determines the area and shape of each noise region, and by the Area summing of each noise region to obtain noise range The domain gross area;
When the noise region gross area is more than or equal to preset area threshold value, start adaptive-filtering equipment, in noise region When the gross area is less than preset area threshold value, adaptive-filtering equipment is closed, by high definition scene image directly as pending image It is input to image smoothing equipment;
Using adaptive-filtering equipment, after being activated, adaptive-filtering processing is carried out to high definition scene image to obtain Pending image;The adaptive-filtering equipment includes region split cells, module selecting unit, filtering execution unit and image Assembled unit, region split cells are used to receive the shape of each noise region, the shape based on each noise region Each noise region is split into multiple benchmark subregions by geometric properties;
Picture smooth treatment is carried out to pending image to obtain smoothed image;Wherein, it is described to determine target therein Whether the corresponding target of image is that human body target includes:It determines multiple target subgraphs in smoothed image, determines each mesh The area of subgraph is marked, by the area of the area of each target subgraph divided by smoothed image to obtain target area percentage Than when target area percentage is fallen in the range of default human body area percentage, determining the corresponding target of target subgraph For human body target;
Wherein, in high definition scene image, the region except multiple noise regions is non-noise region;High definition scene image The distribution situation of interior pixel pixel value includes determining this for region of each pixel in high definition scene image The pixel value range that pixel pixel value should belong to;The module selecting unit is connect with the region split cells, for pair Each noise region, each benchmark subregion after being split for it, selects corresponding medium filtering template, the filtering Execution unit is connect with the module selecting unit, for each noise region, each benchmark after being split for it Subregion takes the medium filtering template of selection to perform medium filtering, to obtain each sub-regions filter pattern, and by each height Region filter pattern is combined into filtered noise region subgraph;Described image assembled unit connects with the filtering execution unit It connects, for receiving each noise region subgraph, and non-noise region is combined to be treated with each noise region subgraph Handle image;
Wherein, the shape of each benchmark subregion is rectangular, round or linear, when shape is rectangular, each base The size of quasi- subregion is 3 × 3,5 × 5 or 7 × 7, when shape is round, the radius of each benchmark subregion is 3 pixels, 5 pixels or 7 pixels, when shape is linear, each benchmark subregion is an one-dimensional pixel set.
More specifically, it is further included described based in the smart home control method for playing back of sleep state detection:It deposits in advance Store up the resolution ratio upper limit threshold and the resolution limit threshold value.
More specifically, it is further included described based in the smart home control method for playing back of sleep state detection:
Daily each period of TV is determined based on the on off state of the switchgear of TV in daily each period Frequency of use;
The frequency of use of daily each period is ranked up, by frequency of use be more than or equal to predeterminated frequency threshold value when Between section as frequent usage time interval, frequency of use is less than period of predeterminated frequency threshold value as free time usage time interval, And match current time with daily each period, when being matched when current time with some idle usage time interval, Send out closing pre-warning signal;
Pre-warning signal will be closed to include on the screen of TV waiting for the confirmation of TV user or denying, the switch of TV When equipment is displayed up to default display time threshold in closing pre-warning signal and cannot get the input signal denied of TV user, Closing television.
Description of the drawings
Embodiment of the present invention is described below with reference to attached drawing, wherein:
Fig. 1 is the smart home broadcasting control system based on sleep state detection according to embodiment of the present invention Block diagram.
Fig. 2 is the smart home control method for playing back based on sleep state detection according to embodiment of the present invention Flow chart of steps.
Reference numeral:1 tv state detection device;2 image capture devices;3 object detection apparatus;4 sleep states identify Equipment;5 wireless control apparatus;S101 determines the current state of TV based on the on off state of the switchgear of TV, TV Current state includes TV opening state and TV closed state;S102 carries out image data acquiring to obtain to TV Week enveloping field scape High definition scene image is obtained, the resolution ratio of the high definition scene image is related to the complexity of TV Week enveloping field scape;S103 is based on height Clear scene image determines whether the corresponding target of target subgraph therein is human body target;S104 receptions are determined as human body target Each target subgraph, the amplitude of variation of each target subgraph is determined based on time shaft, when amplitude of variation be less than it is default When changing amplitude, the current state for determining the human body target of corresponding target subgraph is sleep state, is determined as human body when all When the current state of target is all sleep state, sleep control signal is sent out, otherwise sends out non-sleep control signal;S105 is in electricity The current state regarded is as TV opening state and when receiving sleep control signal, the switch of chain road direction TV by radio communication Equipment, which is sent, closes drive signal
Specific embodiment
Below with reference to accompanying drawings to the implementation of the smart home broadcasting control system based on sleep state detection of the present invention Scheme is described in detail.
Telephotography is to focus on the light image of scenery on photosensitive (or light guide) target surface of pick-up tube, the photoelectricity of target surface each point The excitation or photoconductive situation of change of son are different with the brightness of light image each point.When being scanned with electron beam to target surface, that is, generate One amplitude proportional is transmitted to the scanning electricity for making crt screen in television receiver in the electric signal of each point scene light image brightness Beamlet becomes with the power of input signal.When with transmitting terminal synchronous scanning, show the original of transmission on the screen of kinescope Image.
The process of television signal transmission distribution, for relaying the fact in other cities, generally from video camera, TV The heart or mobile control room, then through microwave relay link, transmitting station, finally to user's television receiver.In addition, telecasting satellite and electricity Cable television is also national respectively and the effective means of urban area property television transmission distribution.
People are frequently encountered such situation when watching TV:Because the dull or people itself of TV programme It is tired out, during TV is watched, people will inadvertently get into it is shallow sleep state even slumber, and at this moment, TV by In lacking state of the closing control still in lasting broadcasting, in this way, by entering the shallow people for sleeping state or even slumber Ceaselessly impact visually and acoustically is carried out, has seriously affected the normal rest of people, consumes unnecessary electric power money Source.
In order to overcome above-mentioned deficiency, the present invention has been built a kind of smart home detected based on sleep state and has played control system Whether system enters dormant detection by the detection of the state switched to TV and to the people for watching TV, realizes TV is automatically closed, so as to efficiently solve above-mentioned technical problem.
Fig. 1 is the smart home broadcasting control system based on sleep state detection according to embodiment of the present invention Block diagram, the system comprises:
Tv state detection device is connect with the switchgear of TV, for the switch shape of the switchgear based on TV State determines the current state of TV, and the current state of TV includes TV opening state and TV closed state;
Image capture device, for obtaining high definition scene image, institute to TV Week enveloping field scape progress image data acquiring The resolution ratio for stating high definition scene image is related to the complexity of TV Week enveloping field scape;Object detection apparatus is cleared out a gathering place for being based on height Scape image determines whether the corresponding target of target subgraph therein is human body target;
Sleep state identification equipment, connect with object detection apparatus, for receiving each target for being determined as human body target Subgraph determines the amplitude of variation of each target subgraph based on time shaft, when amplitude of variation is less than default variation amplitude, The current state for determining the human body target of corresponding target subgraph is sleep state, when all current shapes for being determined as human body target When state is all sleep state, sleep control signal is sent out, otherwise sends out non-sleep control signal;
Wireless control apparatus is connect respectively with sleep state identification equipment and tv state detection device, in TV Current state for TV opening state and when receiving sleep control signal, the switch of chain road direction TV is set by radio communication Preparation send closing drive signal.
Then, continue to the present invention the concrete structure of smart home broadcasting control system detected based on sleep state into Row further instruction.
Described based in the smart home broadcasting control system of sleep state detection:The resolution of the high definition scene image Rate it is related to the complexity of TV Week enveloping field scape including:The complexity of TV Week enveloping field scape is higher, the high definition scene image Resolution ratio is bigger, and the complexity of TV Week enveloping field scape is lower, and the resolution ratio of the high definition scene image is smaller;
Wherein, the resolution bits of the high definition scene image are between resolution ratio upper limit threshold and resolution limit threshold value.
Described based in the smart home broadcasting control system of sleep state detection, further include:
Noise spot analytical equipment for receiving high definition scene image, carries out high definition scene image scene and judges to determine The distribution situation of pixel pixel value in high definition scene image, based on the distribution situation to each picture in high definition scene image Vegetarian refreshments is analyzed to determine whether into row pixel value as noise spot;
Noise region analytical equipment is connect with noise spot analytical equipment, for receiving point of the noise spot analytical equipment Analysis as a result, each noise spot in high definition scene image is formed multiple noise regions, determine each noise region area and Shape, and by the Area summing of each noise region to obtain the noise region gross area;
Starting device is filtered, is connect respectively with noise region analytical equipment and adaptive-filtering equipment, in noise range When the domain gross area is more than or equal to preset area threshold value, start adaptive-filtering equipment, be less than default face in the noise region gross area During product threshold value, adaptive-filtering equipment is closed, high definition scene image is input to image smoothing directly as pending image and is set It is standby;
Adaptive-filtering equipment is connect respectively with filtering starting device and image smoothing equipment, for starting by filtering After equipment starts, adaptive-filtering processing is carried out to high definition scene image to obtain pending image, and pending image is defeated Enter to image smoothing equipment;
The adaptive-filtering equipment includes region split cells, module selecting unit, filtering execution unit and image group Close unit, region split cells is used to receiving the shape of each noise region, the shape based on each noise region it is several What feature, multiple benchmark subregions are split by each noise region;Image smoothing equipment, respectively with adaptive-filtering equipment It is connected with filtering starting device, for obtaining smoothed image to the pending image received progress picture smooth treatment;
Wherein, the object detection apparatus is connect with image smoothing equipment, for determining multiple targets in smoothed image Subgraph determines the area of each target subgraph, by the area of each target subgraph divided by the area of smoothed image To obtain target area percentage, when target area percentage is fallen in the range of default human body area percentage, the mesh is determined It is human body target to mark the corresponding target of subgraph;
Wherein, in high definition scene image, the region except multiple noise regions is non-noise region;Wherein, height is cleared out a gathering place The distribution situation of pixel pixel value is included for region of each pixel in high definition scene image in scape image Determine the pixel value range that the pixel pixel value should belong to;
Wherein, the module selecting unit is connect with the region split cells, for each noise region, for Its each benchmark subregion after being split selects corresponding medium filtering template, the filtering execution unit and the module Selecting unit connects, for each noise region, each benchmark subregion after being split for it to be taken in selection Value filtering template performs medium filtering, to obtain each sub-regions filter pattern, and each sub-regions filter pattern is combined into Filtered noise region subgraph;Described image assembled unit is connect with the filtering execution unit, for receiving each make an uproar Sound area domain subgraph, and non-noise region combined with each noise region subgraph to obtain pending image;
Wherein, the shape of each benchmark subregion is rectangular, round or linear, when shape is rectangular, each base The size of quasi- subregion is 3 × 3,5 × 5 or 7 × 7, when shape is round, the radius of each benchmark subregion is 3 pixels, 5 pixels or 7 pixels, when shape is linear, each benchmark subregion is an one-dimensional pixel set.
Described based in the smart home broadcasting control system of sleep state detection, further include:Static storage device, with Described image collecting device connects, for prestoring the resolution ratio upper limit threshold and the resolution limit threshold value.
Described based in the smart home broadcasting control system of sleep state detection, further include:Behaviour in service analysis is set It is standby, it is connect with the switchgear of TV, for being determined based on the on off state of the switchgear of TV in daily each period The frequency of use of daily each period of TV;
Wherein, the behaviour in service analytical equipment is ranked up the frequency of use of daily each period, will use frequency Rate is more than or equal to the period of predeterminated frequency threshold value as frequent usage time interval, and frequency of use is less than predeterminated frequency threshold value Period matches as idle usage time interval, and by current time with daily each period, when current time and certain During one idle usage time interval matching, closing pre-warning signal is sent out;
Wherein, the screen of the behaviour in service analytical equipment and TV connects, and will close pre-warning signal and includes in TV To wait for the confirmation of TV user or deny on screen, the switchgear of TV is displayed up to default display in closing pre-warning signal Time threshold and cannot get TV user the input signal denied when, closing television.
Fig. 2 is the smart home control method for playing back based on sleep state detection according to embodiment of the present invention Flow chart of steps, the method includes:
The current state of TV is determined based on the on off state of the switchgear of TV, the current state of TV includes TV Opening state and TV closed state;
Image data acquiring is carried out to TV Week enveloping field scape to obtain high definition scene image, point of the high definition scene image Resolution is related to the complexity of TV Week enveloping field scape;
Determine whether the corresponding target of target subgraph therein is human body target based on high definition scene image;
The each target subgraph for being determined as human body target is received, the change of each target subgraph is determined based on time shaft Change amplitude, when amplitude of variation is less than default variation amplitude, the current state for determining the human body target of corresponding target subgraph is Sleep state when all current states for being determined as human body target are all sleep state, send out sleep control signal, otherwise sends out Go out non-sleep control signal;
TV current state for TV opening state and when receiving sleep control signal, link by radio communication It is sent to the switchgear of TV and closes drive signal.
Then, continue to the present invention the specific steps of smart home control method for playing back detected based on sleep state into Row further instruction.
Described based in the smart home control method for playing back of sleep state detection:
The resolution ratio of the high definition scene image it is related to the complexity of TV Week enveloping field scape including:TV Week enveloping field scape Complexity is higher, and the resolution ratio of the high definition scene image is bigger, and the complexity of TV Week enveloping field scape is lower, the high definition scene The resolution ratio of image is smaller;
Wherein, the resolution bits of the high definition scene image are between resolution ratio upper limit threshold and resolution limit threshold value.
Described based in the smart home control method for playing back of sleep state detection, further include:
High definition scene image is received, scene is carried out to high definition scene image and judges to determine pixel in high definition scene image The distribution situation of pixel value, based on the distribution situation to each pixel in high definition scene image into row pixel value analyze with Determine whether for noise spot;
The analysis result of the noise spot analytical equipment is received, noise spot each in high definition scene image is formed into multiple make an uproar Sound area domain, determines the area and shape of each noise region, and by the Area summing of each noise region to obtain noise range The domain gross area;
When the noise region gross area is more than or equal to preset area threshold value, start adaptive-filtering equipment, in noise region When the gross area is less than preset area threshold value, adaptive-filtering equipment is closed, by high definition scene image directly as pending image It is input to image smoothing equipment;
Using adaptive-filtering equipment, after being activated, adaptive-filtering processing is carried out to high definition scene image to obtain Pending image;The adaptive-filtering equipment includes region split cells, module selecting unit, filtering execution unit and image Assembled unit, region split cells are used to receive the shape of each noise region, the shape based on each noise region Each noise region is split into multiple benchmark subregions by geometric properties;
Picture smooth treatment is carried out to pending image to obtain smoothed image;Wherein, it is described to determine target therein Whether the corresponding target of image is that human body target includes:It determines multiple target subgraphs in smoothed image, determines each mesh The area of subgraph is marked, by the area of the area of each target subgraph divided by smoothed image to obtain target area percentage Than when target area percentage is fallen in the range of default human body area percentage, determining the corresponding target of target subgraph For human body target;
Wherein, in high definition scene image, the region except multiple noise regions is non-noise region;High definition scene image The distribution situation of interior pixel pixel value includes determining this for region of each pixel in high definition scene image The pixel value range that pixel pixel value should belong to;The module selecting unit is connect with the region split cells, for pair Each noise region, each benchmark subregion after being split for it, selects corresponding medium filtering template, the filtering Execution unit is connect with the module selecting unit, for each noise region, each benchmark after being split for it Subregion takes the medium filtering template of selection to perform medium filtering, to obtain each sub-regions filter pattern, and by each height Region filter pattern is combined into filtered noise region subgraph;Described image assembled unit connects with the filtering execution unit It connects, for receiving each noise region subgraph, and non-noise region is combined to be treated with each noise region subgraph Handle image;
Wherein, the shape of each benchmark subregion is rectangular, round or linear, when shape is rectangular, each base The size of quasi- subregion is 3 × 3,5 × 5 or 7 × 7, when shape is round, the radius of each benchmark subregion is 3 pixels, 5 pixels or 7 pixels, when shape is linear, each benchmark subregion is an one-dimensional pixel set.
Described based in the smart home control method for playing back of sleep state detection, further include:Prestore described point Resolution upper limit threshold and the resolution limit threshold value.
Described based in the smart home control method for playing back of sleep state detection, further include:
Daily each period of TV is determined based on the on off state of the switchgear of TV in daily each period Frequency of use;
The frequency of use of daily each period is ranked up, by frequency of use be more than or equal to predeterminated frequency threshold value when Between section as frequent usage time interval, frequency of use is less than period of predeterminated frequency threshold value as free time usage time interval, And match current time with daily each period, when being matched when current time with some idle usage time interval, Send out closing pre-warning signal;
Pre-warning signal will be closed to include on the screen of TV waiting for the confirmation of TV user or denying, the switch of TV When equipment is displayed up to default display time threshold in closing pre-warning signal and cannot get the input signal denied of TV user, Closing television.
In addition, image filtering, i.e., press down the noise of target image under conditions of image detail feature is retained as possible System, is indispensable operation in image preprocessing, and the quality for the treatment of effect will directly influence subsequent image processing and divide The validity and reliability of analysis.
Not perfect due to imaging system, transmission medium and recording equipment etc., digital picture is in its formation, transmission log mistake It is often polluted in journey by a variety of noises.In addition, certain links in image procossing when the picture object inputted and are not so good as pre- Also noise can be introduced when thinking in result images.These noises often show as one and cause the isolated of stronger visual effect on the image Pixel or block of pixels.Generally, noise signal it is uncorrelated to the object to be studied it occur with useless message form, upset figure The observable information of picture.For data image signal, psophometer is either large or small extreme value, these extreme values are acted on by plus-minus On the true gray value of image pixel, the interference of bright, dim spot is caused to image, greatly reduces picture quality, influence image restoration, The progress of the subsequent work such as segmentation, feature extraction, image identification.A kind of effective wave filter for inhibiting noise is constructed to must take into consideration Two basic problems:The noise in target and background can effectively be removed;Meanwhile can protect well image object shape, Size and specific geometry and topological features.
One kind in common image filtering pattern is nonlinear filter, it is, in general, that when signal spectrum and noise frequency Such as the noise as caused by mission nonlinear or there are non-gaussian to make an uproar when composing aliasing or when containing nonadditivity noise in signal Sound etc.), traditional linear filter technology, if Fourier converts, while noise is filtered out, always blurred picture is thin in some way Section (such as edge) and then the extraction property reduction for leading to the positioning accuracy and feature as linear character.And nonlinear filter is Based on a kind of Nonlinear Mapping relationship to input signal, often a certain specific noise approx can be mapped as zero and retained Signal wants feature, thus it can overcome the shortcoming of linear filter to a certain extent.
Smart home broadcasting control system using the present invention based on sleep state detection, in the prior art can not It is automatically closed faced spectators have been enter into the TV under sleep state the technical issues of, by sleep state identification equipment, connects The each target subgraph for being determined as human body target in acquisition image is received, the change of each target subgraph is determined based on time shaft Change amplitude, when amplitude of variation is less than default variation amplitude, the current state for determining the human body target of corresponding target subgraph is Sleep state when all current states for being determined as human body target are all sleep state, send out sleep control signal, otherwise sends out Go out non-sleep control signal;TV current switch states are detected by tv state detection device;Pass through wireless control apparatus It is connect respectively with sleep state identification equipment and tv state detection device, for being TV open shape in the current state of TV State and when receiving sleep control signal, the switchgear of chain road direction TV, which is sent, by radio communication closes drive signal.
It is understood that although the present invention has been disclosed in the preferred embodiments as above, above-described embodiment not to Limit the present invention.For any those skilled in the art, without departing from the scope of the technical proposal of the invention, Many possible changes and modifications are all made to technical solution of the present invention using the technology contents of the disclosure above or are revised as With the equivalent embodiment of variation.Therefore, every content without departing from technical solution of the present invention, technical spirit pair according to the present invention Any simple modifications, equivalents, and modifications made for any of the above embodiments still fall within the range of technical solution of the present invention protection It is interior.

Claims (3)

1. a kind of smart home control method for playing back based on sleep state detection, the method includes:
The current state of TV is determined based on the on off state of the switchgear of TV, the current state of TV is opened including TV State and TV closed state;
Image data acquiring is carried out to TV Week enveloping field scape to obtain high definition scene image, the resolution ratio of the high definition scene image It is related to the complexity of TV Week enveloping field scape;
Determine whether the corresponding target of target subgraph therein is human body target based on high definition scene image;
The each target subgraph for being determined as human body target is received, the variation width of each target subgraph is determined based on time shaft Degree, when amplitude of variation is less than default variation amplitude, the current state for determining the human body target of corresponding target subgraph is sleep State when all current states for being determined as human body target are all sleep state, send out sleep control signal, otherwise sends out non- Sleep control signal;
TV current state for TV opening state and when receiving sleep control signal, chain road direction electricity by radio communication Depending on switchgear send close drive signal;
The resolution ratio of the high definition scene image it is related to the complexity of TV Week enveloping field scape including:The complexity of TV Week enveloping field scape Degree is higher, and the resolution ratio of the high definition scene image is bigger, and the complexity of TV Week enveloping field scape is lower, the high definition scene image Resolution ratio it is smaller;
Wherein, the resolution bits of the high definition scene image are between resolution ratio upper limit threshold and resolution limit threshold value;
It is characterized in that, it further includes:
High definition scene image is received, scene is carried out to high definition scene image and judges to determine pixel pixel in high definition scene image The distribution situation of value is analyzed to determine to each pixel in high definition scene image based on the distribution situation into row pixel value Whether it is noise spot;
The analysis result of the noise spot analytical equipment is received, noise spot each in high definition scene image is formed into multiple noise ranges Domain determines the area and shape of each noise region, and the Area summing of each noise region is total to obtain noise region Area;
When the noise region gross area is more than or equal to preset area threshold value, start adaptive-filtering equipment, in the total face of noise region When product is less than preset area threshold value, adaptive-filtering equipment is closed, high definition scene image is inputted directly as pending image To image smoothing equipment;
Using adaptive-filtering equipment, after being activated, adaptive-filtering processing is carried out to high definition scene image and waits to locate to obtain Manage image;The adaptive-filtering equipment includes region split cells, module selecting unit, filtering execution unit and image combination Unit, region split cells are used to receive the shape of each noise region, the geometry of the shape based on each noise region Each noise region is split into multiple benchmark subregions by feature;
Picture smooth treatment is carried out to pending image to obtain smoothed image;
Wherein, it is described to determine whether the corresponding target of target subgraph therein is that human body target includes:It determines in smoothed image Multiple target subgraphs, the area of each target subgraph is determined, by the area of each target subgraph divided by smooth The area of image is to obtain target area percentage, when target area percentage is fallen in the range of default human body area percentage When, it is human body target to determine the corresponding target of target subgraph;
Wherein, in high definition scene image, the region except multiple noise regions is non-noise region;
Wherein, the distribution situation of pixel pixel value is included for each pixel in high definition scene graph in high definition scene image Region as in determines the pixel value range that the pixel pixel value should belong to;
Wherein, the module selecting unit is connect with the region split cells, for each noise region, for its quilt Each benchmark subregion after fractionation, selects corresponding medium filtering template, and the filtering execution unit is selected with the module Unit connects, for each noise region, each benchmark subregion after being split for it to take the intermediate value of selection to filter Wave template performs medium filtering, to obtain each sub-regions filter pattern, and each sub-regions filter pattern is combined into filtering Noise region subgraph afterwards;Described image assembled unit is connect with the filtering execution unit, for receiving each noise range Domain subgraph, and non-noise region combined with each noise region subgraph to obtain pending image;
Wherein, the shape of each benchmark subregion is rectangular, round or linear, when shape is rectangular, each benchmark The size in region is the pixel of 3 pixels × 3, the pixel of the pixel of 5 pixels × 5 or 7 pixels × 7, when shape is round, each benchmark The radius of subregion is 3 pixels, 5 pixels or 7 pixels, and when shape is linear, each benchmark subregion is an one-dimensional picture Element set.
2. the smart home control method for playing back as described in claim 1 based on sleep state detection, which is characterized in that also wrap It includes:
Prestore the resolution ratio upper limit threshold and the resolution limit threshold value.
3. the smart home control method for playing back as claimed in claim 2 based on sleep state detection, which is characterized in that also wrap It includes:
Determine that daily each period of TV makes based on the on off state of the switchgear of TV in daily each period Use frequency;
The frequency of use of daily each period is ranked up, frequency of use is more than or equal to the period of predeterminated frequency threshold value As frequent usage time interval, using period of the frequency of use less than predeterminated frequency threshold value as idle usage time interval, and incite somebody to action Current time is matched with daily each period, when being matched when current time with some idle usage time interval, is sent out Close pre-warning signal;
Pre-warning signal will be closed to include on the screen of TV waiting for the confirmation of TV user or denying, the switchgear of TV When being displayed up to default display time threshold in closing pre-warning signal and cannot get the input signal denied of TV user, close TV.
CN201710727460.8A 2017-08-23 2017-08-23 Smart home broadcasting control system and method based on sleep state detection Active CN107396159B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201710727460.8A CN107396159B (en) 2017-08-23 2017-08-23 Smart home broadcasting control system and method based on sleep state detection
CN201810300889.3A CN108600806A (en) 2017-08-23 2017-08-23 A kind of broadcasting control system
CN201711400498.0A CN108134959A (en) 2017-08-23 2017-08-23 Smart home broadcasting control system based on sleep state detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710727460.8A CN107396159B (en) 2017-08-23 2017-08-23 Smart home broadcasting control system and method based on sleep state detection

Related Child Applications (2)

Application Number Title Priority Date Filing Date
CN201810300889.3A Division CN108600806A (en) 2017-08-23 2017-08-23 A kind of broadcasting control system
CN201711400498.0A Division CN108134959A (en) 2017-08-23 2017-08-23 Smart home broadcasting control system based on sleep state detection

Publications (2)

Publication Number Publication Date
CN107396159A CN107396159A (en) 2017-11-24
CN107396159B true CN107396159B (en) 2018-06-19

Family

ID=60354257

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201710727460.8A Active CN107396159B (en) 2017-08-23 2017-08-23 Smart home broadcasting control system and method based on sleep state detection
CN201810300889.3A Pending CN108600806A (en) 2017-08-23 2017-08-23 A kind of broadcasting control system
CN201711400498.0A Pending CN108134959A (en) 2017-08-23 2017-08-23 Smart home broadcasting control system based on sleep state detection

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN201810300889.3A Pending CN108600806A (en) 2017-08-23 2017-08-23 A kind of broadcasting control system
CN201711400498.0A Pending CN108134959A (en) 2017-08-23 2017-08-23 Smart home broadcasting control system based on sleep state detection

Country Status (1)

Country Link
CN (3) CN107396159B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108090446A (en) * 2017-12-18 2018-05-29 大陆汽车投资(上海)有限公司 Vehicular intelligent response method based on recognition of face
CN109035457A (en) * 2018-07-10 2018-12-18 王刚 Automatic automobile passage charge platform
CN109663321B (en) * 2018-08-14 2020-10-16 王云 Real-time measuring method for leg tension
CN108985273A (en) * 2018-08-18 2018-12-11 明超 Child's bodily form cloud platform recognition methods
CN109714521B (en) * 2018-08-20 2020-11-03 浙江禾记电子科技有限公司 Conference site on-site registration platform
CN109151580A (en) * 2018-09-27 2019-01-04 江苏银河数字技术有限公司 Radar identifies standby control system and method
CN109872430A (en) * 2019-02-26 2019-06-11 移康智能科技(上海)股份有限公司 A kind of control method and intelligent door of intelligent door
CN112802300A (en) * 2020-12-23 2021-05-14 张慧东 Dynamic triggering system based on wireless communication

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430457A (en) * 2015-11-12 2016-03-23 深圳市丰巨泰科电子有限公司 TV box for identifying sleep state of human body
CN105847925A (en) * 2016-05-30 2016-08-10 乐视控股(北京)有限公司 Television control method and television control system
CN106375855A (en) * 2015-12-30 2017-02-01 深圳市美贝壳科技有限公司 Household intelligent equipment dormancy method

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7091471B2 (en) * 2004-03-15 2006-08-15 Agilent Technologies, Inc. Using eye detection for providing control and power management of electronic devices
CN101188719B (en) * 2007-12-20 2012-08-22 康佳集团股份有限公司 A TV smart power off device and method
CN102055928A (en) * 2009-11-04 2011-05-11 鸿富锦精密工业(深圳)有限公司 Television and lock control method thereof
WO2014068537A2 (en) * 2012-11-02 2014-05-08 Koninklijke Philips N.V. Electronic switch for controlling a device in dependency on a sleep stage
CN105791984B (en) * 2014-12-22 2019-07-12 深圳Tcl新技术有限公司 TV set control method and television set
CN106974540B (en) * 2017-05-23 2018-05-29 胡海明 Curtain state transition platform based on wind-force detection

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430457A (en) * 2015-11-12 2016-03-23 深圳市丰巨泰科电子有限公司 TV box for identifying sleep state of human body
CN106375855A (en) * 2015-12-30 2017-02-01 深圳市美贝壳科技有限公司 Household intelligent equipment dormancy method
CN105847925A (en) * 2016-05-30 2016-08-10 乐视控股(北京)有限公司 Television control method and television control system

Also Published As

Publication number Publication date
CN107396159A (en) 2017-11-24
CN108134959A (en) 2018-06-08
CN108600806A (en) 2018-09-28

Similar Documents

Publication Publication Date Title
CN107396159B (en) Smart home broadcasting control system and method based on sleep state detection
CN103518178A (en) Display control device, method, and program
CN111104910B (en) Garbage delivery behavior supervision method and related products
CN107454353B (en) A kind of method of the automatic closing television machine of intelligence
CN101959055A (en) The multimedia that comprises a plurality of properties windows is presented the method and apparatus that monitors
CN107734275A (en) TV automatic closing system
CN104850815B (en) The coding/decoding method of shown bar code on mobile phone
CN107493492B (en) Multi-functional dual tuner set-top box
CN103856813A (en) Television program switching system and method
CN108810586B (en) Set-top box
CN108093246A (en) A kind of recognition methods of top box of digital machine video playback area and device
CN104378681A (en) Self-adaptive control method of smart television
CN109672829A (en) Method of adjustment, device, storage medium and the terminal of brightness of image
KR102487111B1 (en) Method and apparatus for monitoring quality of sign language broadcasting
CN103716676B (en) The video program play method and device of intelligent television
CN108322813B (en) Anti-tampering formula audio plays channel selecting platform
CN105430443A (en) Method and system for acquiring user behavior data based on smart TV
CN200997639Y (en) Apparatus for identifying television station symbol and realizing rating investigation
CN106101759A (en) A kind of photovoltaic solar cell plate cleaning method
CN104038805B (en) The method for showing the television set and display video image of video image
CN111050139B (en) Image processing method, image output equipment and electronic equipment
CN115499692B (en) Digital television intelligent control method and system based on image processing
KR20020036867A (en) A system for measuring the effects of tv ads and a method of face recognition
CN109561341B (en) Anti-tampering formula audio plays channel selection method
KR102557442B1 (en) Method and apparatus for monitoring quality of sign language broadcasting

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20180305

Address after: 518000 Guangdong Province, Shenzhen New District of Longhua City, Dalang street, Longsheng Gold Dragon Road community e-commerce incubator exhibition Tao Commercial Plaza E block 706

Applicant after: Shenzhen step Technology Transfer Center Co., Ltd.

Address before: 050400 Industrial Road, Xibaipo Industrial Park, Pingshan County, Shijiazhuang, Hebei Province, No. 19

Applicant before: Zhang Ke

TA01 Transfer of patent application right
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Zhang Yadong

Inventor before: Zhang Ke

TA01 Transfer of patent application right

Effective date of registration: 20180427

Address after: 730014 278, 101 east railway station, Chengguan District, Lanzhou, Gansu

Applicant after: Zhang Yadong

Address before: 518000 Guangdong Shenzhen Longhua New District big wave street Longsheng community Tenglong road gold rush e-commerce incubation base exhibition hall E commercial block 706

Applicant before: Shenzhen step Technology Transfer Center Co., Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20190507

Address after: 730000 South Hebei Road 956-962, Chengguan District, Lanzhou City, Gansu Province

Patentee after: Lanzhou Ruichuang Bodi Information Technology Co., Ltd.

Address before: 730014 278, 101 east railway station, Chengguan District, Lanzhou, Gansu

Patentee before: Zhang Yadong

PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Intelligent home play control system and method based on sleep state detection

Effective date of registration: 20200804

Granted publication date: 20180619

Pledgee: Lanzhou financial holding Financing Guarantee Co., Ltd

Pledgor: Lanzhou Ruichuang Bodi Information Technology Co.,Ltd.

Registration number: Y2020620000012

PC01 Cancellation of the registration of the contract for pledge of patent right
PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20220329

Granted publication date: 20180619

Pledgee: Lanzhou financial holding Financing Guarantee Co.,Ltd.

Pledgor: Lanzhou Ruichuang Bodi Information Technology Co.,Ltd.

Registration number: Y2020620000012

PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Smart home playback control system and method based on sleep state detection

Effective date of registration: 20220401

Granted publication date: 20180619

Pledgee: Lanzhou Rural Commercial Bank Co.,Ltd. Qilihe sub branch

Pledgor: Lanzhou Ruichuang Bodi Information Technology Co.,Ltd.

Registration number: Y2022620000009

PE01 Entry into force of the registration of the contract for pledge of patent right