CN105868749A - Intelligent building integrated system on basis of cloud computing and internet of things - Google Patents
Intelligent building integrated system on basis of cloud computing and internet of things Download PDFInfo
- Publication number
- CN105868749A CN105868749A CN201610478007.3A CN201610478007A CN105868749A CN 105868749 A CN105868749 A CN 105868749A CN 201610478007 A CN201610478007 A CN 201610478007A CN 105868749 A CN105868749 A CN 105868749A
- Authority
- CN
- China
- Prior art keywords
- value
- image
- pixel
- equipment
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/164—Detection; Localisation; Normalisation using holistic features
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
The invention relates to an intelligent building integrated system on the basis of cloud computing and an internet of things. The intelligent building integrated system comprises cinema structural arrangement equipment, CMOS (complementary metal oxide semiconductor) sensing equipment, image pre-processing equipment and human face region extracting equipment. The CMOS sensing equipment is used for acquiring auditorium images, the image pre-processing equipment is connected with the CMOS sensing equipment and is used for pre-processing the auditorium images, and the human face region extracting equipment is connected with the image pre-processing equipment and is used for extracting human face regions of various audiences on the basis of output of the image pre-processing equipment. The intelligent building integrated system has the advantage that human face data of the audiences can be quickly extracted by the aid of the intelligent building integrated system.
Description
Technical field
The present invention relates to field of cloud calculation, particularly relate to a kind of intelligence based on Internet of Things and cloud computing and build
Build integrated system.
Background technology
Camera in order to prevent performance on-the-spot is taken on the sly, and currently, substantial amounts of camera interference method mainly utilizes
Imaging sensor responds ultrared principle.In order to disturb mobile camera and the picture in shooting
Middle generation light, infrared emitter is installed in cinema.Except extra one-tenth such as those transmitters
This expense and regular job expense, this scheme can be by enclosing suitable filter on camera lens.But
This mode is easy to be avoided because of the selection of the person of taking on the sly.
Accordingly, it would be desirable to a kind of new anti-camcording technology scheme, it is possible to auditorium image is carried out electronics and divides
Analysis, carries out electronic analysis to scene performance environment, and carries out the person's of taking on the sly judgement based on two kinds of analysis results,
It addition, the person of taking on the sly is reminded by the positional information being additionally based upon the person of taking on the sly, thus realize performance scene and steal
The oriented detection of bat person and orientation warning.
Summary of the invention
In order to solve the problems referred to above, the invention provides a kind of intelligence based on Internet of Things and cloud computing and build
Build integrated system, auditorium image capture device be set at the scene and complete the extraction to auditorium image,
Introduce various image processing equipment and whether image analysis equipment judges to exist in the image of auditorium suspicious
The person of taking on the sly, in the case of there is the suspicious person of taking on the sly, extract suspicious seat, the person of taking on the sly place
Numbering, the most at the scene ambient parameter or current performance content are detected, in real time with basis
Information and the Site Detection result of the suspicious person of taking on the sly determine the person that really do not takes on the sly.
According to an aspect of the present invention, it is provided that a kind of intelligent building collection based on Internet of Things and cloud computing
One-tenth system, described system includes structure advancing equipment, CMOS sensing equipment, Image semantic classification
Equipment and human face region extraction equipment, CMOS sensing equipment is used for gathering auditorium image, and image is pre-
Processing equipment is connected with CMOS sensing equipment, for auditorium image is pre-processed, and face district
Territory extraction equipment is connected with image-preprocessing device, extracts for output based on image-preprocessing device
The human face region of each spectators.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing, including:
Structure advancing equipment, is connected with Freescale MC9S12 chip, at Freescale
Under the control of MC9S12 chip, receive the structure control signal that Internet of Things sends；Timer,
The Background control being arranged on movie theatre is indoor, is used for providing timing signal；Ambient brightness sensing equipment, if
Put in middle position, movie theatre roof, for sensing the real-time luminosity of movie theatre internal environment using as real-time ring
Border brightness output；Face brightness detection equipment, the Background control being arranged on movie theatre is indoor, with face district
Territory extraction equipment connects to receive everyone face image and the seat numbering of its correspondence, for based on
It is bright that the gray value of each pixel of everyone face image calculates everyone image of face image
Spend to export as real-time face brightness；Brightness deviates from detection equipment, is arranged on the Background control of movie theatre
Indoor, are connected with timer, ambient brightness detection equipment and face brightness detection equipment respectively, are used for
Receive real time environment brightness and receive the real-time face brightness of everyone face image, for each
Individual's face image, when the time that its real-time face brightness and real time environment brightness deviate from reaches to preset
Between length threshold time, using corresponding for face subgraph seat numbering as targeted seat numbering output；Fly
Thinking karr MC9S12 chip, the Background control being arranged on movie theatre is indoor, deviates from detection equipment with brightness
Connect, for sending, based on targeted seat numbering, the drive control signal including that targeted seat is numbered；Electricity
Machine drives equipment, and the Background control being arranged on movie theatre is indoor, respectively with Freescale MC9S12 chip
Connect with direct current generator, for receiving the drive control signal that Freescale MC9S12 chip is sent,
And resolve to determine that targeted seat is numbered to drive control signal, determine based on targeted seat numbering
Motor drive signal；The Cloud Terrace, is arranged on the position, roof directly over movie theatre curtain, fixes including equipment
Support and direct current generator, equipment fixed support is used for fixing lighting apparatus and direct current generator, direct current generator
It is connected with motor driving apparatus, for adjusting the illumination of lighting apparatus under the driving of motor drive signal
Direction, and after having adjusted, send illumination enabling signal；Lighting apparatus, fixing of the equipment that is fixed on
On frame, be connected with direct current generator, including light switch and lighting source, light switch respectively with direct current
Motor and lighting source connect, for automatically opening up to start illumination after receiving illumination enabling signal
The illumination of light source；CMOS sensing equipment, is arranged on middle position, movie theatre roof, for movie theatre curtain
The auditorium on cloth opposite carries out IMAQ with output auditorium image；Data splitting equipment, is positioned at cloud
End, is connected with CMOS sensing equipment, for auditorium image is divided into N number of image block, N
For the natural number more than 1；N number of high in the clouds storage device, is positioned at high in the clouds, is connected with data splitting equipment,
For storing N number of image block respectively；Cloud service central apparatus, is positioned at high in the clouds, with N number of high in the clouds
Storage device connects, and is used for concentrating N number of image block, and N number of image block is distributed to M
High in the clouds application apparatus, M is that the natural number more than 1 and M are less than or equal to N；Command channel, high in the clouds is managed
Reason equipment, is positioned at high in the clouds, for high in the clouds order is carried out channel management；M high in the clouds application apparatus,
It is positioned at high in the clouds, is connected with cloud service central apparatus, for receiving be assigned to, more than one figure
As piecemeal, each high in the clouds application apparatus includes: gray processing processes subset, carries including channel parameters
Taking unit, weighted value memory cell and gray value computing unit, channel parameters extraction unit is used for receiving
Each image block, extract the R passage pixel value of each pixel in image block, G lead to
Road pixel value and channel B pixel value, weighted value memory cell be used for having prestored R channel weighting value,
G channel weighting value and channel B weighted value, gray value computing unit respectively with channel parameters extraction unit
Connect with weighted value memory cell, for each pixel in image block, by R passage pixel value
Lead to product and the B of G channel weighting value with product, the G passage pixel value of R channel weighting value
The product addition of road pixel value and channel B weighted value with obtain for the gray value of pixel, and base
In image block, the gray value of each pixel obtains the gray level image that image block is corresponding；Its
In, R channel weighting value value is 0.298839, and G channel weighting value value is 0.586811, and B leads to
Higher value is 0.114350；Histogram distribution detection subset, processes subset with gray processing
Connect, be used for receiving gray level image, and gray level image carried out grey level histogram process to obtain
Corresponding histogram image, when histogram image presents bimodal distribution, sends global threshold and selects letter
Number, otherwise, send non-global threshold and select signal；Threshold value selects subset, examines with histogram distribution
Measurement equipment connects, for when receiving global threshold and selecting signal, using global threshold 128 as threshold
Value Data exports, when receiving non-global threshold and selecting signal, by neighbor pixel gray difference threshold
40 export as threshold data；Binary conversion treatment subset, selects subset and Nogata with threshold value respectively
Figure distribution detection subset connects, for when receiving global threshold and selecting signal, for gray processing
Each pixel in image, when gray value more than or equal to threshold data time, by for pixel
Be set to white level pixel, when gray value less than threshold data time, by for pixel be set to
Black level pixel, and the binary image that output gray level image is corresponding；Binary conversion treatment subset
It is additionally operable to when receiving non-global threshold and selecting signal, for each pixel in gray level image
Point, calculates vertical direction upwards grey as upper pixel apart from the gray value of the pixel of its 3 pixels
Angle value, calculate vertical direction downwards apart from the gray value of pixel of its 3 pixels as lower pixel
Gray value, calculated level direction to the left apart from the gray value of pixel of its 3 pixels as left picture
Element gray value, calculated level direction to the right apart from the gray value of pixel of its 3 pixels as the right side
Grey scale pixel value, when the absolute value of upper grey scale pixel value and the difference of lower grey scale pixel value is less than or equal to threshold value
When the absolute value of the difference of data and left grey scale pixel value and right grey scale pixel value is less than or equal to threshold data,
By for pixel be set to white level pixel, when upper grey scale pixel value and lower grey scale pixel value it
The absolute value of difference is more than threshold data or the absolute value of the difference of left grey scale pixel value and right grey scale pixel value
During more than threshold data, by for pixel be set to black level pixel, and output gray level figure
As corresponding binary image；Picture smooth treatment subset, is connected with binary conversion treatment subset,
For receiving binary image, for each pixel in binary image, when adjacent is owned
When pixel exists the trip point of more than half, then by for pixel gray value retain, no
Then, by for the gray value of pixel be set to white level pixel, and export binary image pair
The smoothed image answered；Medium filtering subset, processes subset with image balance and is connected, be used for receiving
Smoothed image, is analyzed determining each noise profile to the gray value of the pixel of smoothed image
The distribution radius in region, the maximum in distribution radius based on each noise profile region determines and carries out
The filtered pixel block size of medium filtering, uses the filtered pixel block size determined to carry out smoothed image
Medium filtering processes to obtain filtering image；Data merge equipment, are positioned at high in the clouds, should with M high in the clouds
Connect with equipment, for the filtering figure that the medium filtering subset of each high in the clouds application apparatus is exported
As carrying out splicing to obtain filtering integral image；Human face region extraction equipment, is arranged on the backstage of movie theatre
In control room, with data merge equipment is connected with obtain filtering integral image, will filtering integral image and
The facial contour pattern prestored carry out mating with detection and be partitioned in filtering integral image each
Individual's face image, for everyone face image, for its position in filtering integral image
Determine for face subgraph corresponding seat numbering；Wherein, for face subgraph corresponding
The movie seat numbering at the spectators place that seat numbered face subgraph is corresponding；Wherein, face subgraph
The determination mode that the real-time face brightness of picture and real time environment brightness deviate from is as follows: when face subgraph
When real-time face brightness is more than real time environment brightness, determine real-time face brightness and the reality of face subgraph
Time ambient brightness deviate from, when the real-time face brightness of face subgraph is less than or equal to real time environment brightness
Time, determine that the real-time face brightness of face subgraph is non-with real time environment brightness and deviate from.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing, also wrap
Include: Compact Flash, be used for prestoring R channel weighting value, G channel weighting value and channel B and add
Weights, are additionally operable to store predetermined time period threshold value.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing: CF
The Background control that storage card is arranged on movie theatre is indoor.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing: CF
Storage card is additionally operable to prestore facial contour pattern.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing: CF
Storage card and Freescale MC9S12 chip are integrated on one piece of surface-mounted integrated circuit.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing: black appliances
The gray value of flat pixel is 0.
More specifically, in described Intelligent building integrated system based on Internet of Things and cloud computing: white appliances
The gray value of flat pixel is 255.
Accompanying drawing explanation
Below with reference to accompanying drawing, embodiment of the present invention are described, wherein:
Fig. 1 is according to the intelligent building collection based on Internet of Things and cloud computing shown in embodiment of the present invention
The block diagram of one-tenth system.
Reference: 1CMOS sensing equipment；2 image-preprocessing device；3 human face regions extract
Equipment
Detailed description of the invention
The integrated system of intelligent building based on Internet of Things and cloud computing to the present invention below with reference to accompanying drawings
The embodiment of system is described in detail.
The existing anti-electronic jamming device taken on the sly is that one infrared facility is placed in curtain or dance
The back side of platform, infrared facility sends the sightless infrared ray of human eye, if the person of taking on the sly is moving
Terminal or video camera shooting, then infrared ray is by the video camera imaging of the interference person of taking on the sly, causes the person of taking on the sly to obtain
The image obtained or lower picture quality, it is impossible to commercially sell and propagate on network, thus having
Effect safeguards copyright interest.
But, this mode needs to launch infrared ray always, and ultrared transmitting is large-scale,
Need all to launch infrared ray, relatively costly and poor feasibility from each position.Therefore on-the-spot electronics is prevented
The equipment of taking on the sly also needs to find other break through direction.
In order to overcome above-mentioned deficiency, the present invention has built a kind of intelligence based on Internet of Things and cloud computing and has built
Build integrated system, it is possible to by audience seat spectators behavioral value and by on-the-spot ring
The parameter extraction in border determines whether there is the person of taking on the sly in audience seat, and can be in time to the person of taking on the sly
The position at place positions, in order to take to orient warning measure accordingly, reminds the person of taking on the sly to abandon
Take on the sly behavior.
Fig. 1 is according to the intelligent building collection based on Internet of Things and cloud computing shown in embodiment of the present invention
The block diagram of one-tenth system, described system include structure advancing equipment, CMOS sensing equipment,
Image-preprocessing device and human face region extraction equipment, CMOS sensing equipment is used for gathering auditorium figure
Picture, image-preprocessing device is connected with CMOS sensing equipment, for auditorium image is carried out pre-place
Reason, human face region extraction equipment is connected with image-preprocessing device, for based on image-preprocessing device
Output extract each spectators human face region.
Then, continue to the present invention based on Internet of Things and the tool of the Intelligent building integrated system of cloud computing
Body structure is further detailed.
Described system includes: structure advancing equipment, is connected with Freescale MC9S12 chip,
Under the control at Freescale MC9S12 chip, receive the structure control that Internet of Things sends
Signal；Timer, the Background control being arranged on movie theatre is indoor, is used for providing timing signal；Environment is bright
Degree sensing equipment, is arranged on middle position, movie theatre roof, for sensing the brightest of movie theatre internal environment
Spend to export as real time environment brightness；Face brightness detection equipment, is arranged on the Background control of movie theatre
Indoor, connect with human face region extraction equipment to receive everyone face image and its corresponding seat
Numbering, the gray value for each pixel based on everyone face image calculates everyone face
The brightness of image of image is to export as real-time face brightness.
Described system includes: brightness deviates from detection equipment, and the Background control being arranged on movie theatre is indoor, point
It is not connected with timer, ambient brightness detection equipment and face brightness detection equipment, is used for receiving in real time
Ambient brightness and receive the real-time face brightness of everyone face image, for everyone face
Image, reaches predetermined time period threshold when the time that its real-time face brightness and real time environment brightness deviate from
During value, using seat numbering corresponding for face subgraph as targeted seat numbering output；Freescale
MC9S12 chip, the Background control being arranged on movie theatre is indoor, deviates from detection equipment with brightness and is connected,
For sending, based on targeted seat numbering, the drive control signal including that targeted seat is numbered.
Described system includes: motor driving apparatus, and the Background control being arranged on movie theatre is indoor, respectively with
Freescale MC9S12 chip and direct current generator connect, and are used for receiving Freescale MC9S12 chip
The drive control signal sent, and resolve drive control signal to determine that targeted seat is numbered,
Motor drive signal is determined based on targeted seat numbering.
Described system includes: The Cloud Terrace, is arranged on the position, roof directly over movie theatre curtain, including equipment
Fixed support and direct current generator, equipment fixed support is used for fixing lighting apparatus and direct current generator, direct current
Motor is connected with motor driving apparatus, for adjusting lighting apparatus under the driving of motor drive signal
Illumination direction, and after having adjusted, send illumination enabling signal；Lighting apparatus, is fixed on equipment solid
On fixed rack, be connected with direct current generator, including light switch and lighting source, light switch respectively with
Direct current generator and lighting source connect, for automatically opening up to start after receiving illumination enabling signal
The illumination of lighting source.
Described system includes: CMOS sensing equipment, is arranged on middle position, movie theatre roof, for right
The auditorium on movie theatre curtain opposite carries out IMAQ with output auditorium image；Data splitting equipment,
It is positioned at high in the clouds, is connected with CMOS sensing equipment, for auditorium image is divided into N number of image
Piecemeal, N is the natural number more than 1；N number of high in the clouds storage device, is positioned at high in the clouds, splits with data
Equipment connects, for storing N number of image block respectively；Cloud service central apparatus, is positioned at high in the clouds,
It is connected with N number of high in the clouds storage device, is used for concentrating N number of image block, and by N number of image block
Being distributed to M high in the clouds application apparatus, M is that the natural number more than 1 and M are less than or equal to N；High in the clouds
Command channel management equipment, is positioned at high in the clouds, for high in the clouds order is carried out channel management.
Described system includes: M high in the clouds application apparatus, is positioned at high in the clouds, with cloud service central apparatus
Connect, for receiving be assigned to, more than one image block.
Each high in the clouds application apparatus includes: gray processing processes subset, extracts single including channel parameters
Unit, weighted value memory cell and gray value computing unit, channel parameters extraction unit is used for receiving each
Individual image block, extracts the R passage pixel value of each pixel in image block, G passage picture
Element value and channel B pixel value, weighted value memory cell is used for having prestored R channel weighting value, G
Channel weighting value and channel B weighted value, gray value computing unit respectively with channel parameters extraction unit and
Weighted value memory cell connects, for each pixel in image block, by R passage pixel value with
The product of the product of R channel weighting value, G passage pixel value and G channel weighting value and channel B picture
Element value and the product addition of channel B weighted value with obtain for the gray value of pixel, and based on figure
As in piecemeal, the gray value of each pixel obtains the gray level image that image block is corresponding；Wherein, R
Channel weighting value value is 0.298839, and G channel weighting value value is 0.586811, and channel B weights
Value value is 0.114350.
Each high in the clouds application apparatus includes: histogram distribution detection subset, processes son with gray processing
Equipment connects, and is used for receiving gray level image, and gray level image is carried out grey level histogram process with
Obtain corresponding histogram image, when histogram image presents bimodal distribution, send global threshold choosing
Select signal, otherwise, send non-global threshold and select signal；Threshold value selects subset, divides with histogram
Cloth detection equipment connects, for when receiving global threshold and selecting signal, being made by global threshold 128
Export for threshold data, when receiving non-global threshold and selecting signal, by neighbor pixel gray scale difference
Threshold value 40 exports as threshold data.
Each high in the clouds application apparatus includes: binary conversion treatment subset, selects son to set with threshold value respectively
Standby and histogram distribution detection subset connects, and is used for when receiving global threshold and selecting signal, pin
To each pixel in gray level image, when gray value is more than or equal to threshold data, will be for
Pixel be set to white level pixel, when gray value less than threshold data time, by for pixel
Point is set to black level pixel, and the binary image that output gray level image is corresponding；At binaryzation
Reason subset is additionally operable to when receiving non-global threshold and selecting signal, every in gray level image
One pixel, calculates vertical direction upwards apart from the gray value conduct of pixel of its 3 pixels
Upper grey scale pixel value, calculates vertical direction and makees apart from the gray value of the pixel of its 3 pixels downwards
For lower grey scale pixel value, calculated level direction is to the left apart from the gray value of pixel of its 3 pixels
As left grey scale pixel value, calculated level direction is to the right apart from the gray scale of pixel of its 3 pixels
Value is as right grey scale pixel value, when the absolute value of upper grey scale pixel value and the difference of lower grey scale pixel value is less than
It is less than or equal to threshold equal to the absolute value of threshold data and the difference of left grey scale pixel value and right grey scale pixel value
During Value Data, by for pixel be set to white level pixel, when upper grey scale pixel value and lower picture
The absolute value of the difference of element gray value more than threshold data or left grey scale pixel value and right grey scale pixel value it
When the absolute value of difference is more than threshold data, by for pixel be set to black level pixel, and defeated
Go out the binary image that gray level image is corresponding.
Each high in the clouds application apparatus includes: picture smooth treatment subset, sets with binary conversion treatment
Standby connection, is used for receiving binary image, for each pixel in binary image, works as phase
When adjacent all pixels exist the trip point of more than half, then by for the gray value of pixel
Retain, otherwise, by for the gray value of pixel be set to white level pixel, and export two-value
Change the smoothed image that image is corresponding.
Each high in the clouds application apparatus includes: medium filtering subset, processes subset with image balance
Connect, be used for receiving smoothed image, be analyzed determining to the gray value of the pixel of smoothed image
The distribution radius in each noise profile region, in distribution radius based on each noise profile region
Maximum determines the filtered pixel block size carrying out medium filtering, uses the filtered pixel block size determined
Smoothed image carries out medium filtering process to obtain filtering image.
Described system includes: data merge equipment, are positioned at high in the clouds, are connected with M high in the clouds application apparatus,
For the filtering image that the medium filtering subset of each high in the clouds application apparatus exports is spliced
To obtain filtering integral image.
Described system includes: human face region extraction equipment, and the Background control being arranged on movie theatre is indoor, with
Data merge equipment and connect to obtain filtering integral image, by filtering integral image and the people prestored
Face contour patterns carries out mating with detection and being partitioned into each face subgraph in filtering integral image,
For everyone face image, for its position in filtering integral image determine for face
The seat numbering that subgraph is corresponding.
Wherein, for spectators institute corresponding to seat numbered face subgraph corresponding to face subgraph
Movie seat numbering；The real-time face brightness of face subgraph and real time environment brightness deviate from really
Determine mode as follows: when the real-time face brightness of face subgraph is more than real time environment brightness, determine people
The real-time face brightness of face image deviates from real time environment brightness, when the real-time face of face subgraph
When brightness is less than or equal to real time environment brightness, determine the real-time face brightness of face subgraph and real-time ring
Border brightness is non-to be deviated from.
Alternatively, in the system, also include: Compact Flash, be used for prestoring R passage
Weighted value, G channel weighting value and channel B weighted value, be additionally operable to store predetermined time period threshold value；
The Background control that Compact Flash is arranged on movie theatre is indoor；Compact Flash is additionally operable to prestore face wheel
Wide pattern；Compact Flash and Freescale MC9S12 chip are integrated on one piece of surface-mounted integrated circuit；
The gray value of black level pixel is 0；The gray value of white level pixel is 255.
It addition, CMOS (Complementary Metal-Oxide-Semiconductor), middle literature
Entitled complementary metal oxide semiconductors (CMOS), he is originally a kind of important chip in computer system, preserves
The data that System guides is most basic.It is poor that the manufacturing technology of CMOS and general computer chip do not have
Not, the semiconductor made mainly by silicon and germanium both elements so that it is coexist on CMOS
Band N (band-electricity) and the semiconductor of P (band+electricity) level, electricity produced by the two complementary effect
Stream can be processed chip record and be interpreted to image.Found that CMOS can also make through processing later
For the imageing sensor in digital photography.
For independent of the portable use of electrical network, the CMOS skill famous with low power consumption characteristic
Art has an obvious advantage: cmos image sensor is for 5V and 3.3V supply voltage
Design.CCD chip then needs the supply voltage of about 12V, therefore has to use one
Electric pressure converter, thus cause power consumption to increase.In terms of total power consumption, integrated with systemic-function controlling
Another benefit will be brought: it is all that he eliminates with other semiconductor elements in cmos sensor
External connection line.The driver of its high power consumption is abandoned the most, this is because carry out at chip internal
The energy that communication is consumed is more much lower than by the outside implementation of PCB or substrate.
Cmos sensor also can be subdivided into passive type element sensor (Passive Pixel Sensor
CMOS) with active pixel sensor (Active Pixel Sensor CMOS).
Passive type element sensor (Passive Pixel Sensor is called for short PPS), is again passive type picture
Element sensor, he is made up of a back-biased photodiode and a switching tube.Photosensitive two poles
Pipe is substantially a PN junction being made up of P-type semiconductor and N-type semiconductor, and he can be equivalent to one
Individual back-biased diode and a mos capacitance parallel connection.When switching tube is opened, photosensitive two poles
Pipe connects with vertical alignment (Column bus).The charge integration amplifier being positioned at alignment end is read
Going out circuit (Charge integrating amplifier) keeps column line voltage to be a constant, when photosensitive two poles
The signal charge of pipe storage is when being read, and its voltage is reset to column line voltage level, meanwhile,
The electric charge being directly proportional to optical signal is converted to electric charge output by charge integration amplifier.
Active pixel sensor (Active Pixel Sensor is called for short APS), is again active picture
Element sensor.Almost while CMOS PPS dot structure is invented, it is rapidly be recognized that at picture
In element, introducing buffer or amplifier can improve the performance of pixel, each pixel in CMOS APS
Inside there is the amplifier of oneself.The transistor that amplifies being integrated in surface decreases effective table of pixel element
Area, reduces " packaging density ", makes the incident light of 40%～50% be reflected.This sensor
Another problem be how to make to have between the multi-channel amplifier of sensor preferably coupling, this can
Preferably realize with the fixed pattern noise by reducing residual level.Due in CMOS APS pixel
Each amplifier only at this read during be excited, so CMOS APS power dissipation ratio CCD figure
The least as sensor.
Use the present invention based on Internet of Things and the Intelligent building integrated system of cloud computing, for existing skill
Art cannot provide the technical problem of effective detection of electrons for taking on the sly of performance, by using targetedly
, the audience status of auditorium enters by high-precision a series of images processing equipment and image analysis equipment
Row is analyzed, and is analyzed, on the basis of above-mentioned analysis, to sight also by the environment on-the-spot to performance
In many seats, the behavior of pirates shoot person accurately detects and location recognition.
Although it is understood that the present invention discloses as above with preferred embodiment, but above-mentioned enforcement
Example is not limited to the present invention.For any those of ordinary skill in the art, without departing from
Under technical solution of the present invention ambit, all may utilize the technology contents of the disclosure above to the technology of the present invention
Scheme makes many possible variations and modification, or is revised as the Equivalent embodiments of equivalent variations.Therefore,
Every content without departing from technical solution of the present invention, the technical spirit of the foundation present invention is to above example
Any simple modification, equivalent variations and the modification done, all still falls within technical solution of the present invention protection
In the range of.
Claims (8)
1., based on Internet of Things and an Intelligent building integrated system for cloud computing, described system includes shadow
Institute's structure advancing equipment, CMOS sensing equipment, image-preprocessing device and human face region extraction equipment,
CMOS sensing equipment is used for gathering auditorium image, image-preprocessing device and CMOS sensing equipment
Connecting, for pre-processing auditorium image, human face region extraction equipment sets with Image semantic classification
Standby connection, extracts the human face region of each spectators for output based on image-preprocessing device.
2. as claimed in claim 1 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that, described system includes:
Structure advancing equipment, is connected with Freescale MC9S12 chip, at Freescale
Under the control of MC9S12 chip, receive the structure control signal that Internet of Things sends；
Timer, the Background control being arranged on movie theatre is indoor, is used for providing timing signal；
Ambient brightness sensing equipment, is arranged on middle position, movie theatre roof, is used for sensing movie theatre inner loop
The real-time luminosity in border is to export as real time environment brightness；
Face brightness detection equipment, the Background control being arranged on movie theatre is indoor, extracts with human face region and sets
Standby connection is to receive everyone face image and the seat numbering of its correspondence, for based on everyone
The gray value of each pixel of face image calculate the brightness of image of everyone face image using as
Real-time face brightness exports；
Brightness deviates from detection equipment, and the Background control being arranged on movie theatre is indoor, respectively with timer, ring
Border brightness detection equipment and face brightness detection equipment connect, and are used for receiving real time environment brightness and connecing
Receive the real-time face brightness of everyone face image, for everyone face image, when it is real-time
When the time that face brightness and real time environment brightness deviate from reaches predetermined time period threshold value, by people's face
The seat numbering that image is corresponding exports as targeted seat numbering；
Freescale MC9S12 chip, the Background control being arranged on movie theatre is indoor, deviates from inspection with brightness
Measurement equipment connects, and includes that the driving that targeted seat is numbered controls letter for sending based on targeted seat numbering
Number；
Motor driving apparatus, the Background control being arranged on movie theatre is indoor, respectively with Freescale MC9S12
Chip and direct current generator connect, and the driving sent for receiving Freescale MC9S12 chip controls letter
Number, and resolve drive control signal to determine that targeted seat is numbered, number based on targeted seat
Determine motor drive signal；
The Cloud Terrace, is arranged on the position, roof directly over movie theatre curtain, including equipment fixed support and direct current
Motor, equipment fixed support is used for fixing lighting apparatus and direct current generator, and direct current generator drives with motor
Equipment connects, for adjusting the illumination direction of lighting apparatus under the driving of motor drive signal, and
Illumination enabling signal is sent after having adjusted；
Lighting apparatus, is fixed on equipment fixed support, is connected with direct current generator, open including illumination
Closing and lighting source, light switch is connected with direct current generator and lighting source respectively, for receiving
Automatically open up to start the illumination of lighting source after illumination enabling signal；
CMOS sensing equipment, is arranged on middle position, movie theatre roof, for movie theatre curtain opposite
Auditorium carries out IMAQ with output auditorium image；
Data splitting equipment, is positioned at high in the clouds, is connected with CMOS sensing equipment, for by auditorium figure
As being divided into N number of image block, N is the natural number more than 1；
N number of high in the clouds storage device, is positioned at high in the clouds, is connected with data splitting equipment, for storing respectively
N number of image block；
Cloud service central apparatus, is positioned at high in the clouds, is connected with N number of high in the clouds storage device, is used for concentrating
N number of image block, and N number of image block is distributed to M high in the clouds application apparatus, M is more than 1
Natural number and M less than or equal to N；
Command channel, high in the clouds management equipment, is positioned at high in the clouds, for high in the clouds order is carried out channel management；
M high in the clouds application apparatus, is positioned at high in the clouds, is connected with cloud service central apparatus, is used for receiving
Image block that be assigned to, more than one, each high in the clouds application apparatus includes:
Gray processing process subset, including channel parameters extraction unit, weighted value memory cell and
Gray value computing unit, channel parameters extraction unit is used for receiving each image block, and extraction is published picture
As the R passage pixel value of each pixel, G passage pixel value and channel B pixel value in piecemeal,
Weighted value memory cell is used for having prestored R channel weighting value, G channel weighting value and channel B and adds
Weights, gray value computing unit is connected with channel parameters extraction unit and weighted value memory cell respectively,
For each pixel in image block, by the product of R passage pixel value and R channel weighting value,
The product of G passage pixel value and G channel weighting value and channel B pixel value and channel B weighted value
Product addition with obtain for the gray value of pixel, and based on each pixel in image block
Gray value obtain gray level image corresponding to image block；Wherein, R channel weighting value value is
0.298839, G channel weighting value value is 0.586811, and channel B weighted value value is 0.114350；
Histogram distribution detection subset, processes subset with gray processing and is connected, be used for receiving ash
Degreeization image, and gray level image is carried out grey level histogram process to obtain corresponding histogram figure
Picture, when histogram image presents bimodal distribution, sends global threshold and selects signal, otherwise, send
Non-global threshold selects signal；
Threshold value selects subset, is connected with histogram distribution detection equipment, for receiving entirely
When office's threshold value selects signal, global threshold 128 is exported as threshold data, is receiving the non-overall situation
When threshold value selects signal, neighbor pixel gray difference threshold 40 is exported as threshold data；
Binary conversion treatment subset, selects subset and histogram distribution detection respectively with threshold value
Equipment connects, for when receiving global threshold and selecting signal, and each in gray level image
Individual pixel, when gray value more than or equal to threshold data time, by for pixel be set to white level
Pixel, when gray value less than threshold data time, by for pixel be set to black level pixel,
And the binary image that output gray level image is corresponding；Binary conversion treatment subset is additionally operable to receiving
When non-global threshold selects signal, for each pixel in gray level image, calculate Vertical Square
To upwards apart from the gray value of pixel of its 3 pixels as upper grey scale pixel value, calculate vertical
Direction downwards apart from the gray value of pixel of its 3 pixels as lower grey scale pixel value, calculate water
Square to the left apart from the gray value of pixel of its 3 pixels as left grey scale pixel value, calculate
Horizontal direction to the right apart from the gray value of pixel of its 3 pixels as right grey scale pixel value, when
The absolute value of the difference of upper grey scale pixel value and lower grey scale pixel value is less than or equal to threshold data and left pixel
The absolute value of the difference of gray value and right grey scale pixel value less than or equal to threshold data time, by for pixel
Point is set to white level pixel, when the absolute value of upper grey scale pixel value and the difference of lower grey scale pixel value is big
Absolute value in threshold data or the difference of left grey scale pixel value and right grey scale pixel value is more than threshold data
Time, by for pixel be set to black level pixel, and the two-value that output gray level image is corresponding
Change image；
Picture smooth treatment subset, is connected with binary conversion treatment subset, is used for receiving two-value
Change image, for each pixel in binary image, when adjacent all pixels exist
During more than half trip point, then by for the gray value of pixel retain, otherwise, by for
The gray value of pixel is set to white level pixel, and exports the smooth figure that binary image is corresponding
Picture；
Medium filtering subset, processes subset with image balance and is connected, and is used for receiving smooth figure
Picture, is analyzed determining each noise profile region to the gray value of the pixel of smoothed image
Distribution radius, the maximum in distribution radius based on each noise profile region determines and carries out intermediate value filter
The filtered pixel block size of ripple, uses the filtered pixel block size determined that smoothed image is carried out intermediate value filter
Ripple processes to obtain filtering image；
Data merge equipment, are positioned at high in the clouds, are connected with M high in the clouds application apparatus, for by each
The filtering image of the medium filtering subset output of high in the clouds application apparatus carries out splicing to obtain filtering whole
Close image；
Human face region extraction equipment, the Background control being arranged on movie theatre is indoor, merges equipment with data even
Connect to obtain filtering integral image, filtering integral image is carried out with the facial contour pattern prestored
Mate with detection and be partitioned into each face subgraph in filtering integral image, for each face
Subgraph, for its position in filtering integral image determine for seat corresponding to face subgraph
Bit number；Wherein, for sight corresponding to seat numbered face subgraph corresponding to face subgraph
The movie seat numbering at many places；
Wherein, the determination mode that the real-time face brightness of face subgraph and real time environment brightness deviate from is such as
Under: when the real-time face brightness of face subgraph is more than real time environment brightness, determine face subgraph
Real-time face brightness deviate from real time environment brightness, when the real-time face brightness of face subgraph is less than
During equal to real time environment brightness, determine that the real-time face brightness of face subgraph is non-with real time environment brightness
Deviate from.
3. as claimed in claim 2 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that, also include:
Compact Flash, is used for prestoring R channel weighting value, G channel weighting value and channel B and adds
Weights, are additionally operable to store predetermined time period threshold value.
4. as claimed in claim 3 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that:
The Background control that Compact Flash is arranged on movie theatre is indoor.
5. as claimed in claim 3 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that:
Compact Flash is additionally operable to prestore facial contour pattern.
6. as claimed in claim 3 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that:
Compact Flash and Freescale MC9S12 chip are integrated on one piece of surface-mounted integrated circuit.
7. as claimed in claim 2 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that:
The gray value of black level pixel is 0.
8. as claimed in claim 2 based on Internet of Things and the Intelligent building integrated system of cloud computing,
It is characterized in that:
The gray value of white level pixel is 255.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610778017.9A CN107545227A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system based on Internet of Things and cloud computing |
| CN201610478007.3A CN105868749A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system on basis of cloud computing and internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610478007.3A CN105868749A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system on basis of cloud computing and internet of things |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610778017.9A Division CN107545227A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system based on Internet of Things and cloud computing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105868749A true CN105868749A (en) | 2016-08-17 |
Family
ID=56655285
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610778017.9A Withdrawn CN107545227A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system based on Internet of Things and cloud computing |
| CN201610478007.3A Withdrawn CN105868749A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system on basis of cloud computing and internet of things |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610778017.9A Withdrawn CN107545227A (en) | 2016-06-27 | 2016-06-27 | Intelligent building integrated system based on Internet of Things and cloud computing |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN107545227A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106961771A (en) * | 2016-08-31 | 2017-07-18 | 梁云 | Intelligent city power lighting management system for internet of things |
| CN108837520A (en) * | 2018-06-29 | 2018-11-20 | 许兰兰 | Bungee jumping rope body discharges drive system |
| CN108960121A (en) * | 2018-06-28 | 2018-12-07 | 王忠亮 | Channel control platform based on face recognition |
| CN109701203A (en) * | 2018-07-29 | 2019-05-03 | 张亮 | Adult detection platform based on cloud processing |
| CN110772803A (en) * | 2018-07-29 | 2020-02-11 | 张亮 | Adult detection method based on cloud processing |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109036534B (en) * | 2018-07-27 | 2019-07-19 | 青岛大学附属医院 | Pharmacy dispensing instant alerts system |
| CN109309797B (en) * | 2018-08-08 | 2019-07-09 | 乐清市川嘉电气科技有限公司 | Light variable quantity judges system immediately |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120002849A1 (en) * | 2007-02-16 | 2012-01-05 | Sony Corporation | Image-processing device and image-processing method, image-pickup device, and computer program |
| US20130083207A1 (en) * | 2000-11-06 | 2013-04-04 | Nant Holdings Ip, Llc | Object Information Derived from Object Images |
| CN103824058A (en) * | 2014-02-26 | 2014-05-28 | 杨勇 | Face recognition system and method based on locally distributed linear embedding algorithm |
| CN104732413A (en) * | 2013-12-20 | 2015-06-24 | 中国科学院声学研究所 | Intelligent individuation video advertisement pushing method and system |
| CN104915656A (en) * | 2015-06-12 | 2015-09-16 | 东北大学 | Quick human face recognition method based on binocular vision measurement technology |
| CN105069448A (en) * | 2015-09-29 | 2015-11-18 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and device |
| CN105629654A (en) * | 2016-03-10 | 2016-06-01 | 宁波新文三维股份有限公司 | Augmented reality-based novel dream theater |
-
2016
- 2016-06-27 CN CN201610778017.9A patent/CN107545227A/en not_active Withdrawn
- 2016-06-27 CN CN201610478007.3A patent/CN105868749A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130083207A1 (en) * | 2000-11-06 | 2013-04-04 | Nant Holdings Ip, Llc | Object Information Derived from Object Images |
| US20120002849A1 (en) * | 2007-02-16 | 2012-01-05 | Sony Corporation | Image-processing device and image-processing method, image-pickup device, and computer program |
| CN104732413A (en) * | 2013-12-20 | 2015-06-24 | 中国科学院声学研究所 | Intelligent individuation video advertisement pushing method and system |
| CN103824058A (en) * | 2014-02-26 | 2014-05-28 | 杨勇 | Face recognition system and method based on locally distributed linear embedding algorithm |
| CN104915656A (en) * | 2015-06-12 | 2015-09-16 | 东北大学 | Quick human face recognition method based on binocular vision measurement technology |
| CN105069448A (en) * | 2015-09-29 | 2015-11-18 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and device |
| CN105629654A (en) * | 2016-03-10 | 2016-06-01 | 宁波新文三维股份有限公司 | Augmented reality-based novel dream theater |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106961771A (en) * | 2016-08-31 | 2017-07-18 | 梁云 | Intelligent city power lighting management system for internet of things |
| CN106961771B (en) * | 2016-08-31 | 2017-12-05 | 南京师范大学 | Intelligent city power lighting management system for internet of things |
| CN108960121A (en) * | 2018-06-28 | 2018-12-07 | 王忠亮 | Channel control platform based on face recognition |
| CN108960121B (en) * | 2018-06-28 | 2019-05-21 | 南京成君电子科技有限公司 | Channel control platform based on face recognition |
| CN108837520A (en) * | 2018-06-29 | 2018-11-20 | 许兰兰 | Bungee jumping rope body discharges drive system |
| CN109701203A (en) * | 2018-07-29 | 2019-05-03 | 张亮 | Adult detection platform based on cloud processing |
| CN110772803A (en) * | 2018-07-29 | 2020-02-11 | 张亮 | Adult detection method based on cloud processing |
| CN109701203B (en) * | 2018-07-29 | 2020-09-15 | 安徽省徽腾智能交通科技有限公司泗县分公司 | Adult detection platform based on cloud processing |
| CN110772803B (en) * | 2018-07-29 | 2021-01-29 | 南师大科技园栖霞管理(南京)有限公司 | Adult detection method based on cloud processing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107545227A (en) | 2018-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105868749A (en) | Intelligent building integrated system on basis of cloud computing and internet of things | |
| US10009549B2 (en) | Imaging providing ratio pixel intensity | |
| US7645975B2 (en) | Spatial information detecting device | |
| CN105898246A (en) | Smart home system | |
| CN107770521B (en) | Camera shooting mode method of adjustment | |
| CN105868748A (en) | Data service platform on basis of cloud processing | |
| CN106162076A (en) | Big data image gray processing processing means | |
| CN105868747B (en) | Cloud computing system | |
| CN107547839A (en) | Remote control table based on graphical analysis | |
| CN105933676A (en) | Remote control platform based on image analysis | |
| CN105872115B (en) | A kind of remote supervision system based on cloud computing | |
| CN106096665A (en) | Dual pathways cloud data management platform | |
| CN107545212A (en) | Binary channels cloud data management platform | |
| CN105905727A (en) | Multifunctional elevator safety control method | |
| CN106199133A (en) | Current sample processing platform | |
| CN106998442A (en) | Intelligent domestic system | |
| CN107257449B (en) | A kind of remote supervision system based on cloud computing | |
| CN106096578A (en) | Multifunctional lift safety control platform | |
| CN107547840A (en) | Intelligent building integrated system based on Internet of Things and cloud computing | |
| CN108076284A (en) | Camera shooting mode adjusts system | |
| KR101397222B1 (en) | Solar tracking method, solar tracking system and solar power generation system including the same | |
| CN106128007A (en) | Intelligent compact shelf controls guard system | |
| CN106060472A (en) | Intelligent device cloud platform management system | |
| CN107545558A (en) | Alternating current voltage samples conditioning system | |
| CN107547830B (en) | Cloud computing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20160817 |