CN105354822A - Intelligent apparatus for automatically identifying position of read-write element in read-write scene and application - Google Patents
Intelligent apparatus for automatically identifying position of read-write element in read-write scene and application Download PDFInfo
- Publication number
- CN105354822A CN105354822A CN201510641016.5A CN201510641016A CN105354822A CN 105354822 A CN105354822 A CN 105354822A CN 201510641016 A CN201510641016 A CN 201510641016A CN 105354822 A CN105354822 A CN 105354822A
- Authority
- CN
- China
- Prior art keywords
- read
- write
- intelligent apparatus
- dimensional coordinate
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/08—Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
Abstract
Provided are an intelligent apparatus for automatically identifying a position of a read-write element in a read-write scene and application. The intelligent apparatus can automatically and accurately determine whether a read-write posture of a teenager is correct or not in a state of non-contact with the body of the teenager in a teenager read-write scene. The intelligent apparatus is formed by at least one two-dimensional image sensor, a microprocessor connected to the two-dimensional image sensor, an alarm module and a power supply module. The intelligent apparatus is capable of effectively acquiring a posture and an attitude of the teenager in the reading and writing process and prompting an incorrect posture or attitude. The intelligent apparatus has the following advantages: 1) the intelligent device adopts a non-contact structure, and does not need to be worn on the body, without a body load generated; 2) the intelligent apparatus can accurately measure a distance from human eyes to a book; 3) the intelligent apparatus can be mounted within a range of 1 to 3 meters in front of a read-write person, has a large measurement range and does not need to be calibrated; and 4) an algorithm has a function of carrying out tracking measurement on the basis of human face three-dimensional coordinates, and unintentional shakes of the head and shoulders in the reading and writing process will not influence measurement accuracy.
Description
Technical field
The present invention relates to a kind of alarm set whether correct set during teenager's reading and writing being carried out to automatic decision, particularly a kind of two-dimensional image information gathered by two-dimensional image sensor carries out the prior-warning device of Intelligent Recognition to teenager's read-write posture.
Background technology
The existing A nearsighted person of China, more than 300,000,000 people, accounts for 33% of world's myopia number, far away higher than the ratio of world average 22%.China there will be low visual acuity 1,350,000 every year, namely about per minutely just there will be three low visual acuity patients.If do not taken effective measures, will be current 4 times to the year two thousand twenty China number with visual disabilities.The cost of the annual inpairment of vision in the whole world is up to 25,000,000,000 dollars.In sum, inpairment of vision has become the serious public health problem in China and even the whole world.China pupil of 8 ~ 12 years old myopia incidence of disease is about 23%, and middle school student are about 55%, and university student is about 76%, and national myopia is about 300,000,000 people, and wherein teenager is about 200,000,000 people.Occupy first place in the world in myopia number of the infected position, the whole nation.
The Crack cause of juvenile shortsightedness comprises congenital heredity and acquired environment factor.The former accounts for 20%, and the latter accounts for 80%.Teenager is in vigorous period of growing, and physiological function and the institutional framework of eye have the feature different from other periods, are subject to environment harmful effect and form myopia.Incorrect reading, posture of doing the homework cause the major reason of adolescent myopia.
In prior art, people find out multiple method, and make teenager when reading a book or writing, its eyes maintain a certain distance apart from books, and these methods comprise mechanical means, electronic method etc.
Usually, mechanical means is at the head of people or shoulder, wears complicated mechanical part, and it needs and direct physical contact, increases the physical load of wearer, is restricted thus (mainly wearer does not like using).
Electronic method be with ultrasound wave or infrared ray as test media, aimed at the Head And Face of people, or ultrasound wave or infrared tester be worn on head or ear, and survey sensor is aimed at books.These two kinds of methods, sensing station all needs prior calibration when mounted, its can only survey sensor to the single-point distance of head (or sensor is to books), and carry out geometry reckoning, estimate the distance of head to books.Accurately can not measure the distance of human eye to books.Due to based on spot measurement, so measuring accuracy can reduce with the shake of head in read-write process.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind ofly to be read and write in scene with teenager's health without under any state contacted teenager, automatically, accurately judges that intelligent apparatus and the application of reading and writing element position in scene are read and write in the automatic identification of teenager's read-write posture correctness.
In order to solve the problems of the technologies described above, the technical solution used in the present invention is:
Read and write the intelligent apparatus of element position in automatic identification read-write scene of the present invention, it is made up of at least one two-dimensional image sensor, the microprocessor, alarm module and the power module that are connected with this two-dimensional image sensor, wherein,
Two-dimensional image sensor, by obtain with diverse location or visual angle at least two width teenagers read and write scene comprise read-write people looks appearance, read-write books and/or rely on the desktop of these books to send described microprocessor at interior two-dimentional original image for read-write element;
Microprocessor, for the described original image obtained, adopts solid matching method to obtain the depth image corresponding with at least one width original image and obtain arbitrary target in described read-write element and reads and writes the three-dimensional coordinate of element; Store the image information of described imageing sensor Real-time Collection; Dynamic distance in the described read-write element of real-time calculating between the three-dimensional coordinate of target read-write element and the two objects read-write element with relevance or dynamic float preserving;
Alarm module, sends alerting signal when certain read-write in scene reads and writes the three-dimensional coordinate of element or described dynamic distance departs from the normal value of setting;
Power module, for imageing sensor, microprocessor and alarm module provide operating voltage.
Described imageing sensor is two black and white or color image sensor.
The three-dimensional coordinate of described read-write element comprises in read-write scene the three-dimensional coordinate of the books under reading and writing people's eyes and being placed in read-write state, and described dynamic distance is dynamically followed the tracks of by described microprocessor and automatically read the air line distance of read-write people eyes to described books.
The three-dimensional coordinate of described read-write element comprises the three-dimensional coordinate of standard figure corresponding when read-write people is in standard read/write state, and described dynamic distance is dynamically followed the tracks of by described microprocessor and obtain the corresponding three-dimensional coordinate of dynamic figure and the three-dimensional coordinate deviation value of described standard figure when reading and writing people's dynamic read/write posture.
The three-dimensional coordinate of described read-write element comprises the three-dimensional coordinate of standard figure corresponding when read-write people is in standard read/write state, described dynamic float be dynamically followed the tracks of by microprocessor and obtains read and write people be in this standard figure under continuous accumulated time.
Described alarm module also comprises the brightness of read-write scene ambient light line and reports to the police and WIFI communication connection module.
Myopia-proof intelligent desk lamp of the present invention, comprises light source, lamp stand and lamp socket, and lamp stand or lamp socket are provided with the intelligent apparatus reading and writing element position in a described automatic identification read-write scene of the present invention.
Myopia prevention Intelligent flat of the present invention, comprise touch liquid crystal display and central processing unit, also be provided with the intelligent apparatus reading and writing element position in a described automatic identification read-write scene of the present invention thereon, described central processing unit is the microprocessor in this intelligent apparatus.
Intelligent apparatus of the present invention is made up of at least one two-dimensional image sensor, the microprocessor, alarm module and the power module that are connected with this two-dimensional image sensor.It is by adopting cost lower and the simple two-dimensional image sensor of structure, with diverse location or visual angle obtain two width teenagers read and write in scene relate to read-write element (this read-write element can contain read and write to teenager in this read-write scene time relevant physical points, as teen-age body posture, Head And Face state, the books of read-write, rely on the desktop of these books, bright and dark light degree etc.) at interior original image, again by original image information stored in microprocessor, by microprocessor based on this imageing sensor calibrating parameters, solid matching method is adopted to obtain the depth image corresponding with original image, afterwards, obtain the three-dimensional coordinate of arbitrary target read-write element in read-write element.By the calculating of microprocessor, the present invention, by rationally arranging the frequency of image information collecting, accurately can to know in this read-write scene that distance under static between any two read-write elements or current intelligence and a certain read-write element are in time length that a kind of state maintains and judge that whether a certain read-write element status is normal.The present invention is simple, quick, accurate, and cost of investment is lower.
Figure when device of the present invention effectively can obtain teenager's reading and writing and posture are also pointed out incorrect figure or posture.This device also tool has the following advantages: 1) contactless, without the need to wearing, without body burden.2) distance of human eye to books can accurately be measured, measuring error <1cm.3) measurement mechanism can be arranged on read-write 1 ~ 3 meter, people front scope, and measurement range is large, and without the need to calibration.4) algorithm has and carries out tracking measurement based on face three-dimensional coordinate, and the head in read-write and shoulder shake unintentionally, can not affect measuring accuracy.5) image and corresponding measurement result can be preserved in the mode of image, to the prevention of myopia, there is positive effect.
Accompanying drawing explanation
Fig. 1 is the block diagram of apparatus of the present invention.
Fig. 2 is Image Acquisition schematic diagram.
Fig. 3 is Head And Face three-dimensional localization process flow diagram.
Fig. 4 is the three-dimensional coordinate positioning flow figure of read-write element.
Embodiment
As shown in Figure 1, in automatic identification read-write scene of the present invention, read and write the intelligent apparatus of element position, be made up of at least one two-dimensional image sensor, the microprocessor, alarm module and the power module that are connected with this two-dimensional image sensor, wherein,
Two-dimensional image sensor, by obtain with diverse location or visual angle at least two width teenagers read and write scene comprise read-write people looks appearance, read-write books and/or rely on the desktop of these books to send described microprocessor at interior two-dimentional original image for read-write element.
Microprocessor, for the described original image obtained, adopts solid matching method to obtain the depth image corresponding with at least one width original image and obtain arbitrary target in described read-write element and reads and writes the three-dimensional coordinate of element; Store the image information of described imageing sensor Real-time Collection; Dynamic distance in the described read-write element of real-time calculating between the three-dimensional coordinate of target read-write element and the two objects read-write element with relevance or dynamic float preserving.
Alarm module, sends alerting signal when certain read-write in scene reads and writes the three-dimensional coordinate of element or described dynamic distance departs from the normal value of setting.Described alarm module also comprises the brightness of read-write scene ambient light line and reports to the police and WIFI communication connection module.
Power module, for imageing sensor, microprocessor and alarm module provide operating voltage.
Device of the present invention is arranged on desk lamp, a myopia-proof intelligent desk lamp can be formed, because its two-dimensional image sensor used, microprocessor and other module body are long-pending all little, therefore whole device volume is little lightweight, it arbitrarily can be installed on the lamp stand of desk lamp, lamp socket or lampshade.
Device of the present invention is arranged on panel computer, a myopia prevention Intelligent flat can be formed.In the case, intelligent apparatus of the present invention can share a central processing unit with panel computer.
Intelligent apparatus of the present invention can identify to the locus reading and writing element in read-write scene the method that main employing is following automatically:
It adopts, structure simple two-dimensional image sensor lower by cost, obtain the original image information in the read-write scene at place when teenager's (also people is write in read) reads, afterwards again by this information stored in computing machine (comprise computer, Embedded microprocessor or the central processing unit such as single-chip microcomputer containing CPU, lower with).By obtaining the depth image corresponding with original image to imageing sensor calibration for cameras parameter, Stereo matching, then obtain described read-write scene comprise read-write people looks appearance, the books of read-write, arbitrary physical points relevant when relying on the desktop etc. of these books to read and write to teenager (described in read-write element, to these read-write elements in specify certain read-write element read and write element referred to as target, lower with) three-dimensional coordinate.
The method can make computing machine automatically accurately identify, and the spatial relation in obtained two-dimentional original image information between each read-write element, the changing value between the target read-write real-time three-dimensional state of element and the standard three-dimensional state of this read-write element of setting and target read and write time continued when element is in a kind of three-dimensional state etc.
Pass through Programming, method of the present invention is applied in the relevant apparatus of prevention adolescent myopia, by the two-dimensional image sensor be arranged in this device just can know easily be in teen-age read-write posture in read-write scene whether normal, its eyes distance books distance how and the information such as whether time of continuing of read-write long, then send information by warning piece.
Described method is specific as follows:
Adopt the two-dimensional image sensor be connected with computing machine, obtain at least two width teenagers with diverse location or visual angle and read and write scene original image, be respectively the first width original image and the second width original image, again by computer based in this imageing sensor calibrating parameters, adopt solid matching method to obtain and at least one corresponding depth image in two width original images.
Two-dimensional image sensor can be the imageing sensor of a black and white or colour, also can be the imageing sensor of two black and white or colour, and its method obtaining depth image is described below:
1, a black and white or color image sensor
1) geometric position or the focal length of this imageing sensor is set, according to the camera parameter of the demarcation thing uncalibrated image sensor determined.
The concept of camera calibration is as follows:
In image measurement process and machine vision applications, for determining three-dimensional geometry position and its mutual relationship in the picture between corresponding point of certain point of space object surface, must set up the geometric model of camera imaging, these geometric model parameters are exactly camera parameter.These parameters must just can obtain with calculating by experiment in most conditions, and this process solving parameter is just referred to as camera calibration (or camera calibration).
The present invention adopts following steps to carry out camera calibration:
A. grid cardboard is set as demarcating thing, the focal length of setting imageing sensor and other optical parametrics.
If b. only adopt an imageing sensor, moving image transmitting sensor is then needed repeatedly to take (according to two imageing sensors, two sensors can be fixed on different geometric positions and take simultaneously) demarcation thing from different geometric position, angle.
C. based on the image sequence of shooting, utilize geometrical-restriction relation to adopt corners Matching calibration algorithm, ask for the inside and outside parameter matrix of this imageing sensor, be stored as calibrating parameters.
2) imaging is carried out to the scene comprising described target read-write element place, obtain the first width original image and preserve;
3) change geometric position or the focal length of sensor, again imaging is carried out to the scene comprising described target read-write element place, obtains with the second width original image of the first width original image poling geometrical-restriction relation and preserve;
4) solid matching method of local (local), the partly overall situation (Semi-global) or the overall situation (global) is adopted to obtain disparity map and be converted to depth image.
In order to improve counting yield, by adopting the sectional perspective matching process of blockmatching obtain disparity map and be converted to depth image in this example.
2, two black and white or color image sensor
1) by two imageing sensors with left and right azimuth distribution, according to the camera parameter (scaling method is the same) of the demarcation thing uncalibrated image sensor determined.
2) use two imageing sensors to carry out imaging to the scene comprising target read-write element place respectively, obtain left-hand image and dextrad image and preserve, described left-hand image and dextrad image poling geometrical-restriction relation.
3) solid matching method of local (local), the partly overall situation (Semi-global) or the overall situation (global) is adopted to obtain disparity map and be converted to depth image.
Equally, in order to improve counting yield, also by adopting the sectional perspective matching process of blockmatching obtain disparity map and be converted to depth image in this example.
The three-dimensional coordinate of described target read-write element can obtain according to the following steps:
1) by setting space initial point and boundary definition 3-D scanning body, this sweep volume is the cuboid in z-direction with setting thickness;
2) in z-direction, sweep volume is divided at equal intervals the different sub-sweep volume of size same position;
3) based on described original image and depth image, the some cloud density of all sub-sweep volumes is asked for;
4) described sub-sweep volume is successively scanned along Z-direction (from large value to little value or reverse), when the some cloud density of certain the sub-sweep volume scanned reaches the setting threshold value of target read-write element, then judge the locus of the center of current sub-sweep volume as this target read-write element.
The preferred described space origins of method of the present invention is the face central point of read-write human face profile, adopts described sweep volume successively to scan and assert in read-write scene to take books as the three-dimensional coordinate that target reads and writes element below this space origins in 0cm-80cm.0cm-80cm refers to that identification people is when normal read-write state, and the vertical range of usually placing between books on the table and its chin drops within the scope of this.
The present invention is by obtaining to read and write the three-dimensional coordinate that mouth bar central point is space origins with under type:
1) adopt the recognition methods of haar characteristic sum adaboost sorter pattern, in original image, locate the two-dimensional coordinate of human face's profile.
2) in the 2 dimensional region of face, the adaboost detection of classifier face for face object is adopted.Detectability fixes on human face region, improves reliability.
3) based on the corresponding relation of depth image and original image, face contour is obtained, the three-dimensional coordinate of face and central point thereof.
Described method has following three kinds of application at least:
1, the distance between the eyes of reading and writing people in read-write scene to books is automatically measured
By arranging the frequency of image acquisition, by method Real-time Obtaining read-write people's eyes of the present invention and the three-dimensional coordinate being placed in the books under read-write state, first automatically read the air line distance of read-write people eyes to described books by computing machine, again by this real time data with in advance stored in compared with gauged distance corresponding to the correct read-write state in computing machine, just can know whether this read-write people is in correct read-write state (certainly in actual applications, also should consider the time value giving to allow when this read-write people is in incorrect read-write state to continue).
2, automatically measure read-write people and read and write attitude
Namely when reading and writing people when reading and writing, whether its figure is correct.Incorrect figure has: slanting head reading, turn round body reading etc. (sometimes, under this incorrect figure state, its eyes apart from books distance but in the reasonable scope).
First feature identification point is set at the read-write face of people, head or shoulder and forms three-dimensional figure net, by arranging the frequency of image acquisition, by the three-dimensional coordinate of this three-dimensional figure net of method Real-time Obtaining of the present invention, afterwards again with prior stored in computing machine be in correct read-write state time corresponding standard figure three-dimensional coordinate compare, normal posture whether is in (the same when just can know that this read-write people reads, in actual applications, the time value giving to allow when this read-write people is in abnormal read-write posture to continue should also be considered).
3, automatically measure read-write people and read and write the attitude duration
Even if read-write people reading/writing distance, posture are all correct, but the time that reading continues is oversize, also teen-age eyesight can be damaged, therefore, apply identical with the first two, by arranging the frequency of image acquisition, be in the continuous accumulated time under standard figure, correct distance state by method Real-time Obtaining read-write people of the present invention.When exceeding setting-up time, read-write people just can be reminded suitably to have a rest.
The basic principle that the present invention relates to is as follows:
Stereoscopic vision (StereoVision) is a kind of important form of machine vision, it is based on principle of parallax and utilizes imaging device from two width images of different position acquisition testees, by the position deviation between computed image corresponding point, obtain the method for object dimensional geological information.Merge image the difference of observing between them that two eyes obtain, make us can obtain obvious depth perception, set up the corresponding relation between feature, the photosites of the same space physical points in different images is mapped, this difference, we are called parallax (Disparity) image.
Image Acquisition
Image acquisition procedures can be divided into single-sensor to obtain and dual sensor acquisition, and wherein single-sensor can obtain in shift position, and two sensors can be fixed on different geometric position and obtain.Two square ratio juris are similar, are all to gather on the diverse location or different visual angles of target object, thus obtain left and right view as shown in Figure 2.
Pole geometrical concept:
It is the technical term in machine vision in camera calibration, and at world coordinate system, view coordinate is a very important concept in the ordinate transform such as pixel coordinate system.
For binocular vision system, namely two video cameras are had, the optic center point of definition two video cameras is C1, C2, there is a scene point P (x in three dimensions, y, z), the plane that this point and two camera optics central points are formed jointly is exactly to polar plane, each video camera has a plane of delineation, be respectively the left plane of delineation and the right plane of delineation, C1, P point line and the left plane of delineation meet at p1 point, and C2, P point line and the right plane of delineation meet at p2 point, and C1, C2 line meets at e1 and e2 point respectively with the left plane of delineation and the right plane of delineation; These two points are called limit, and C1, C2 line is called baseline.Intersect at two polar curve L and R respectively to polar plane and the left plane of delineation and the right plane of delineation, the relation of these two polar curves is corresponding, and p1 and e1 point falls within L polar curve, p2 and e2 point falls within R polar curve.
Along with the movement at three dimensional field sight spot P (x, y, z), polar plane will rotate around baseline, and these polar planes form one jointly to polar plane bundle, these to polar plane and the plane of delineation the polar curve race that crosses all meet at two limit e1 and e2 respectively.
If we only know P (x, y, z) the incident point p1 on the left plane of delineation is incident upon, how we go to know the respective point p2 of p1 point on the right plane of delineation, what a kind of geometrical rule does this respective point p2 meet? we know, by baseline to polar plane, p1 and P is formed jointly, therefore, respective point p2 also one is positioned this on polar plane, namely can draw on the intersection R that p2 point is positioned at polar plane and another plane of delineation (i.e. the right plane of delineation), also namely p2 point is the image of back projection on second visual angle (i.e. the right plane of delineation) of incident point p1 point.This pass ties up to during stereoscopic correspondence is calculated very large benefit, and that is exactly the corresponding point not needing to find P (x, y, z) in entire image, and only needs scope to be limited on polar curve R.
Demarcate and disparity computation principle
The three-dimensional geometry position of body surface point and its mutual relationship in the picture between corresponding point are determined by the geometric model of video camera imaging, demarcate refer to by experiment with calculate the process obtaining these sensor parameters.In prior art, camera marking method generally comprises traditional scaling method and self-calibrating method.The present invention adopts traditional scaling method, will have the captured object of calibrated reference as sensor that oneself knows shape, size.Spatial alternation is utilized to ask for the inside and outside parameter of sensor model.Wherein, inner parameter refers to camera internal geometry, optical parametric, and external parameter refers to the conversion parameter of camera coordinates system and world coordinate system.
Here, we set B is parallax range, and camera focus is f.If two video cameras are at the same unique point P (x of synchronization viewing space object
c, y
c, z
c), on left figure and right figure, obtain the image of a P respectively, their image coordinate is respectively p
left=(X
left, Y
left), p
right=(X
right, Y
right), obtained by triangle geometric relationship:
Then parallax is: Disparity=X
left-X
right.Can calculate the three-dimensional coordinate of a P under camera coordinates system is thus:
Therefore, left camera image planes (namely described the left plane of delineation) if on any point can find the match point of correspondence in right camera image planes (the namely described right plane of delineation), just can determine the three-dimensional coordinate of this point.
Image rectification
Calculate the parallax that impact point is formed on the view of two, left and right, need to mate corresponding point on two-dimensional space.In order to reduce match search scope, we utilize epipolar-line constraint to make the coupling of corresponding point reduce to linear search by two-dimensional search.The effect of image rectification strictly carries out correspondence two width images exactly, make two width images to polar curve in the same horizontal line, on piece image, any point is corresponding with its certain point with a line in another piece image, and need carry out linear search at this row can match corresponding point.The present invention adopts epipolar line restriction hunting zone to be may be limited on EP point one very in minizone, improves search speed, reduces the quantity of false match point simultaneously.
Stereo matching
Stereo matching selects a kind of characteristics of image (as gradation of image) from the piece image of figure centering, the correspondence image feature of Same Physical structure is determined in another piece image, thus the relative position obtained between these two features, calculate parallax, and then three-dimensional coordinate can be calculated according to formula (2).According to the difference of the way of restraint, existing Stereo Matching Algorithm is roughly divided into three classes: a class is local (Local) matching algorithm, comprise the Stereo Matching Algorithm of the Stereo Matching Algorithm (blockmatching, BM) based on region, feature based; Another kind of is the overall situation (Global) optimal algorithm, matching process is seen as the process finding energy equation minimum value by this algorithm, comprise and cut method (graphcuts), belief propagation algorithm (beliefpropagation) etc. based on dynamic programming algorithm, figure, finally also have a class to be between half Global Algorithm (Semi-global) locally and between the overall situation.The design adopts BM local matching algorithm, carries out pyramid Multiresolution Decomposition simultaneously, reduce computation complexity further to the image after correction, improves real-time.The design adopts following formula as match measure.
Wherein: d
minand d
maxbe minimum and maximum disparity, m is template size, I
rightand I
leftit is the image on the right and the left side.
The three-dimensional coordinate location of people's Head And Face in read-write scene
As shown in Figure 3, the three-dimensional localization reading and writing people's Head And Face has two class methods.1) face can be detected from original image, obtain the two-dimensional coordinate of Head And Face, then based on depth image, after finding corresponding z coordinate, thus Head And Face is mapped to three dimensions.2) directly in three dimensions, based on faceform locating human face such as 3DAAM.
The present invention, in order to improve real-time, improves first kind method.Before adaboost classification, adopt complexion model to detect alternative human face region, reduce the sensing range of adaboost, process flow diagram as shown in Figure 3.
The three-dimensional coordinate location of element (book or desktop) is read and write in read-write scene
As shown in Figure 4, in read-write scene, color, the shape of read-write element (books or desktop), put there is a lot of uncertainty.Direct Land use models recognition methods identification books or desktop, its robustness can not ensure.The present invention is directed to the singularity of read-write scene, propose a kind of detection algorithm reliably:
1) the some closed three dimensions Q defined below face is the region to be detected of read-write element (book or desktop), and definition above-below direction is z direction.
2) in a z-direction, take deltaZ as interval, space Q is divided into three different n-dimensional subspace ns of n size same position Q1, Q2 ... Qn}.
3) based on original image and depth image, ask for three n-dimensional subspace ns Q1, Q2 ... the point cloud density of Qn}.
4) above-mentioned subspace is scanned in direction (z minimizing) from the top down, when the some cloud density of described subspace reaches the setting threshold value of target read-write element, then judges the position of the center of current subspace as this target read-write element.
Robustness annotates:
Robust is the transliteration of Robust, the namely healthy and strong and strong meaning.It is the key of system survival under exception and dangerous situation.Such as can not computer software, in input error, disk failure, network over loading or intentional attack situation, crash, not collapse, it is exactly the robustness of this software.So-called " robustness ", refers to that control system is under the Parameter Perturbation of certain (structure, size), maintains the characteristic of some other performance.
Claims (8)
1. automatically identify the intelligent apparatus reading and writing element position in read-write scene, it is characterized in that: it is made up of at least one two-dimensional image sensor, the microprocessor, alarm module and the power module that are connected with this two-dimensional image sensor, wherein,
Two-dimensional image sensor, by obtain with diverse location or visual angle at least two width teenagers read and write scene comprise read-write people looks appearance, read-write books and/or rely on the desktop of these books to send described microprocessor at interior two-dimentional original image for read-write element;
Microprocessor, for the described original image obtained, adopts solid matching method to obtain the depth image corresponding with at least one width original image and obtain arbitrary target in described read-write element and reads and writes the three-dimensional coordinate of element; Store the image information of described imageing sensor Real-time Collection; Dynamic distance in the described read-write element of real-time calculating between the three-dimensional coordinate of target read-write element and the two objects read-write element with relevance or dynamic float preserving;
Alarm module, sends alerting signal when certain read-write in scene reads and writes the three-dimensional coordinate of element or described dynamic distance departs from the normal value of setting;
Power module, for imageing sensor, microprocessor and alarm module provide operating voltage.
2. read and write the intelligent apparatus of element position in automatic identification read-write scene according to claim 1, it is characterized in that: described imageing sensor is two black and white or color image sensor.
3. in automatic identification read-write scene according to claim 1 and 2, read and write the intelligent apparatus of element position, it is characterized in that: the three-dimensional coordinate of described read-write element comprises in read-write scene the three-dimensional coordinate of the books under reading and writing people's eyes and being placed in read-write state, described dynamic distance is dynamically followed the tracks of by described microprocessor and automatically read the air line distance of read-write people eyes to described books.
4. in automatic identification read-write scene according to claim 1 and 2, read and write the intelligent apparatus of element position, it is characterized in that: the three-dimensional coordinate of described read-write element comprises the three-dimensional coordinate of standard figure corresponding when read-write people is in standard read/write state, and described dynamic distance is dynamically followed the tracks of by described microprocessor and obtain the corresponding three-dimensional coordinate of dynamic figure and the three-dimensional coordinate deviation value of described standard figure when reading and writing people's dynamic read/write posture.
5. in automatic identification read-write scene according to claim 1 and 2, read and write the intelligent apparatus of element position, it is characterized in that: the three-dimensional coordinate of described read-write element comprises the three-dimensional coordinate of standard figure corresponding when read-write people is in standard read/write state, described dynamic float be dynamically followed the tracks of by microprocessor and obtains read and write people be in this standard figure under continuous accumulated time.
6. read and write the intelligent apparatus of element position in automatic identification read-write scene according to claim 1 and 2, it is characterized in that: described alarm module also comprises the brightness of read-write scene ambient light line and reports to the police and WIFI communication connection module.
7. a myopia-proof intelligent desk lamp, comprises light source, lamp stand and lamp socket, it is characterized in that: on lamp stand or lamp socket, be provided with the intelligent apparatus reading and writing element position in an automatic identification read-write scene according to any one of claim 1-6.
8. a myopia prevention Intelligent flat, comprise touch liquid crystal display and central processing unit, it is characterized in that: be also provided with the intelligent apparatus reading and writing element position in an automatic identification read-write scene according to any one of claim 1-6 thereon, described central processing unit is the microprocessor in this intelligent apparatus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510641016.5A CN105354822B (en) | 2015-09-30 | 2015-09-30 | The intelligent apparatus of read-write element position and application in automatic identification read-write scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510641016.5A CN105354822B (en) | 2015-09-30 | 2015-09-30 | The intelligent apparatus of read-write element position and application in automatic identification read-write scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105354822A true CN105354822A (en) | 2016-02-24 |
| CN105354822B CN105354822B (en) | 2018-06-22 |
Family
ID=55330789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510641016.5A Active CN105354822B (en) | 2015-09-30 | 2015-09-30 | The intelligent apparatus of read-write element position and application in automatic identification read-write scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105354822B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108597264A (en) * | 2017-12-28 | 2018-09-28 | 福州市鼓楼区智搜信息科技有限公司 | A kind of tutoring system and its implementation tracing review |
| CN109523755A (en) * | 2018-12-17 | 2019-03-26 | 石家庄爱赛科技有限公司 | Stereoscopic vision sitting posture reminder and based reminding method |
| CN110046552A (en) * | 2019-03-21 | 2019-07-23 | 南京华捷艾米软件科技有限公司 | Protect the method for user's eyesight and the device of protection user's eyesight |
| CN110290349A (en) * | 2019-06-17 | 2019-09-27 | 苏州佳世达电通有限公司 | The method of the sitting posture state of lamps and lanterns and detecting user |
| CN110298284A (en) * | 2019-06-24 | 2019-10-01 | 火石信科(广州)科技有限公司 | A kind of recognition methods for reading and writing scene and read and write position |
| CN110309751A (en) * | 2019-06-24 | 2019-10-08 | 火石信科(广州)科技有限公司 | A kind of recognition methods for reading and writing scene read-write posture |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2767340B2 (en) * | 1991-12-26 | 1998-06-18 | ファナック株式会社 | 3D position / posture measurement method for objects |
| JP2004030011A (en) * | 2002-06-24 | 2004-01-29 | Seiichi Uchinami | Three-dimensional form data acquisition system and method |
| CN101308018B (en) * | 2008-05-30 | 2010-09-15 | 汤一平 | Stereo vision measuring apparatus based on binocular omnidirectional visual sense sensor |
| CN101833759B (en) * | 2010-04-01 | 2012-05-30 | 复旦大学 | Robot scene depth discrimination method based on continuous videos |
| CN202362833U (en) * | 2011-12-08 | 2012-08-01 | 长安大学 | Binocular stereo vision-based three-dimensional reconstruction device of moving vehicle |
| CN102542294A (en) * | 2011-12-29 | 2012-07-04 | 河海大学常州校区 | Centralized control type soccer robot identification system and identification method for double visual information fusion |
| CN102592117B (en) * | 2011-12-30 | 2014-04-16 | 杭州士兰微电子股份有限公司 | Three-dimensional object identification method and system |
| CN103226693B (en) * | 2013-03-21 | 2016-05-25 | 浙江工业大学 | The identification of fishing for object based on full-view stereo vision and space positioning apparatus and method |
| CN104732586B (en) * | 2015-03-24 | 2016-12-14 | 中国人民解放军国防科学技术大学 | A kind of dynamic body of 3 D human body and three-dimensional motion light stream fast reconstructing method |
-
2015
- 2015-09-30 CN CN201510641016.5A patent/CN105354822B/en active Active
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108597264A (en) * | 2017-12-28 | 2018-09-28 | 福州市鼓楼区智搜信息科技有限公司 | A kind of tutoring system and its implementation tracing review |
| CN109523755A (en) * | 2018-12-17 | 2019-03-26 | 石家庄爱赛科技有限公司 | Stereoscopic vision sitting posture reminder and based reminding method |
| CN110046552A (en) * | 2019-03-21 | 2019-07-23 | 南京华捷艾米软件科技有限公司 | Protect the method for user's eyesight and the device of protection user's eyesight |
| CN110290349A (en) * | 2019-06-17 | 2019-09-27 | 苏州佳世达电通有限公司 | The method of the sitting posture state of lamps and lanterns and detecting user |
| CN110290349B (en) * | 2019-06-17 | 2022-03-08 | 苏州佳世达电通有限公司 | Lamp and method for detecting sitting posture state of user |
| US11568561B2 (en) | 2019-06-17 | 2023-01-31 | Qisda Corporation | Lamp and method for detecting a sitting posture of a user |
| CN110298284A (en) * | 2019-06-24 | 2019-10-01 | 火石信科(广州)科技有限公司 | A kind of recognition methods for reading and writing scene and read and write position |
| CN110309751A (en) * | 2019-06-24 | 2019-10-08 | 火石信科(广州)科技有限公司 | A kind of recognition methods for reading and writing scene read-write posture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105354822B (en) | 2018-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105354825B (en) | The intelligent apparatus of reading matter position and its application in automatic identification read-write scene | |
| CN105354822A (en) | Intelligent apparatus for automatically identifying position of read-write element in read-write scene and application | |
| US9265414B2 (en) | Methods and systems for measuring interpupillary distance | |
| CN106168853B (en) | A kind of free space wear-type gaze tracking system | |
| Morimoto et al. | Detecting eye position and gaze from a single camera and 2 light sources | |
| CN105335699B (en) | Read-write scene is read and write intelligent identification and the application thereof of element three-dimensional coordinate | |
| CN106022304B (en) | A kind of real-time body's sitting posture situation detection method based on binocular camera | |
| CN104173054B (en) | Measuring method and measuring device for height of human body based on binocular vision technique | |
| CN102812416B (en) | Pointing input device, indicative input method, program, recording medium and integrated circuit | |
| CN104685541B (en) | Method and apparatus for determining blinkpunkt on three dimensional object | |
| CN103557859B (en) | Image acquisition localization method and image acquisition positioning system | |
| CN109690553A (en) | The system and method for executing eye gaze tracking | |
| CN103630116B (en) | Image acquisition localization method and image acquisition locating device | |
| CN105139447A (en) | Sitting posture real-time detection method based on double cameras | |
| CN104154898B (en) | A kind of initiative range measurement method and system | |
| CN104634276A (en) | Three-dimensional measuring system, photographing device, photographing method, depth calculation method and depth calculation device | |
| JP2010259605A (en) | Visual line measuring device and visual line measuring program | |
| CN107016697B (en) | A kind of height measurement method and device | |
| CN113808160B (en) | Sight direction tracking method and device | |
| CN106214118A (en) | A kind of ocular movement based on virtual reality monitoring system | |
| US9230325B2 (en) | Three-dimensional model acquisition using planar mirrors | |
| CN105354828B (en) | Read and write intelligent identification and the application thereof of reading matter three-dimensional coordinate in scene | |
| CN106991378A (en) | Facial orientation detection method, detection means and electronic installation based on depth | |
| WO2019125700A1 (en) | System and method of obtaining fit and fabrication measurements for eyeglasses using simultaneous localization and mapping | |
| CN104952221A (en) | Intelligent table lamp with myopia prevention function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160927 Address after: 518000 Nanhai Road, Guangdong, Shenzhen, No. 3688, No. Applicant after: Shenzhen University Address before: 518000 Department of medicine, Shenzhen University, Nanhai Avenue, Guangdong, Shenzhen, 3688, China Applicant before: Li Qiaoliang |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |