CN101846503A - Luggage information on-line obtaining system based on stereoscopic vision and method thereof - Google Patents
Luggage information on-line obtaining system based on stereoscopic vision and method thereof Download PDFInfo
- Publication number
- CN101846503A CN101846503A CN 201010157526 CN201010157526A CN101846503A CN 101846503 A CN101846503 A CN 101846503A CN 201010157526 CN201010157526 CN 201010157526 CN 201010157526 A CN201010157526 A CN 201010157526A CN 101846503 A CN101846503 A CN 101846503A
- Authority
- CN
- China
- Prior art keywords
- luggage
- image
- information
- video camera
- stereo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 55
- 238000000605 extraction Methods 0.000 claims abstract description 6
- 239000004744 fabric Substances 0.000 claims description 22
- 230000008569 process Effects 0.000 claims description 19
- 238000004040 coloring Methods 0.000 claims description 18
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 239000003086 colorant Substances 0.000 claims description 3
- 230000008878 coupling Effects 0.000 claims description 3
- 238000010168 coupling process Methods 0.000 claims description 3
- 238000005859 coupling reaction Methods 0.000 claims description 3
- 238000005286 illumination Methods 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 claims description 3
- 230000007704 transition Effects 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000005693 optoelectronics Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000000700 radioactive tracer Substances 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a luggage information on-line obtaining system based on stereoscopic vision and a method thereof. An image collecting part is arranged in an image collecting work table in the system, the image collecting part obtains stereoscopic image pairs in an on-line non-contact way when the luggage passes through the image collecting work table; an image processing module is connected with the image collecting part, and is used for feature extracting and matching processing on the stereoscopic image pairs to reconstruct the three-dimensional deep information on the surface of the luggage and calculate the length, width and height dimension of the luggage; the luggage image carries out color and space conversation, the color features of the luggage are extracted and classified to obtain the color information of the luggage; and a server is connected with the image processing module and is used for receiving the dimension and color information of the luggage and the stereoscopic image pairs of the luggage and providing the inquiring service of the luggage information. The method comprises the following steps: carrying out feature extraction and feature matching on the stereoscopic image pairs of the luggage; reconstructing the three-dimensional deep information on the surface of the luggage; calculating the length, width and height dimension of the luggage; carrying out color and space conversation on the luggage images; extracting the color features; carrying out classification; and obtaining the color information of the luggage.
Description
Technical field
The invention belongs to the collection and the processing technology field of stereo-picture, relate in particular to online system and the method thereof obtained of a kind of luggage information based on stereoscopic vision.
Background technology
Along with the fast development in air passenger traffic market, countries in the world, the number of passengers that airplane commutes various places is being on the increase.Yet, being subjected to the influence of multiple uncertain factors such as airport, luggage loading and unloading, sorting equipment, peopleware even weather, the accident that undesired transportation takes place flight luggage gets more and more.
For the luggage of these undesired transportations, before 1980, countries in the world airline adopts the mode of fax (TTY) to inquire about mutually.Under the appealing and expectation of various countries airline, (the BAGGAGE TRACING SYSTEM of first generation baggage tracing BAGTRAC system appearred in 1980,1984,1989 in succession, be abbreviated as BT), first generation baggage tracing management system BAHAMAS (BAGGAGE HANDLING MANAGEMENT is abbreviated as BM) and based on the WORLDTRACER of world baggage tracing system of above-mentioned BT and BM two cover systems.Baggage tracing system WORLD TRACER in the world has made full use of modern information management mode, to adding the airline of this cover system in the world, has realized that the mechanical check of accident luggage is searched, monitoring and system management in real time.The backup of the main frame of this cover system is in the data processing centre (DPC) of U.S. Atlanta, adopts the form of the leasing use of paying dues by various countries airline.
Be subjected to factor affecting such as high expense, no Chinese function, at present China only has the part of airlines of several family such as CA, East Airways, South Airways and tall building boat to have the boat station of international transport to use this cover " global baggage tracing system ", does not also accomplish the shared fully of luggage information resource each other.
The luggage of the undesired transportation of each airline's independent processing of China, accident luggage is lacked effective communication, make that the accident rate of luggage transportation is high, luggage the rate of complaints of passenger is also soaring year by year, increase carrier's operation cost, greatly influenced carrier's prestige.Though domestic have indivedual airlines, as South Airways, externally announce that having developed a cover is used for baggage tracing, can be connected mutually with the internet, baggage tracing system with Chinese function, this airline is inner to be used but this cover system is because only limit to, and the boat station of using is few, does not also give full play of its due effect.For the luggage of undesired transportation, current domestic most of airports mainly depend on the essential information of luggage treatment people by visual method acquisition luggage, manually register luggage basic condition table.Increasing along with the undesired shipping accident of luggage, total man worker's processing mode of this repetition, poor efficiency has had a strong impact on the efficient of accident luggage office reason, has brought the hard work amount also for accident luggage treatment people.For the big country of the such air-transport industry fast development of China, the development pole of the inquiry present situation of current undesired transportation luggage and the transportation of China civil aviaton is discord.
For searching problem of fundamentally solution accident luggage, should utilize modern high technology, research and development China oneself, the cost performance height, have " the baggage tracing system " of Chinese function, luggage information interconnection with boat station, various places, and then the passenger who uses existing Lee's shipping accident, can pass through the internet, consult and transfer the information of own luggage easily.This can not only raising accident luggage seek rate, can also alleviate baggage tracing staff's burden, more convenient passenger.
How to realize the automatic statistics and the inquiry of airport accident luggage, and can keep existing airdrome luggage operating mechanism to greatest extent, become the problem that vast airport and airline show great attention to.Wherein, luggage sizes and color are the important indicator and the important evidence of accident baggage tracing, and therefore, the Information Statistics of obtaining automatically for luggage of information such as luggage sizes and color have very important significance with effective inquiry.
Utilize computer vision and image processing techniques to obtain information such as the size of luggage and color, have that cost is low, the characteristics of noncontact, online and automatic measurement, not only can be used for the measurement of airdrome luggage, also can be used for the measurement of luggage such as railway station, long-distance bus station.At present, though stereoscopic vision has obtained application in a lot of fields, also do not occurred based on the online system that obtains of the luggage information of stereoscopic vision.
Summary of the invention
The object of the present invention is to provide the online System and method for that obtains of a kind of luggage information, utilize computer vision and image processing techniques, realize low cost, noncontact, automatic, online the obtaining of luggage sizes and colouring information based on stereoscopic vision.
In order to realize purpose of the present invention, a first aspect of the present invention provides the online system that obtains of a kind of luggage information based on stereoscopic vision, the technical scheme of this system comprises: the image acquisition worktable, image acquisition portion, image processing module and server, wherein: image acquisition portion is installed in the image acquisition worktable; Image acquisition portion is online, the stereogram when luggage is obtained in noncontact through the image acquisition worktable; Image processing module is connected with image acquisition portion, image processing module carries out the processing of two aspects: the one, the stereogram that image acquisition portion obtains is carried out feature extraction and matching treatment, reconstruct the three-dimensional depth information on luggage surface, calculate the length size of luggage on this basis, be that the luggage image that image acquisition portion gathers is carried out color notation conversion space on the other hand, the color characteristic of picking up one's luggage, and color characteristic classified, the luggage colouring information obtained; Server is connected with image processing module, be responsible for to receive luggage sizes and colouring information that image processing module obtains, and the stereogram of luggage, and the inquiry service of luggage information is provided for luggage managerial personnel and passenger.
Wherein, described image acquisition portion comprises: the stereo colour video camera, lighting device, luggage detector and the luggage conveyer that are positioned at the image acquisition worktable; The stereo colour video camera is embedded on the inner top surface of image acquisition worktable, is made up of a plurality of colour TV cameras; Lighting device is installed on the inner top surface or medial surface of image acquisition worktable, and the light beam irradiates that lighting device is launched is used to the stereo colour video camera imaging that illumination is provided to luggage, so that the stereo colour video camera obtains luggage image clearly; Luggage conveyer horizontal positioned is placed luggage on it, be used for level and transport luggage; The luggage detector is installed on the medial surface of image acquisition worktable, is positioned at the position of the lower middle side of image acquisition worktable medial surface, and whether be used to detect has luggage to occur on the luggage conveyer; When the luggage detector has detected luggage, trigger the stereogram of stereo colour camera acquisition luggage.
Wherein, described stereo colour video camera, this luggage information based on stereoscopic vision is online obtain system and open after, in running order all the time; When luggage process luggage detector, the luggage detector has detected luggage and has occurred, and produces switch controlling signal; This switch controlling signal is given the stereo colour video camera, triggers the stereo colour video camera luggage image that each colour TV camera obtains is transferred to the luggage processing module; In this process, each colour TV camera is exported a width of cloth luggage image; Set up sports lottery ticket look video camera to form by N colour TV camera, the exportable altogether N width of cloth of this N colour TV camera luggage image then, this N width of cloth constitutes the stereogram of this luggage jointly about the image of same luggage; Before the work of stereo colour video camera, need earlier the stereo colour video camera to be demarcated, obtain the inside and outside parameter of stereo colour video camera, be used to calculate the three-dimensional depth information on luggage surface.
Wherein, on the described server Internet device is installed, and is connected with the Internet network.
In order to realize purpose of the present invention, a second aspect of the present invention provides a kind of online online acquisition methods of luggage information that obtains system of luggage information that utilizes, and it is as follows that the method comprising the steps of:
Step S1: the luggage conveyer is made uniform motion in the horizontal direction, and when having luggage to occur as if the luggage conveyer, luggage is along with the luggage conveyer is made horizontal uniform motion with respect to ground together; The luggage detector that is positioned at the image acquisition worktable is detecting whether the luggage process is arranged all the time, and a plurality of colour TV cameras in the stereo colour video camera are also all the time with certain frame per second images acquired simultaneously; When luggage process luggage detector, the luggage detector detects luggage and output switch control signal, this switch controlling signal triggers the stereo colour video camera and once exports and give image processing module with the luggage image of a plurality of colour TV camera collections, it is each colour TV camera output piece image, if the stereo colour video camera is made up of N colour TV camera, the image of then giving image processing module is total up to the N width of cloth, and this N width of cloth constitutes the stereogram of this luggage jointly about the image of same luggage; After the stereogram work of obtaining of luggage is finished, execution in step S2 then;
Step S2: several luggage images in the luggage stereogram that image processing module obtains the stereo colour video camera carry out feature extraction respectively, obtain the feature primitive, then the feature primitive from different images is mated, obtain corresponding feature primitive between the different images;
Step S3:, in conjunction with the inside and outside parameter of the stereo colour video camera of having demarcated, utilize the binocular stereo vision principle, the three-dimensional depth information on reconstruct luggage surface again according to the feature primitive of coupling;
Step S4: the three-dimensional depth information on luggage surface is generated a width of cloth gray level image, what the pixel coordinate of this image reflected is the position of luggage surface different parts, what the gray scale of image reflected is the depth information at the pairing luggage surface location of pixel coordinate place, the depth value of this pixel institute corresponding position of the big more expression of the gray-scale value of pixel is big more, and the more little then corresponding depth value of grey scale pixel value is more little; From the gray level image of this width of cloth reflection luggage surface three dimension depth information, be partitioned into the luggage zone, find the minimum boundary rectangle in luggage zone, thereby obtain the length and the width of luggage;
Utilize the three-dimensional depth information on luggage surface,, calculate the height of luggage again in conjunction with the elevation information of stereo colour video camera apart from the luggage conveyer; According to the length of luggage, generate the dimension information of luggage again;
Step S5: the luggage image that the stereo colour video camera is obtained carries out color notation conversion space, the luggage image transitions that former cause three primary colours (RGB) color space is represented arrives tone, saturation degree and brightness (HIS) color space, the dominant hue color characteristic of picking up one's luggage, and according to pre-set color class the color characteristic of luggage is classified, obtain the colouring information of luggage;
Step S6: image processing module is delivered to the length size and the colouring information of luggage server and is preserved, so that luggage managerial personnel and passenger's inquiry.
Wherein, described stereo colour video camera, this luggage information based on stereoscopic vision is online obtain system and open after, in running order all the time; A plurality of colour TV cameras of forming the stereo colour video camera are constantly gathered the image of luggage with certain frame per second; When luggage process luggage detector, the luggage detector has detected luggage and has occurred, and produces switch controlling signal; This switch controlling signal is given the stereo colour video camera, triggers the stereo colour video camera luggage image that each colour TV camera obtains is exported.
Wherein, the luggage image that described image processing module obtains image acquisition portion carries out the processing and the analysis of two aspects, be to utilize stereogram to come the three-dimensional depth information on reconstruct luggage surface on the one hand, and then the length size of acquisition luggage, be that the luggage image is carried out analyzing and processing on the other hand, the color characteristic of picking up one's luggage is also classified, and obtains the colouring information of luggage.
Beneficial effect of the present invention: the online System and method for that obtains of the luggage information based on stereoscopic vision of the present invention, based on computer vision, Flame Image Process and machine learning techniques, obtain the size of luggage based on principle of stereoscopic vision, adopt method simultaneously based on supervised learning, color characteristic to luggage carries out Classification and Identification, obtains the colouring information of luggage.System is easy for installation, simple to operate, with low cost, once dropping into just can be permanently effective, not only can on-line automaticly obtain the size and the color of luggage, and label needn't be set on luggage in advance, thereby realize that under the prerequisite that does not change current Airport Operation mechanism noncontact obtains the purpose of luggage information automatically, can significantly reduce the workload of luggage treatment people, improve the efficient that luggage is handled.
Description of drawings
Fig. 1 is an overall construction drawing of the present invention;
Fig. 2 is an image acquisition of the present invention portion schematic side view;
Fig. 3 is an image acquisition of the present invention portion front-view schematic diagram;
Fig. 4 is system works flow process figure.
Attached major label description in figure
1: the image acquisition worktable; 2: image acquisition portion; 21: the stereo colour video camera;
22: light fixture; 23: the luggage detector; 24: the luggage conveyer;
3: image processing module; 4: server; 5: luggage.
Embodiment
Example: online the obtaining of airport accident luggage information
The online System and method for that obtains of a kind of luggage information based on stereoscopic vision that the present invention proposes can be widely used in obtaining automatically of accident luggage information, as airport accident luggage information at line drawing.Be specifically described below in conjunction with example.
As shown in Figure 1, the online system that obtains of airport accident luggage information based on stereoscopic vision of the present invention except that power supply, mainly is made up of image acquisition worktable 1, image acquisition portion 2, image processing module 3 and server 4.
As Fig. 2 and Fig. 3 the synoptic diagram of image acquisition portion 2 is shown, described image acquisition portion 2 comprises stereo colour video camera 21, lighting device 22, luggage detector 23 and the luggage conveyer 24 that is positioned at image acquisition worktable 1.
Stereo colour video camera 21 is embedded on the inner top surface of image acquisition worktable 1, and stereo colour video camera 21 is made up of a plurality of colour TV cameras, and the optical axis of different colour TV cameras is positioned at same plane, and this plane is vertical with the working direction of luggage conveyer 24.A plurality of colour TV cameras of forming stereo colour video camera 21 are after system opens, and are in running order all the time, with the image of certain frame per second synchronous acquisition luggage 5.When luggage 5 process luggage detectors 23 places, luggage detector 23 has detected luggage 5 and has occurred, and then sends a switch controlling signal.This switch controlling signal is given stereo colour video camera 21, triggers stereo colour video camera 21 the luggage image that each colour TV camera obtains synchronously is transferred to luggage processing module 3.In this process, each colour TV camera has a width of cloth luggage image to export.In the present embodiment, the stereo colour video camera adopts Bumblebee2 binocular solid colour TV camera.Therefore, exportable altogether two width of cloth luggage images of this binocular solid colour TV camera 21, this two width of cloth has constituted the stereogram of this luggage 5 jointly about the image of same luggage 5.
In the implementation case, luggage detector 23 adopts the correlation optoelectronic switch, the correlation optoelectronic switch mainly is made up of the transmitter and the receiver that structurally are separated from each other and optical axis is staggered relatively, transmitter and receiver are installed in respectively on the image acquisition worktable 1 opposed inside face, as shown in Figure 3.Do not have luggage 5 through out-of-date between transmitter and receiver, the light that transmitter sends directly enters receiver, and when luggage 5 passes through between transmitters and the receiver and blocks light, this optoelectronic switch will produce a switch controlling signal.
Image processing module 3 is mainly used in image storage, image analysis processing, luggage sizes calculating and colouring information generation.Image processing module 3 had both comprised the hardware cell that supports image storage and computing, also comprised being specifically designed to the image processing algorithm that luggage information obtains.Image processing module 3 utilizes principle of stereoscopic vision, stereogram to luggage 5 is carried out analyzing and processing, recover the surface three dimension depth information of luggage 5,, calculate the length size of luggage 5 further combined with the elevation information of stereo colour video camera 21 apart from luggage conveyer 24; Simultaneously, the luggage image that 3 pairs of stereo colour video cameras of image processing module 21 are gathered carries out color notation conversion space, and 5 the dominant hue color characteristic and classifying of picking up one's luggage obtains the colouring information of luggage 5.
Server 4 is general computer systems, comprises the database of a storage luggage sizes and colouring information in the server 4.Online setting also is installed on the server 4, and is connected with the Internet network, airdrome luggage managerial personnel or passenger can pass through Internet access server 4, are used for the storage and the inquiry of information such as luggage sizes and color.
As Fig. 4 the online process flow diagram that obtains the acquisition methods of system of the luggage information based on stereoscopic vision of the present invention is shown, at first be that luggage detector 23 is when having detected luggage 5 and occurring, the luggage image that stereo camera 21 is gathered is sent to image processing module 3,3 pairs of luggage images of image processing module carry out analyzing and processing then, obtain the size and the colouring information of luggage, and be sent to server in order to inquiry.Be implemented as follows:
Step S1: luggage conveyer 24 is made uniform motion in the horizontal direction, and when having luggage 5 to occur as if luggage conveyer 24, luggage 5 is along with luggage conveyer 24 is made horizontal uniform motion with respect to ground together.The luggage detector 23 that is positioned at image acquisition worktable 1 is detecting whether luggage 5 processes are arranged all the time, and a plurality of colour TV cameras in the stereo colour video camera 21 are also all the time synchronously with certain frame per second images acquired simultaneously.When luggage 5 process luggage detectors 23, luggage detector 23 detects luggage 5 and output switch control signal, this switch controlling signal triggers stereo colour video camera 21 and once exports and give image processing module 3 with the luggage image of a plurality of colour TV camera synchronous acquisition, it is each colour TV camera output piece image, if the stereo colour video camera is made up of N colour TV camera, the image of then giving image processing module 3 is total up to the N width of cloth, and this N width of cloth constitutes the stereogram of this luggage 5 jointly about the image of same luggage 5.In the present embodiment, the stereo colour video camera adopts Bumblebee2 binocular solid colour TV camera, and then the stereogram in this programme is made up of 2 width of cloth images.After the stereogram work of obtaining of luggage 5 is finished, execution in step S2 then.
After a luggage leaves luggage detector 23, if detecting new luggage once more, luggage detector 23 occurs, then trigger the image of 21 pairs of each colour TV camera collections of stereo colour video camera once more and export, and be sent to image processing module 3.This process circulation is carried out.
Step S2: several luggage images in the luggage stereogram that 3 pairs of stereo colour video cameras 21 of image processing module obtain carry out feature extraction respectively, obtain the feature primitive represented with key point or curve form, then the feature primitive from different images is mated, obtain corresponding feature primitive between the different images.
Step S3:, in conjunction with the inside and outside parameter of the stereo colour video camera of having demarcated 21, utilize the binocular stereo vision principle, the three-dimensional depth information on reconstruct luggage surface again according to the feature primitive of coupling.
Step S4: the three-dimensional depth information on luggage surface is generated a width of cloth gray level image, what the pixel coordinate of this image reflected is the position of luggage surface different parts, what the gray scale of image reflected is the depth information at the pairing luggage surface location of pixel coordinate place, the depth value of this pixel institute corresponding position of the big more expression of the gray-scale value of pixel is big more, and the more little then corresponding depth value of grey scale pixel value is more little.From the gray level image of this width of cloth reflection luggage surface three dimension depth information, be partitioned into the luggage zone, find the minimum boundary rectangle in luggage zone, thereby obtain the length and the width of luggage 5;
Utilize the three-dimensional depth information on luggage surface,, calculate the height of luggage again in conjunction with the elevation information of stereo colour video camera 21 apart from luggage conveyer 24; According to the length of luggage 5, generate the dimension information of luggage 5 again.
Step S5: the luggage image that stereo colour video camera 21 is obtained carries out color notation conversion space, the luggage image transitions that former cause three primary colours (RGB) color space is represented arrives tone, saturation degree and brightness (Hue, Saturation and Intensity, HSI) color space, pick up one's luggage 5 dominant hue color characteristic, and according to pre-set color class (as redness, white, black etc.) color characteristic of luggage 5 is classified, obtain the colouring information of luggage 5.
Step S6: image processing module 3 is with the length size and the colouring information of luggage 5, and the stereogram of luggage, delivers to server 4 and preserves, so that luggage managerial personnel and passenger's inquiry.
The above; only be the embodiment among the present invention; but protection scope of the present invention is not limited thereto; anyly be familiar with the people of this technology in the disclosed technical scope of the present invention; can understand conversion or the replacement expected; all should be encompassed in of the present invention comprising within the scope, therefore, protection scope of the present invention should be as the criterion with the protection domain of claims.
Claims (7)
1. online system that obtains of the luggage information based on stereoscopic vision is characterized in that this system comprises: the image acquisition worktable, and image acquisition portion, image processing module and server, wherein,
Image acquisition portion is installed in the image acquisition worktable; Image acquisition portion is online, the stereogram when luggage is obtained in noncontact through the image acquisition worktable;
Image processing module is connected with image acquisition portion, image processing module carries out the processing of two aspects: the one, the stereogram that image acquisition portion obtains is carried out feature extraction and matching treatment, reconstruct the three-dimensional depth information on luggage surface, calculate the length size of luggage on this basis, be that the luggage image that image acquisition portion gathers is carried out color notation conversion space on the other hand, the color characteristic of picking up one's luggage, and color characteristic classified, the luggage colouring information obtained;
Server is connected with image processing module, be responsible for to receive the luggage sizes that image processing module obtains and the stereogram of colouring information and luggage, and the inquiry service of luggage information is provided for luggage managerial personnel and passenger.
2. the online system that obtains of luggage information as claimed in claim 1 is characterized in that, described image acquisition portion comprises: the stereo colour video camera, lighting device, luggage detector and the luggage conveyer that are positioned at the image acquisition worktable; The stereo colour video camera is connected with luggage detector point, and the stereo colour video camera is embedded on the inner top surface of image acquisition worktable, is made up of a plurality of colour TV cameras; Lighting device is installed on the inner top surface or medial surface of image acquisition worktable, and the light beam irradiates that lighting device is launched is used to the stereo colour video camera imaging that illumination is provided to luggage, so that the stereo colour video camera obtains luggage image clearly; Place luggage on luggage conveyer horizontal positioned and its, be used for level and transport luggage; The luggage detector is installed on the medial surface of image acquisition worktable, is positioned at the position of the lower middle side of image acquisition worktable medial surface, and whether be used to detect has luggage to occur on the luggage conveyer; When the luggage detector has detected luggage, trigger the stereogram of stereo colour camera acquisition luggage.
3. the online system that obtains of luggage information as claimed in claim 1 is characterized in that, described stereo colour video camera, this luggage information based on stereoscopic vision is online obtain system and open after, in running order all the time; When luggage process luggage detector, the luggage detector has detected luggage and has occurred, and produces switch controlling signal; This switch controlling signal is given the stereo colour video camera, triggers the stereo colour video camera luggage image that each colour TV camera obtains is transferred to the luggage processing module; In this process, each colour TV camera is exported a width of cloth luggage image; Set up sports lottery ticket look video camera to form by N colour TV camera, the exportable altogether N width of cloth of this N colour TV camera luggage image then, this N width of cloth constitutes the stereogram of this luggage jointly about the image of same luggage; Before the work of stereo colour video camera, need earlier the stereo colour video camera to be demarcated, obtain the inside and outside parameter of stereo colour video camera, be used to calculate the three-dimensional depth information on luggage surface.
4. the online system that obtains of luggage information as claimed in claim 1 is characterized in that, on the described server Internet device is installed, and is connected with the Internet network.
5. one kind is utilized the online online acquisition methods of luggage information that obtains system of the described luggage information of claim 1, it is characterized in that it is as follows that the method comprising the steps of:
Step S1: the luggage conveyer is made uniform motion in the horizontal direction, and when having luggage to occur as if the luggage conveyer, luggage is along with the luggage conveyer is made horizontal uniform motion with respect to ground together; The luggage detector that is positioned at the image acquisition worktable is detecting whether the luggage process is arranged all the time, and a plurality of colour TV cameras in the stereo colour video camera are also all the time with certain frame per second images acquired simultaneously; When luggage process luggage detector, the luggage detector detects luggage and output switch control signal, this switch controlling signal triggers the stereo colour video camera and once exports and give image processing module with the luggage image of a plurality of colour TV camera collections, it is each colour TV camera output piece image, if the stereo colour video camera is made up of N colour TV camera, the image of then giving image processing module is total up to the N width of cloth, and this N width of cloth constitutes the stereogram of this luggage jointly about the image of same luggage; After the stereogram work of obtaining of luggage is finished, execution in step S2 then;
Step S2: several luggage images in the luggage stereogram that image processing module obtains the stereo colour video camera carry out feature extraction respectively, obtain the feature primitive, then the feature primitive from different images is mated, obtain corresponding feature primitive between the different images;
Step S3:, in conjunction with the inside and outside parameter of the stereo colour video camera of having demarcated, utilize the binocular stereo vision principle, the three-dimensional depth information on reconstruct luggage surface again according to the feature primitive of coupling;
Step S4: the three-dimensional depth information on luggage surface is generated a width of cloth gray level image, what the pixel coordinate of this image reflected is the position of luggage surface different parts, what the gray scale of image reflected is the depth information at the pairing luggage surface location of pixel coordinate place, the depth value of this pixel institute corresponding position of the big more expression of the gray-scale value of pixel is big more, and the more little then corresponding depth value of grey scale pixel value is more little; From the gray level image of this width of cloth reflection luggage surface three dimension depth information, be partitioned into the luggage zone, find the minimum boundary rectangle in luggage zone, thereby obtain the length and the width of luggage;
Utilize the three-dimensional depth information on luggage surface,, calculate the height of luggage again in conjunction with the elevation information of stereo colour video camera apart from the luggage conveyer; According to the length of luggage, generate the dimension information of luggage again;
Step S5: the luggage image that the stereo colour video camera is obtained carries out color notation conversion space, the luggage image transitions that former cause three primary colours color space is represented arrives tone, saturation degree and brightness color space, the dominant hue color characteristic of picking up one's luggage, and according to pre-set color class the color characteristic of luggage is classified, obtain the colouring information of luggage;
Step S6: image processing module is delivered to the length size and the colouring information of luggage server and is preserved, so that luggage managerial personnel and passenger's inquiry.
6. the online acquisition methods of luggage information as claimed in claim 5 is characterized in that, described stereo colour video camera, this luggage information based on stereoscopic vision is online obtain system and open after, in running order all the time; A plurality of colour TV cameras of forming the stereo colour video camera are constantly gathered the image of luggage with certain frame per second; When luggage process luggage detector, the luggage detector has detected luggage and has occurred, and produces switch controlling signal; This switch controlling signal is given the stereo colour video camera, triggers the stereo colour video camera luggage image that each colour TV camera obtains is exported.
7. the online acquisition methods of luggage information as claimed in claim 5, it is characterized in that, the luggage image that described image processing module obtains image acquisition portion carries out the processing and the analysis of two aspects, be to utilize stereogram to come the three-dimensional depth information on reconstruct luggage surface on the one hand, and then the length size of acquisition luggage, be that the luggage image is carried out analyzing and processing on the other hand, the color characteristic of picking up one's luggage is also classified, and obtains the colouring information of luggage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101575262A CN101846503B (en) | 2010-04-21 | 2010-04-21 | Luggage information on-line obtaining system based on stereoscopic vision and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101575262A CN101846503B (en) | 2010-04-21 | 2010-04-21 | Luggage information on-line obtaining system based on stereoscopic vision and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101846503A true CN101846503A (en) | 2010-09-29 |
| CN101846503B CN101846503B (en) | 2011-09-28 |
Family
ID=42771200
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101575262A Expired - Fee Related CN101846503B (en) | 2010-04-21 | 2010-04-21 | Luggage information on-line obtaining system based on stereoscopic vision and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101846503B (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106056056A (en) * | 2016-05-23 | 2016-10-26 | 浙江大学 | Long-distance non-contact luggage volume detection system and method thereof |
| CN106813568A (en) * | 2015-11-27 | 2017-06-09 | 阿里巴巴集团控股有限公司 | object measuring method and device |
| CN106839975A (en) * | 2015-12-03 | 2017-06-13 | 杭州海康威视数字技术股份有限公司 | Volume measuring method and its system based on depth camera |
| CN107392101A (en) * | 2017-06-16 | 2017-11-24 | 深圳市盛路物联通讯技术有限公司 | A kind of luggage claim method and system, claim terminal |
| CN108563084A (en) * | 2018-05-25 | 2018-09-21 | 深圳新亮智能技术有限公司 | Multi-structured light pattern three-dimensional sensing system |
| CN108701287A (en) * | 2016-03-02 | 2018-10-23 | 西门子股份公司 | The method and luggage of description for creating baggage item describe system |
| CN109063877A (en) * | 2018-08-08 | 2018-12-21 | 深圳码隆科技有限公司 | Luggage storage position selection method, device and server |
| EP3460385A4 (en) * | 2016-05-16 | 2019-04-24 | Hangzhou Hikrobot Technology Co., Ltd | Method and apparatus for determining volume of object |
| CN110435919A (en) * | 2019-09-02 | 2019-11-12 | 刘子暄 | A kind of airdrome luggage processing system |
| CN110631475A (en) * | 2019-05-31 | 2019-12-31 | 安琳 | On-site target size detection method |
| CN110738691A (en) * | 2018-07-19 | 2020-01-31 | 大连因特视智能传感科技有限公司 | Luggage tracking system based on online intelligent visual network |
| WO2020029402A1 (en) * | 2018-08-08 | 2020-02-13 | 深圳码隆科技有限公司 | Suitcase volume measurement method and device, and suitcase volume measurement server, and computer readable medium |
| CN110793472A (en) * | 2019-11-11 | 2020-02-14 | 桂林理工大学 | Grinding surface roughness detection method based on quaternion singular value entropy index |
| CN110866944A (en) * | 2019-12-06 | 2020-03-06 | 民航成都物流技术有限公司 | Consigned luggage measurement and identification method and system |
| CN111504230A (en) * | 2020-04-22 | 2020-08-07 | 海尔智家股份有限公司 | Three-dimensional size measuring system and method for refrigerator |
| CN111854636A (en) * | 2020-07-06 | 2020-10-30 | 北京伟景智能科技有限公司 | Multi-camera array three-dimensional detection system and method |
| CN115112508A (en) * | 2022-08-29 | 2022-09-27 | 民航成都物流技术有限公司 | Device and method for identifying soft and hard bags of consigned luggage in civil aviation airport |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4181064A1 (en) * | 2021-11-12 | 2023-05-17 | SITA Information Networking Computing UK Limited | Method and system for measuring an article |
| IT202100029669A1 (en) * | 2021-11-24 | 2023-05-24 | Automate S R L | STEREOSCOPIC CAMERA FOR THE RECOGNITION, MEASUREMENT AND POSITIONING OF BAGGAGE ON THE COLLECTOR BELT OF AN AIRPORT |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020118873A1 (en) * | 2000-01-24 | 2002-08-29 | Robotic Vision Systems, Inc. | Machine vision-based singulation verification system and method |
-
2010
- 2010-04-21 CN CN2010101575262A patent/CN101846503B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020118873A1 (en) * | 2000-01-24 | 2002-08-29 | Robotic Vision Systems, Inc. | Machine vision-based singulation verification system and method |
Non-Patent Citations (3)
| Title |
|---|
| 《农业工程学报》 20020331 冯斌，汪懋华 《基于颜色分形的水果计算机视觉分级技术》 第1页第3、4段，第3页第2段，附图1 1-7 第18卷, 第2期 2 * |
| 《农业机械学报》 20000331 李庆中，汪懋华 《基于计算机视觉的苹果自动分级系统硬件开发》 全文 1-7 第31卷, 第2期 2 * |
| 《农业机械学报》 20030131 冯斌，汪懋华 《基于计算机视觉的水果大小检测方法》 第1页第1章2-7行，第2页第2.1节，第3页第3章第1、2行，附图1 1-7 第34卷, 第1期 2 * |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106813568A (en) * | 2015-11-27 | 2017-06-09 | 阿里巴巴集团控股有限公司 | object measuring method and device |
| CN106813568B (en) * | 2015-11-27 | 2019-10-29 | 菜鸟智能物流控股有限公司 | Object measuring method and device |
| CN106839975A (en) * | 2015-12-03 | 2017-06-13 | 杭州海康威视数字技术股份有限公司 | Volume measuring method and its system based on depth camera |
| CN106839975B (en) * | 2015-12-03 | 2019-08-30 | 杭州海康威视数字技术股份有限公司 | Volume measuring method and its system based on depth camera |
| CN108701287A (en) * | 2016-03-02 | 2018-10-23 | 西门子股份公司 | The method and luggage of description for creating baggage item describe system |
| US10922834B2 (en) | 2016-05-16 | 2021-02-16 | Hangzhou Hikrobot Technology, Co., LTD | Method and apparatus for determining volume of object |
| EP3460385A4 (en) * | 2016-05-16 | 2019-04-24 | Hangzhou Hikrobot Technology Co., Ltd | Method and apparatus for determining volume of object |
| CN106056056A (en) * | 2016-05-23 | 2016-10-26 | 浙江大学 | Long-distance non-contact luggage volume detection system and method thereof |
| CN107392101A (en) * | 2017-06-16 | 2017-11-24 | 深圳市盛路物联通讯技术有限公司 | A kind of luggage claim method and system, claim terminal |
| CN108563084A (en) * | 2018-05-25 | 2018-09-21 | 深圳新亮智能技术有限公司 | Multi-structured light pattern three-dimensional sensing system |
| CN110738691A (en) * | 2018-07-19 | 2020-01-31 | 大连因特视智能传感科技有限公司 | Luggage tracking system based on online intelligent visual network |
| CN109063877A (en) * | 2018-08-08 | 2018-12-21 | 深圳码隆科技有限公司 | Luggage storage position selection method, device and server |
| WO2020029402A1 (en) * | 2018-08-08 | 2020-02-13 | 深圳码隆科技有限公司 | Suitcase volume measurement method and device, and suitcase volume measurement server, and computer readable medium |
| CN110631475A (en) * | 2019-05-31 | 2019-12-31 | 安琳 | On-site target size detection method |
| CN110631475B (en) * | 2019-05-31 | 2021-08-03 | 安康钟吾青帜工业设计有限公司 | On-site target size detection method |
| CN110435919A (en) * | 2019-09-02 | 2019-11-12 | 刘子暄 | A kind of airdrome luggage processing system |
| CN110793472A (en) * | 2019-11-11 | 2020-02-14 | 桂林理工大学 | Grinding surface roughness detection method based on quaternion singular value entropy index |
| CN110793472B (en) * | 2019-11-11 | 2021-07-27 | 桂林理工大学 | Grinding surface roughness detection method based on quaternion singular value entropy index |
| CN110866944A (en) * | 2019-12-06 | 2020-03-06 | 民航成都物流技术有限公司 | Consigned luggage measurement and identification method and system |
| CN111504230A (en) * | 2020-04-22 | 2020-08-07 | 海尔智家股份有限公司 | Three-dimensional size measuring system and method for refrigerator |
| CN111854636A (en) * | 2020-07-06 | 2020-10-30 | 北京伟景智能科技有限公司 | Multi-camera array three-dimensional detection system and method |
| CN111854636B (en) * | 2020-07-06 | 2022-03-15 | 北京伟景智能科技有限公司 | Multi-camera array three-dimensional detection system and method |
| CN115112508A (en) * | 2022-08-29 | 2022-09-27 | 民航成都物流技术有限公司 | Device and method for identifying soft and hard bags of consigned luggage in civil aviation airport |
| CN115112508B (en) * | 2022-08-29 | 2023-01-24 | 民航成都物流技术有限公司 | Device and method for identifying soft and hard bags of consigned luggage in civil aviation airport |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101846503B (en) | 2011-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101846503B (en) | Luggage information on-line obtaining system based on stereoscopic vision and method thereof | |
| CN101871768B (en) | Automatic acquisition system of baggage appearance information based on monocular vision and method thereof | |
| CN104392224B (en) | A kind of highway pavement crack detecting method | |
| CN111949809B (en) | Intelligent processing method for infrared inspection data of power transmission line | |
| CN103512762B (en) | Image processing method, device and train failure detection system | |
| WO2018028103A1 (en) | Unmanned aerial vehicle power line inspection method based on characteristics of human vision | |
| CN108957240A (en) | Electric network fault is remotely located method and system | |
| CN109919058A (en) | A kind of multisource video image highest priority rapid detection method based on Yolo V3 | |
| CN101788270B (en) | Ranging technology-based system for on-line measurement of luggage sizes and method thereof | |
| CN110070530A (en) | A kind of powerline ice-covering detection method based on deep neural network | |
| CN103413150A (en) | Power line defect diagnosis method based on visible light image | |
| CN110147758A (en) | A kind of forest fire protection method based on deep learning | |
| CN104834920A (en) | Intelligent forest fire recognition method and device based on multispectral image of unmanned plane | |
| CN112528979B (en) | Transformer substation inspection robot obstacle distinguishing method and system | |
| CN106331636A (en) | Intelligent video monitoring system and method of oil pipelines based on behavioral event triggering | |
| CN109525194A (en) | Photovoltaic panel failure spot detection recognition methods and system | |
| CN102854192A (en) | System and method for detecting apple surface defect | |
| CN107181323B (en) | Unmanned aerial vehicle line patrol system and method | |
| CN110110586A (en) | The method and device of remote sensing airport Airplane detection based on deep learning | |
| CN108846331A (en) | The video frequency identifying method whether a kind of EMU chassis screw fastener falls off | |
| Lianqiao et al. | Recognition and application of infrared thermal image among power facilities based on yolo | |
| CN113485432A (en) | Photovoltaic power station electroluminescence intelligent diagnosis system and method based on unmanned aerial vehicle | |
| CN109816780A (en) | A kind of the transmission line of electricity three-dimensional point cloud generation method and device of binocular sequential images | |
| CN106920240A (en) | A kind of insulator identification and method for diagnosing faults based on infrared image | |
| CN102565873A (en) | Safety check system for three-dimensional vehicle chassis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110928 Termination date: 20210421 |