WO2020021580A1

WO2020021580A1 - Apparatus and method for automatically checking a piece of baggage

Info

Publication number: WO2020021580A1
Application number: PCT/IT2019/050165
Authority: WO
Inventors: Paolo Barbieri; Giovanni ANTINOZZI
Original assignee: Airlogs S.R.L.
Priority date: 2018-07-23
Filing date: 2019-07-16
Publication date: 2020-01-30
Also published as: IT201800007423A1

Abstract

An apparatus for automatically checking a piece of baggage comprises a containment structure (2) provided with an opening (3) for insertion of a piece of baggage, at least one three-dimensional scanning device (4) positioned inside said containment structure (2) and suitable for supplying a three-dimensional reconstruction of the piece of baggage, and a processing unit (5) connected to the scanning device (4) for calculating the dimensions of the piece of baggage starting from the three-dimensional reconstruction of the piece of baggage.

Description

APPARATUS AND METHOD FOR AUTOMATICALLY CHECKING A PIECE OF BAGGAGE

Technical Field

The present invention relates to an apparatus and a method for automatically checking a piece of baggage.

In particular, the invention applies to baggage checking at airports, where the size and weight of the piece of baggage must be checked before boarding.

Background Art

For hold baggage, this check is usually carried out in the check-in area, where the piece of baggage is loaded onto a weight-detecting belt in the presence of an attendant. Checks have recently become necessary on hand baggage, which would otherwise be carried onto the cabin even where bulky and above a certain weight. To check the size of a piece of hand baggage, and therefore its compliance with the permitted dimensions, containers with the permitted dimensions can be used for passengers to insert their own piece of baggage into. In reality, these containers are seldom used and, in any case, they are provided to allow passengers to perform an approximate check on whether or not their piece of baggage meets the permitted dimensions. However, no check is carried out by an attendant and, in any case, these containers do not enable the weight of the piece of baggage to be checked.

Of late, devices have been introduced at airports to automatically check the size and weight of pieces of hand baggage.

A known device comprises a conveyor belt with built-in load cells to determining the weight of the piece of baggage and photocells which allow the transversal dimensions of the piece of baggage to be determined relative to the direction of travel of the belt. The load cells and the photocells are connected to a processing unit that compares the data detected on the weight and dimensions of the piece of baggage against the permitted specifications.

Although this device allows items of baggage to be checked automatically, it is particularly cumbersome as it involves a belt travelling inside a closed tunnel with built-in photocells. These devices are generally positioned at the baggage security check, and therefore once the passenger has already reached the boarding area. Therefore, if the check by the processing unit shows that the piece of baggage exceeds the permitted dimensions or weight, the passenger should theoretically return to the check-in area and check the piece of baggage into the hold.

Disclosure of the Invention

The aim of the present invention is to provide a baggage-checking apparatus which enables the size of the piece of baggage to be determined.

An additional aim of the present invention is to provide an apparatus that can be installed in several airport areas.

According to the present invention, an apparatus is provided with the features defined in Claim 1.

The dimensions of the piece of baggage can be accurately measured using a three- dimensional scanning device. With respect to photocells, that is to screened feedback devices, the use of a three-dimensional scanning device also allows the apparatus to be of limited size and, therefore, to be positioned in several areas (check-in, gate) without having any significant impact on space.

Advantageously, the three-dimensional scanning device comprises at least one structured-light video camera, which enables the dimensions of the piece of baggage to be effectively and accurately reconstructed.

In particular, the structured-light video camera is positioned at an inner upper zone of the containment structure.

Advantageously, the three-dimensional scanning device comprises a first structured-light video camera and a second structured-light video camera which are positioned at a predetermined distance from each other, and in particular are positioned at an equal distance from the base of the device. This allows the piece of baggage to be scanned completely by reducing shadow areas, without increasing the size of the apparatus.

Advantageously, the apparatus comprises a housing positioned inside the containment structure and connected to the opening, wherein the housing has at least one supporting surface for the piece of baggage, for correctly positioning the piece of baggage relative to the three-dimensional scanning device.

In one preferred embodiment, the structured-light video camera is positioned parallel to the supporting surface of the housing so as to optimally capture the area in which the piece of baggage is positioned. In the case of a single video camera, this is preferably positioned centrally relative to the lateral ends of the supporting surface of the housing. In the case of two video cameras, these are preferably positioned symmetrically relative to the centre of the housing for the piece of baggage.

Advantageously, the apparatus comprises at least one load cell, positioned inside the containment structure and connected to the processing unit, for determining the weight of the piece of baggage.

In one preferred embodiment, the checking apparatus comprises at least one optical reader attached to the containment structure and connected to the processing unit.

The optical reader can identify the information on the boarding pass, in particular the airline and passenger class, which are then linked to the baggage weight and dimensions limits for a given company. The permitted limits are compared against the determined dimensions and weight and it is automatically checked whether the piece of baggage conforms to the required specifications of a given airline.

Preferably, the checking apparatus comprises a printing unit attached to the containment structure, for printing a document, preferably a label, which shows at least the information on the dimensions and/or the weight of the piece of baggage, so as to facilitate subsequent checks.

Advantageously, the checking apparatus comprises a data entry and/or display interface, positioned on the outer part of the structure, to interactively guide the user, indicate errors, non-conformity, etc.

According to another aspect of the present invention, a method for automatically checking a piece of baggage comprises the features of Claim 15.

Brief Description of the Drawings

Further advantages and features of the present invention will become more apparent from the detailed description below with reference to the accompanying drawings, which show a non-limiting embodiment, in which:

- Figure 1 shows a front-view of an automatic checking apparatus according to a first embodiment of the present invention;

- Figure 2 shows a longitudinal section of the apparatus shown in Figure l ;

- Figure 3 shows a cross-section of the apparatus shown in Figure 1;

- Figure 4 shows a front-view of an automatic checking apparatus according to an alternative embodiment;

- Figure 5 shows a diagram of the steps for determining the dimensions of the piece of baggage in a preferred embodiment of the method according to the present invention.

Detailed Description of Preferred Embodiment of the Invention

Figure 1 shows, with reference number 1, a first embodiment of an apparatus for automatically checking a piece of baggage.

According to the present invention, the checking apparatus 1 comprises a containment structure 2 provided with an opening 3 for insertion of a piece of baggage, at least one three-dimensional scanning device 4 positioned inside the containment structure 2, in which the three-dimensional scanning device is suitable for supplying a three-dimensional reconstruction of the piece of baggage, and a processing unit 5 connected to the scanning device 4 for calculating the dimensions of the piece of baggage starting from the three-dimensional reconstruction of the piece of baggage (Figure 2).

The three-dimensional scanning device 4 preferably comprises at least one structured-light video camera. The structured-light video camera projects a pattern of light onto the piece of baggage and, by analysing the edge deformation of the pattern projected onto the surface, enables the dimensions of the piece of baggage to be determined. This type of video camera allows three coordinates (x, y, z) to be obtained for each sensing point of the sensor.

A triangulation procedure is used to obtain a“point cloud”, a cluster of points defined by their position within a system of coordinates, forming a three- dimensional image of the piece of baggage. In particular, each point in the point cloud is determined by the xy coordinate of the plane and the z coordinate defining the distance of the point from the video camera.

In the embodiment shown in Figure 2, the three-dimensional scanning device 4 is positioned at an inner upper zone 7 of the containment structure 2.

In a preferred embodiment, the apparatus 1 comprises at least one load cell 12, connected to the processing unit 5, for determining the weight of the piece of baggage. The load cell 12 is advantageously positioned inside the containment structure 2, in particular at the base 11 of the apparatus 1.

In an advantageous embodiment, shown in Figure 2, the device 1 comprises a housing 13 for the piece of baggage, positioned inside the containment structure 2 and connected to the opening 3, so that the piece of baggage can be correctly positioned relative to the three-dimensional scanning device 4.

The housing 13 comprises at least one supporting surface 23 for the piece of baggage, with its first edge positioned at the opening and a second edge inside the containment structure 2. Advantageously, the structured-light video camera is positioned parallel to the supporting surface 23 of the housing 13.

Preferably, the internal housing 13 has a substantially parallelepiped shape. The housing comprises at least one bottom surface 33, which has a corner 14 in common with the inside edge of the supporting surface 23.

In the embodiment shown in Figure 2, the housing 13 is positioned angled relative to the horizontal surface.

As well as enabling the piece of baggage to be correctly positioned relative to the three-dimensional scanning device 4 and the load cell 12, this also facilitates the insertion and retrieval of the piece of baggage by the user.

In particular, the supporting surface 23 of the housing 13 forms an angle of approximately 50° with the horizontal surface of the base 11 of the apparatus. In the embodiment shown in Figure 2, the corner 14 in common between the supporting surface 23 and the bottom surface 33 of the housing 13 rests on the surface of the load cell 12.

The three-dimensional scanning device 4 may be formed by a single structured- light video camera. In this case, the video camera is positioned centrally relative to the lateral ends of the supporting surface 23 of the housing 13 at a predetermined distance from the bottom surface 33.

In an advantageous embodiment, shown in Figure 3, the three-dimensional scanning device 4 comprises a first structured-light video camera 6 and a second structured-light video camera 8. In particular, the first video camera 6 and the second video camera 8 are positioned symmetrically relative to the centre of the housing 13. Preferably, each video camera 6, 8 is positioned at an intermediate distance between the centre of the inside edge and one lateral end of the supporting surface 23. This allows the piece of baggage to be scanned completely by reducing shadow areas, without increasing the size of the apparatus.

Advantageously, the video cameras 6, 8 are positioned parallel to the supporting surface 23 of the baggage housing 13. Preferably, the video cameras 6, 8 are positioned at an equal distance from the base 11 of the apparatus 1.

In one embodiment, the containment structure 2 has a height of approximately 1330 mm, a width of approximately 600 mm and a depth of approximately 800 mm.

The supporting surface 23 of the housing 13 is substantially rectangular in shape, with its smaller side measuring approximately 500 mm.

The video cameras 6, 8 are positioned at a height of approximately 1320 mm from the base 11 of the apparatus, with a centre-to-centre distance of approximately 233 mm. Each video camera 6, 8 is positioned at a distance of approximately 133 mm from the edge of the housing 13.

In the embodiment shown in Figure 1, the device 1 comprises a printing unit 15 positioned on the outside of the containment structure 2, for printing a document, preferably a label, which shows at least the data relating to the dimensions and/or to the weight of the piece of baggage.

Advantageously, the apparatus 1 comprises a data entry and/or display interface 16, positioned on the outer part of the containment structure 2. The interface 16 is preferably a touchscreen monitor, so as to allow the passenger to receive instructions interactively.

In the embodiment shown in Figure 3, the apparatus 1 comprises an optical reader 17 associated with the containment structure 2, positioned, for instance, on its outer side wall, and connected to the processing unit 5. The optical reader 17, which may be, for instance, a barcode reader, can detect and transmit the information on the boarding pass to the processing unit 5, which compares this against the baggage dimensions and/or weight information. It is thus automatically checked whether the dimensions and/or weight of the piece of baggage conform to the permissible specifications for the specific boarding pass. The apparatus 1 may provide for a label to be printed confirming the compliance with the permissible values.

Advantageously, the processing unit 5 is capable of being connected to the airport’s computer systems. In this way, it is possible for the data obtained when using the equipment to be transferred to other units in the airport, such as computers in the check-in or boarding area, and for the data provided by the airport computer systems to be transferred to update the data contained in the processing unit.

In the embodiment shown in Figure 4, the apparatus 1 comprises a payment module 18, such as POS type. The payment module 18 can be used if the airline company requires a surcharge to be paid on pieces of baggage that exceed the permitted dimensions or weight. This payment module 18 may comprise a credit card reader 19, such as a slot-type reader and/or a contactless reader 20, a numeric keyboard 21 and a printer 22 for issuing receipt.

The method according to the present invention involves carrying out a three- dimensional scan of a piece of baggage; supplying a three-dimensional reconstruction of the piece of baggage; and calculating the dimensions of the piece of baggage starting from the three-dimensional reconstruction.

Preferably, the method comprises the steps of inserting the piece of baggage in a containment structure and determining the weight of the piece of baggage inserted in the containment structure.

To perform the three-dimensional scan, the method advantageously envisages detecting a first image of the piece of baggage by means of a first structured-light video camera 6 and detecting a second image of the piece of baggage by means of a second structured-light video camera 8, wherein the first video camera 6 and the second video camera 8 are positioned at a predetermined distance from each other. The data relative to the first and second images are obtained by the processing unit 5.

In particular, as shown in the diagram in Figure 5, each video camera 6, 8 captures the piece of baggage and obtains imaging data for the piece of baggage within a coordinate system (x, y, z) where the video camera itself is the point of origin. There will therefore be two point clouds, the first for the first video camera 6 in the first coordinate system and the second for the second video camera 8 in the second coordinate system. The data obtained by the two video cameras 6, 8 are then reported in a single coordinate system (x, y, z), substantially by means of translation to make the first and second coordinate systems coincide. This produces a single point cloud, which gives a“rough” image of the piece of baggage.

An area of interest (“crop” area) is then defined, substantially corresponding to the area of the housing 13 in which the piece of baggage is inserted, and any points captured from video cameras 6, 8 outside of this area are excluded.

The next step involves applying clustering filters to eliminate points due to, for instance, reflections or refractions caused by material imperfections where the coordinates do not correspond to a physical point. As these points are usually isolated, this step uses clustering algorithms which group the elements together based on their distance to each other, thus determining whether or not these belong to a cluster, based on how far the element in question is from the cluster itself. A three-dimensional (spherical) space is then defined and, if the number of cluster points in the space is lower than a given threshold, the point is classified as “interference" or a“spike point” and is eliminated.

A subsequent step involves applying exclusion filters to eliminate elements from the three-dimensional image of the piece of baggage which are not significant for calculating the overall dimensions, such as bands, straps and so on. Preferably, these filters use the parameter of distance from the supporting surface 23 of the housing 13, excluding any points located at a distance below a predetermined value. For instance, the height of a strap protruding from a piece of baggage positioned on the supporting surface 23 of the housing 13 will be lower than the predetermined value and will not be factored in when calculating the size of the piece of baggage.

A processed point cloud is thus obtained, which is to say a three-dimensional image representing the solid mass of a piece of baggage, from which all non significant elements have been eliminated.

A bounding box system is used to calculate the dimensions, which determines the measurements of the parallelepiped having the minimum dimensions to contain the three-dimensional solid body of the processed point cloud.

In an advantageous embodiment, the method comprises the steps of detecting information on a travel document using a reader; linking the information detected to the set limits on baggage dimensions and/or weight; comparing the set limits on baggage dimensions and/or weight against the dimensions and/or weight of the actual piece of baggage; indicating whether the dimensions and/or weight of the actual piece of baggage comply with the set limits.

In one embodiment, with reference to Figure 2, a user inserts the piece of baggage into the opening 3 of the apparatus 1. The piece of baggage is correctly positioned inside the housing 13. The dimensions and, preferably, the weight of the piece of baggage are then detected. This information is transmitted to the processing unit 5.

The user places the boarding pass near to the reader 17.

The reader 17 can verify whether it is valid by connecting to the airport computer systems. If the boarding pass is not recognised or is not valid, the operation is cancelled.

If the boarding pass is valid, the reader 17 detects the information on the boarding pass, in particular the airline and passenger class. The information detected is transmitted to the processing unit 5. The processing unit 5 contains a database which associates the limits on baggage dimensions and size with each airline and class. The processing unit 5 retrieves the permitted limits from the database and compares them against the calculated dimensions and weight to check whether they comply with the rules of the airline.

If the piece of baggage is compliant, the apparatus 1 prints out a label to be attached to the piece of baggage for subsequent checks. If the piece of baggage is not compliant, the apparatus may show an error message.

The operation of the apparatus 1 can be checked before inserting the piece of baggage by determining whether the measured weight is zero, and therefore whether the housing 13 is empty, and/or whether paper is available for printing the label. The monitor 16 can therefore indicate whether the apparatus is available for use or can indicate otherwise by displaying an error message.

In these operations, the user is guided through the information provided via the interface touchscreen monitor 16. The interface 16 can be customised according to the needs of the user.

In case of excess baggage, the apparatus 1 can provide indications to the user on the cause of the problem and how to proceed.

Claims

1 . An apparatus for automatically checking a piece of baggage comprising a containment structure (2) provided with an opening (3) for insertion of a piece of baggage, at least one three-dimensional scanning device (4) positioned inside said containment structure (2) and suitable for supplying a three-dimensional reconstruction of the piece of baggage, and a processing unit (5) connected to the scanning device (4) for calculating the dimensions of the piece of baggage starting from the three-dimensional reconstruction of the piece of baggage.

2. The checking apparatus according to claim 1, characterised in that the three-dimensional scanning device (4) comprises at least one structured- light video camera.

3. The checking apparatus according to claim 2, characterised in that the structured-light video camera is positioned at an inner upper zone (7) of the containment structure (2).

4. The checking apparatus according to any of the preceding claims, characterised in that the three-dimensional scanning device (4) comprises a first structured-light video camera (6) and a second structured-light video camera (8) which are positioned at a predetermined distance from each other.

5. The checking apparatus according to claim 4, characterised in that said first structured-light video camera (6) and said second structured-light video camera (8) are positioned at the same distance from the base (11) of the apparatus.

6. The checking apparatus according to any of the preceding claims, characterised in that it comprises a housing (13) positioned inside the containment structure (2) and connected to the opening (3), wherein the housing has at least one supporting surface (23) for the piece of baggage, for positioning the piece of baggage relative to the three-dimensional scanning device (4).

7. The checking apparatus according to claim 6, characterised in that the housing (13) has a substantially parallelepiped shape, and is positioned angled relative to a horizontal plane.

8. The checking apparatus according to claim 6 or 7, characterised in that the structured-light video camera is positioned parallel to the supporting surface (23) of said housing (13).

9. The checking apparatus according to claim 6 or 7 or 8, characterised in that the structured-light video camera is positioned centrally relative to the lateral ends of the supporting surface (23) of the housing (13).

10. The checking apparatus according to claim 6 or 7 or 8, characterised in that the first structured-light video camera (6) and the second structured- light video camera (8) are positioned symmetrically relative to the centre of the housing (13).

1 1 . The checking apparatus according to any of the preceding claims, characterised in that it comprises at least one load cell (12), positioned inside the containment structure (2) and connected to the processing unit (5), for determining the weight of the piece of baggage.

12. The checking apparatus according to any of the preceding claims, characterised in that it comprises at least one optical reader (17) associated with the containment structure (2) and connected to the processing unit (5).

13. The checking apparatus according to any of the preceding claims, characterised in that it comprises a printing unit (15) associated with the containment structure (2), for printing a document, preferably a label, which shows at least the data relating to the dimensions and/or to the weight of the piece of baggage.

14. The checking apparatus according to any of the preceding claims, characterised in that it comprises a data entry and/or display interface (16), positioned on the outer part of the containment structure (2).

15. 15. A method for checking a piece of baggage, comprising the steps of

- carrying out a three-dimensional scan of a piece of baggage;

- supplying a three-dimensional reconstruction of the piece of baggage;

- calculating the dimensions of the piece of baggage starting from the three- dimensional reconstruction.

16. The method for checking a piece of baggage according to claim 15, characterised in that it detects a first image of the piece of baggage by means of a first structured-light video camera (6) and it detects a second image of the piece of baggage by means of a second structured-light video camera (8), wherein the first video camera (6) and the second video camera (8) are positioned at a predetermined distance from each other.

17. The method for checking a piece of baggage according to claim 16, characterised in that it obtains a first three-dimensional representation of the piece of baggage in a first reference system having the first video camera (6) as the origin; obtains a second three-dimensional representation of the piece of baggage in a second reference system having the second video camera (8) as the origin; and aligns the first reference system relative to the second reference system to obtain a single three-dimensional representation of the piece of baggage.

18. The method for checking a piece of baggage according to claim 17, characterised in that it defines a measuring area, preferably corresponding to a housing (13) in which the piece of baggage is inserted; applies to the three-dimensional representation of the piece of baggage a filter for excluding points which do not correspond to the piece of baggage and/or a filter for excluding predetermined elements of the piece of baggage; and obtains a new three-dimensional representation of the piece of baggage.

19. The method for checking a piece of baggage according to claim 18, characterised in that it processes a Bounding Box depending on the new three-dimensional representation of the piece of baggage for calculating the dimensions of the piece of baggage.

20. The method for checking a piece of baggage according to any of the preceding claims 15 to 19, characterised in that it comprises the steps of:

- inserting a piece of baggage in a containment structure (2);

- determining the weight of the piece of baggage inserted in the containment structure (2).

21 . The method for checking a piece of baggage according to any of the preceding claims 15 to 20, characterised in that it comprises the steps of:

- using a reader (17) to detect data present on a travel document;

- associating with the data detected predetermined limit values for the dimensions and/or the weight of the piece of baggage;

- comparing the predetermined limit values for the dimension and/or weight with the dimensions and/or the weight of the piece of baggage; - indicating compliance of the dimensions and/or the weight of the piece of baggage with the predetermined limit values.

22. A computer program, characterised in that it comprises instructions for carrying out the steps of the method according to any of the preceding claims 15 to 21.