WO2014125158A1

WO2014125158A1 - A method and an apparatus for imaging arthropods

Info

Publication number: WO2014125158A1
Application number: PCT/FI2013/050171
Authority: WO
Inventors: Teo KANNIAINEN
Original assignee: Kanniainen Teo
Priority date: 2013-02-14
Filing date: 2013-02-14
Publication date: 2014-08-21
Also published as: EP2956004A1; EP2956004A4

Abstract

The invention relates to a method and an apparatus for imaging arthropods. In the method an arthropod is detected. The arthropod may be illuminated when necessary. The method further comprises providing at least a first view to at least a part of the arthropod, providing a second view to the arthropod, and capturing at least one image of at least the first view and a second view of the arthropod. The apparatus comprises means for detecting an arthropod; means for providing a first view to at least a part of the arthropod and means for capturing an image of at least the first view and a second view of the arthropod.

Description

A Method and an Apparatus for Imaging Arthropods

Technical Field

The present invention relates to a method for imaging arthropods and an apparatus comprising a sensor for detecting an arthropod and an image capturing element for capturing an image of the arthropod. Background Information

There are many situations in which a detection and classification and/or identification of an arthropod may be useful. For example, many insects and other arthropods may be harmful and may spread diseases among plants and even among human beings. On the other hand, there exist many arthropods which may be useful for plantations. It might therefore provide useful information for protecting plants, animals and human beings if accurate enough information of spreading or existence of arthropods in a certain region could be collected.

A patent US-7, 916,951 discloses a colour-based imaging system and method for the detection and classification of insects and other arthropods, including devices for counting arthropods and providing taxonomic capabilities useful for pest-management. Some embodiments include an image sensor (for example, a digital colour camera, scanner or a video camera) with optional illumination that communicates with a computer system. Some embodiments include a colour scanner connected to a computer. Sampled arthropods are put on a scanner to be counted and identified. The computer captures images from the scanner, adjusts scanner settings, and processes the acquired images to detect and identify the arthropods. Other embodiments include a trapping device and a digital camera connected by cable or wireless communications to the computer. Some devices include a processor to do the detection and identification in the field, or the field system can send the images to a centralized host computer for detection and identification.

In the system of US-7, 916,951 arthropods are captured by a sticky substrate. One or more images are taken of the substrate onto which arthropods have been entrapped. The image is analysed to identify the arthropods. When using this kind of system the imaging is either manually initiated by a person or on a predetermined time instance or instances irrespective of whether there are any arthropods on the surface of the substrate. In some situations there may be a plurality of arthropods when an image is taken which may complicate the identification process. For example, two or more arthropods may be so close to each other on the surface of the substrate that the identification of individual arthropods may not be possible at all. It may also be insufficient for the identification process when the arthropods are imaged from only one direction.

When using adhesives the arthropods may stuck in an undefined position which may not be optimal for classification and/or identification. It may also be difficult or even impossible to take images of a desired part of the arthropod if it has been stuck to adhesive in a position which is not optimal for the imaging. For example, the arthropod may lay on its back on the adhesive surface wherein it is not possible to take images on the backside of the arthropod. Furthermore, if images are taken at certain intervals although there is no new information to be imaged, e.g. only those arthropods are on the surface of the substrate which have already been imaged, energy is consumed unnecessarily to the imaging and also to the identification process. Summary

An aim of the present invention is to provide a method and apparatus for imaging arthropods and for providing information for recognizing the imaged arthropod. In some embodiments there is provides a housing having one or more inlets to enable arthropods entering the housing. There may also detecting means e.g. in the housing and/or outside the housing to detect when an arthropod has entered or is entering the housing and to initiate capturing of one or more images of the arthropod. The housing may further comprise means to provide two or more views for imaging arthropods. When an image has been captured by an image capturing element the image may be provided for further analysis e.g. to classify the arthropod. The image may be captured when the arthropod has arrived or is assumed to have arrived to an imaging area i.e. an area which are "viewed" by an image capturing element directly and/or via an optical element.

According to an aspect there is provided a method for imaging arthropods comprising:

- detecting an arthropod;

- providing a first view to the arthropod;

- providing a second view to the arthropod; and

- capturing at least one image of at least the first view and the second view of the arthropod.

According to another aspect there is provided an apparatus comprising:

- means for detecting an arthropod;

- means for providing a first view to the arthropod; and

- means for capturing at least one image of at least the first view and a second view of the arthropod.

According to yet another aspect there is provided an apparatus comprising:

- a sensor for detecting an arthropod;

- an optical element for providing at least a first view to the arthropod; and

- an image sensor for capturing at least one image of at least the first view and a second view of the arthropod. According to a still another aspect there is provided an apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- detect an arthropod;

- provide a first view to the arthropod;

- provide a second view to the arthropod; and

- capture at least one image of at least the first view and the second view of the arthropod. In some embodiments the apparatus also comprises an image capturing element for capturing an image of the arthropod. These and some other aspects are clarified by the following description but it will be apparent to a skilled person that also other embodiments may be implemented within the scope of the present invention. Some advantages may be achieved when using the present invention. For example, in some embodiments images are only taken when there is something new to be imaged and thus energy may be saved compared to prior art systems. Furthermore, more than one viewpoint may be provided of the same arthropod for the imaging wherein the classification and/or identification of the arthropod may be faster and/or more reliable compared to situations in which an image shows the arthropod from only one direction.

Description of the Drawings In the following the present invention will be described in more detail with reference to the appended drawings, in which

Figure 1 depicts a top view of an apparatus according to an example embodiment having one wall removed from a housing;

Figure 2 depicts a cross sectional view of the apparatus of Figure 1 ;

Figure 3 depicts an example situation in which an arthropod has entered the housing of the apparatus;

Figure 4a illustrates an example how a second view of the arthropod may be obtained;

Figure 4b illustrates another example how a second view of the arthropod may be obtained;

Figure 4c illustrates yet another example how some additional views of the arthropod may be obtained; Figure 5a depicts as a circuit diagram some details of the apparatus according to an example embodiment; Figure 5b depicts as a circuit diagram some details of the apparatus according to another example embodiment;

Figures 6a— 6d illustrate examples some images of an arthropod captured by the apparatus;

Figure 7a— 7c depict some details of the apparatus according to an example embodiment; and

Figure 8 depicts a top view of an apparatus according to another example embodiment;

Figure 9 depicts a top view of a housing of an apparatus according to a third example embodiment;

Figures 10a and 10b depict cross sectional views of examples of the cylindrical housing.

Detailed Description of some Example Embodiments

In figure 1 an example embodiment of an apparatus 1 is depicted so that the elements located within the housing 2 can be seen. In this embodiment the housing 2 comprises four inlets 3 through which insects and other arthropods can enter the housing and possibly leave the housing. However, in some other embodiments the number of inlets may also be less than four or more than four. For example, in some embodiments one, two or three inlets may be enough. Also the cross section of the housing 2 need not be rectangular or a square but may also differ from these cross sections. In some embodiments the cross section of the housing 2 may resemble a circle. For example, the housing 2 may be a cylinder. An example of such a cylindrical housing 2 is depicted in Figure 9 as a top view.

Images of the arthropods may be captured by one or more image capturing elements 6 or by some other appropriate means. In this context the term image capturing element is to be interpreted broadly so that the image capturing element 6 may be a CMOS sensor, a CCD sensor, a camera of a mobile phone, a digital camera, etc. In some embodiments the image capturing element 6 is located inside the housing so that the view of the image capturing element 6 i.e. the optical area which may be captured to an image by the image capturing element 6 covers the one or more inlets 3 of the housing. In some other embodiments there may be separate image capturing elements 6 for each inlet 3. In yet some embodiments one wall of the housing 2 may comprise a window 7 through which images may be captured e.g. by a camera of a mobile phone which is put beside the window 7. An example of this is illustrated in Figures 7a— 7c. In Figure 7a the wall of the housing (e.g. a lid) in which the window 7 is located is shown. Figure 7b illustrates how a mobile phone 9 can be located so that the lens 9a of the camera of the mobile phone has a view inside the housing 2 through the window 7.

In some example embodiments the apparatus 1 comprises one or more optical elements 8 so that the arthropod can be viewed from two or more viewing angles. The optical element 8 may be a mirror, a prism or other optical component which reflects and/or refracts optical beams. By means of the optical element(s) 8 the image capturing element 6 is provided with at least two different views. Some examples of this are illustrated in Figures 4a, 4b and 4c. In Figure 4a three different views are illustrated with dotted lines 10a, 10b, 10c. One of the views, e.g. the second view 10b, may represent a direct view to the arthropod whereas the other view(s) 10b, 10c may represent reflected view(s) to the arthropod. When two or more views are formed from the same arthropod it may help the classification and/or identification of the arthropod by an analysing apparatus. Namely, some arthropods may look almost the same when viewed from above (usually the back of the arthropod) but more visible differences may exist on the other side (usually the breast side) or on the sides of the arthropod. In Figure 4b the optical elements 8 are arranged to an angle which is different from the embodiment of Figure 4a to provide some of the views from a different viewpoint as in the embodiment of Figure 4a. Also in Figure 4b three different views are illustrated with dotted lines 10a, 10b, 10c. In Figure 4c the optical elements 8 are arranged to have two different angles wherein even more than two additional views may be obtained. In this example at least five views are provided as illustrated with dotted lines 10a— 10e.

As can be seen from Figures 4a— 4c there may be one or more optical elements. One or more of the optical elements may have a reflecting surface which may be planar, convex or concave, or may comprise two or more sections each having a reflecting surface. Figure 4c illustrates an example of mirrors having a first reflecting section 8c and a second reflecting section 8d in such a way that the surface of the first reflecting section 8c and the surface of the second reflecting section 8d have a different angle with respect to the image sensor and with respect to each other.

In some embodiments the two or more views can be captured by separate camera elements wherein one camera element may capture the first view and another camera element may capture the second view.

The two views captured by one or more image capturing elements 6 may also be called as a three-dimensional (3D) image of the arthropod. In some embodiments one or more of the optical elements 8 may be movable wherein it may be possible to vary the view the optical element 8 provides to the image capturing element 6. In addition to or instead of the image capturing element 6 may be movable and/or rotatable to change the imaging area which the image capturing element 6 sees.

It should be mentioned here that the two or more views need not be views of different parts of the arthropod but they may also be views of the same part of the arthropod but viewed from different directions. For example, both the first and the second view may show a head or a wing of the arthropod but the first view may show the head or the wing from the right side and the second view may show the head or the wing from the left side. When the angle of the optical elements 8 and distance from the image capturing element(s) 6 is known, it is possible to determine counterparts in different views i.e. which points in one view and in another view represent the same part of the arthropod. In the example of Figure 1 the apparatus also comprises one or more sensors 4 at each inlet 3 so that it is possible to detect when an arthropod enters the housing 2. The sensors 4 may be based on optical recognition, a thermal detection, a mechanical detection, on a combination of any of these principles or on another recognition principle. In some example embodiments the sensors 4 are infrared sensors (IR sensors) which may be based on detecting variations in temperature and/or detecting when an infrared beam is blocked by an object. In embodiments in which there are more than one sensor 4 all the sensors need not be similar to each other but they may also be different. For example, one sensor may be an optical sensor and another sensor may be based on thermal detection. Furthermore, the sensors 4 are advantageously located in such a way that the sensors 4 do not react to the movements of the arthropod within the housing 2. In other words, when the arthropod has entered the housing and moves away from the inlet, the sensor 4 at the inlet only reacts when the arthropod has entered the housing and possibly when the arthropod exits the housing.

In some embodiments one or more sensors 4 may be located within the inlet so that the sensor 4 may detect an arthropod when it is within the inlet heading to the inside of the housing. In yet some embodiments one or more sensors 4 may also be totally or partly outside the housing 2 so that the sensors 4 may detect an arthropod when it approaches the housing 2 and possibly enters the housing 2. Positioning one or more of the sensors 4 within the inlet or outside the housing 2 may provide more time for the image capturing element 6 to prepare for the capturing. Hence, the image capturing element 6 is ready for imaging when the arthropod is at a proper location for the imaging.

It may also be possible to mount one or more sensors 4 to the roof of the housing to detect whether there is movement inside the housing 2 or not. In some embodiments no other sensors are needed but in some other embodiments there may be one or more sensors attached with the housing 2 in addition to the sensor at the roof. In some embodiments the image capturing element 6 may be used as the sensor 4. For example, the image capturing element 6 may capture images at intervals and when there is a difference between two or more consecutive images, the image capturing element or another element (e.g. the controller 21 ) which analyses the images may determine that an arthropod is within the housing and one or more images may be captured. In this kinds of embodiments other sensors 4 may not be needed at all. It should be mentioned here that it may not be necessary to examine the whole area of the images but it may be possible to define one or more smaller areas within an image (a.k.a. regions of interest, ROI) which shall be compared with corresponding area(s) of another image(s) to determine whether the contents of this area/these areas is the same or if there exists some differences between images.

Figure 5a depicts as a circuit diagram some details of the apparatus 1 according to an example embodiment. In this example the apparatus 1 comprises a controller 21 which may be, for example, a microprocessor or some other kind of processor capable to execute computer code to cause the apparatus 1 perform certain operations. The apparatus 1 may further comprise input/output logic 22 to interface with sensors 4 and possibly some other elements such as switches, illuminators etc. There is also a camera which may operate as the image capturing element 6, and a memory 23 for storing data and/or computer code. The communication element 24 is intended e.g. for transmitting images and possibly some other data such as date, time, luminosity, location data, wind speed, temperature, etc. to further processing, for example to an analyser 30. The communication element 24 may also be capable to receive commands and/or data from the analyser 30 and/or other apparatuses (not shown). The apparatus 1 may also comprise other circuitry but they need not be described in more detail in this context.

In some embodiments the apparatus 1 may be capable of classification and/or identification of an arthropod wherein the communication element 24 may be used to transmit classification and/or identification data of the arthropod to a receiver. The receiver may be selected on the basis of the classification and/or identification data e.g. in such a way that information on certain type or type(s) of arthropod(s) may be transmitted to a first predetermined receiver or set of receivers and information of another type(s) of arthropod(s) may be transmitted to a second predetermined receiver or set of receivers. Figure 5b depicts as a circuit diagram some details relating to the apparatus 1 according to another example embodiment. In this example the image capturing element 6, the controller 21 , input/output logic 22, the camera, the memory 23, and the communication element 24 are part of another apparatus such as a mobile phone, wherein the mobile phone may receive signals from the sensors 4 and the controller 21 of the mobile phone may perform operations on the basis of the received sensor signals for initiating the image capturing and send captured images and/or other information derived from the captured images for further processing, e.g. to the analyser 30.

In some embodiments the controller 21 of the apparatus or the mobile phone may perform some image analysis before transmitting image information to the analyser 30.

Figure 7c illustrates an example of the operation of an infrared sensor for detecting an arthropod. A transmitter 1 1 of the infrared sensor transmits an infrared beam which is reflected by a wall 12. The reflected infrared beam is detected by a receiver 13 of the infrared sensor. When an arthropod comes to a location in which the arthropod blocks or at least attenuates the infrared beam of the sensor (in other words, the arthropod blocks the transmitted and/or reflected infrared beam) wherein the receiver 13 does not receive the infrared beam or receives an attenuated infrared beam. Hence, the output of the receiver 13 changes which can be used to determine that there is an object (an arthropod) in a vicinity of the sensor 4.

The exact location of the sensors 4 may be adjusted so that possible delays, if any, between the detection of the arthropod and capturing the image can be taken into account. For example, if the image capturing element 6 is set to a power saving mode when no movements have been detected by the sensors 4, it may take some time to exit the power saving mode and to prepare the image capturing element 6 to be ready to capture images. During this time the arthropod may proceed deeper in the housing so that if this delay were not taken into account the captured image might not be properly directed to the arthropod. In some embodiments the operation may be such that when a sensor 4 detects that an arthropod is at a proper location for the image capturing, the image capturing element 6 may begin to capture one or more images as soon as possible, or after a delay.

In some embodiments the apparatus 1 may also estimate the proper capturing time on the basis of signals provided by a sensor 4. For example, when a sensor 4 detects an arthropod an estimate when the arthropod is at a correct location for image capturing may be calculated or determined otherwise.

In some embodiments the floor of the housing may contain some adhesive at the locations of the inlets 3. Hence, arthropods entering the housing 2 may be stuck to adhesive for a while which may reduce the movements of the arthropod during capturing the image and improve the quality of the image. The strength of the adhesive may be selected in such a way that the arthropods are not totally stuck but may release from the effects of the adhesive. In some embodiments the walls of the housing 2 or some of them may comprise adhesive material or the wall may be formed of an adhesive material. This may cause that the arthropods which have been entered the housing may be stuck on a wall by the adhesive, wherein the arthropod may be out of the viewing area of the image capturing element 6 and does not disturb when images of other arthropods will be captured. Furthermore, when arthropods have been stuck to adhesive it may be possible to opening the housing and count the number of arthropods inside the housing 2.

In some embodiments the housing 2 may be formed by bending a paper sheet or a cardboard sheet to a cylindrical form. The sheet may contain some adhesive.

The housing 2 may further be embodied with one or more illuminators 5 to provide more illumination inside the housing 2 when an image is to be captured. The illuminators 5 may be, for example, light emitting diodes (LED) or other appropriate components which are able to provide some illumination inside the housing 2. The illuminators 5 need not usually be operating each time but it may be enough to control the illuminators 5 so that they only illuminate when an image is captured. This may reduce the total energy consumption of the apparatus 1 . In some embodiments the apparatus 1 may comprise an illumination level detector 14, which may be used e.g. to determine if the illumination inside the housing 2 is bright enough for image capturing or if more illumination is needed. In some embodiments the housing 2 may be totally or partly transparent or it may have some parts which are transparent to provide ambient light inside the housing. Hence, illuminators 5 may not be needed or the illuminators 5 may be switched on only if the ambient light does not provide enough illumination for the image capturing.

In some embodiments the walls of the housing are matt white so that the illumination inside the housing is as even as possible and without too bright spots of light. If some areas inside the housing, especially within the view the image capturing element sees, had illumination level which strongly varies, it might make further processing of a captured image more difficult compared to the situation in which the illumination level is as even as possible.

It may also be possible to determine white balance of the imaging area and use the determined value in evaluation of a need for adjusting some parameters which may affect the imaging, for example providing additional illumination, adjusting hue and/or saturation, adjusting intensities of different colour components such as red, green and blue, or adjusting luminosity, chromacity and/or xyz coordinates. The imaging area may contain a reference area which may be used in the determination of the white balance. For example, when the reference area is visible in different images it may be possible to tune one or more of the images so that the reference area of each image may have substantially the same brightness level and/or picture quality. Hence, other details in different images may better correspond with each other and/or classification and/or identification may be more reliable. The determination of the white balance may also be performed during capturing of an image e.g. in such a way that the white balance is determined on the basis of the reference area and if the determination indicates that the illumination level may need to be adjusted, the controller may adjust the brightness of illuminator(s) of the apparatus 1 .

In the example embodiment of Figure 1 the inlets 3 of the apparatus comprise pipes 3a and an expander 3b at the other end of the pipe. One purpose of the expander 3b is to improve arthropod attracting properties of the apparatus and make it easier for the arthropods to go inside the pipe 3a. At the larger opening of the expander 3b there is an opaque or partly transparent plate 3c. The plate 3c prevents direct sun light entering the inlets 3 which might cause erroneous detections of arthropods and/or might also prevent correct detections of arthropods. It is obvious that such plates 3c may not be needed in each situation.

In some embodiments one or more inlet 3 may be a hole on a wall of the housing 2 without any pipes 3a or other tube-like elements.

In some embodiments one or more inlets 3 may be curved or bended so that direct sun light cannot enter the housing 2. Figure 8 depicts an example embodiment of such a structure. In Figure 8 some non-limiting examples of alternative locations for the sensors 4 are depicted.

In some situations it may be useful to use some volatile compounds (e.g. pheromones) to attract insects and other arthropods to enter the housing 2 of the apparatus 1 . For this purpose an object which release such volatile compounds may be put inside the housing 2 wherein released volatile compounds can exit the housing through the inlets 3. Some arthropods may be attracted by some kind of light wherein a suitable illuminator may be installed e.g. into the housing or near the inlets. In addition to or instead of the above mentioned means, some other kinds of attractive apparatuses or materials may be used as well.

When one or more images has been captured they can be transmitted e.g. to a server 13 for analysis. The server 13 may comprise a software program in which information of the images may be examined to determine which kind of arthropod is in question. The analysis may be based on e.g. reference images or other reference information which has been formed beforehand. A histogram or other statistical property or other property of the captured image may be formed and compared with the reference information e.g. to find out which reference information matches best to the captured image. In some embodiments some kind of image filters may also be used in the analysis. In the analysis the species of the arthropod(s) or another classifying criteria may be determined at least partly on the basis of the image information. In some embodiments it may be possible to also use other information in the classification and/or identification. For example, the ambient temperature, the time of day, the time of year etc. may also help to classify the arthropod e.g. when the image information is not sufficient for the classification and/or identification. Hence, some further information may be available which indicates e.g. the time of day certain arthropods are moving or are not moving.

As was described above, in some embodiments of the apparatus 1 at least two different views are formed. It may then be necessary to determine which points in these two (or more than two) views represent each other i.e. are originated from the same location of the arthropod.

In some embodiments it may also be possible to analyze the captured images locally e.g. by the apparatus 1 or the device having a camera which may be used as the image capturing element 6. In these kinds of situations the device may comprise a processor, a memory and software for controlling the operation of the apparatus and for analyzing the captured images. In some embodiments the apparatus 1 may form e.g. a notification when an arthropod or a certain amount of arthropods have entered the apparatus 1 . This notification may be sent to a control room, to a researcher or to some other location to inform that arthropod(s) have entered the apparatus 1 . In yet some embodiments the notification may be formed when the analysis indicates that a certain arthropod has entered the housing. This may be useful e.g. when an existence of e.g. a harmful or rare or common arthropod in a certain area should be find out.

In the following operation of the apparatus 1 according to an example embodiment will be described in more detail. When an arthropod approaches the apparatus 1 a sensor 4 may detect it. For example, if a sensor 4 is positioned inside one inlet 3 and the arthropod enters this inlet the sensor 4 inside the inlet 3 may provide a signal indicative of that an arthropod has entered the inlet 3. The signal may be connected to the input/output logic 22. The input/output logic 22 may generate an interrupt or the controller 21 may poll the status of the input/output logic 22 to detect possible changes in the input lines of the input/output logic 22. Therefore, a signal from a sensor 4 may be detected by the controller 21 which may then determine that one or more images may need to be captured. The controller 21 may examine, on the basis of the signal, which sensor has generated the signal and perform operations defined for that particular sensor 4. For example, the controller 21 may examine whether the image capturing need to be delayed or should the image capturing element 6 begin capture one or more images substantially immediately. The controller 21 may also determine whether additional lighting is needed. This may be performed e.g. by measuring the illumination level inside the housing 2 for example by the illumination level detector 14, wherein the controller 21 may control the illuminators 5 to be switched on for illuminating the housing 2, if the illumination is not bright enough for the image capturing. In some embodiments the controller 21 may control the illuminators 5 to be switched on for illuminating the housing 2 without evaluating the illumination level inside the housing 2.

There may also be more than one illuminator 5 so that each illuminator 5 may illuminate only a part of the inside of the housing 2. Hence, the controller 21 may deduce e.g. on the basis of the sensor which illuminator to use to illuminate at least the arthropod.

In some embodiments different sensors 4 may be located differently and/or may be based on different recognition techniques wherein a shorter or longer delay may be needed before capturing image(s). In some embodiments no delay is need wherein an image may be captured as fast as possible when a sensor detects an arthropod.

In some embodiments the delay may be sensor related wherein signals from different sensors may cause a different delay. The image capturing element 6 may have been switched off or set to a power saving mode when no activity has been detected by the sensors 4. Therefore, the controller 21 may wake-up the image capturing element 6 and set it to a stand-by mode for a while, and after the delay has elapsed the controller 21 may set the image capturing element 6 to a ready state. Alternately, the controller 21 may set the image capturing element 6 directly to the ready state and instruct the image capturing element 6 to capture one or more images.

In some other embodiments the sensors 4 may be able to provide the delay so that the sensor 4 delays the generation of the signal to the input/output logic 22. In this case, the controller 21 may directly set (if necessary) the image capturing element 6 to a ready state and instruct the image capturing element 6 to capture one or more images.

In some embodiments the operation of the apparatus 1 may comprise the following steps. When a sensor 4 detects an arthropod, which is coming into the housing 2, the controller 21 may wake-up the image capturing element 6 and set it to a stand-by mode. Then, there may be another sensor which may be used to determine when the arthropod has moved to a proper location for image capturing i.e. to the imaging area, wherein the controller 21 may switch the image capturing element 6 to the ready state so that the image capturing element 6 captures one or more images.

Figures 6a— 6d illustrate examples of some images 31 of an arthropod 32 captured by the apparatus 1 . In Figure 6a— 6d the images 31 show the first view 31 a above the arthropod 32 formed by a first optical element 8a and the second view below above the arthropod 32 formed by a second optical element 8b. The optical elements 8a, 8b may be mirrors or some other elements able to reflect optical beams.

Figures 10a and 10b depict simplified cross sectional views of some further examples apparatuses 1 having a cylindrical housing 2. The apparatus may comprise a base plate 14 and supporting bars 15 which support the housing 2 above the base plate 14. In these embodiments the circumference of the lower part of the housing 2 forms an inlet 3 wherein an arthropod may come inside the housing practically from any direction e.g. by walking on the base plate 14. The housing 2 may contain the sensor 4 to detect when the arthropod is entering the housing or is at the imaging area inside the housing. There may be one or more optical elements which provides the second view and possible also a third view etc. for the image capturing element 6.

In the embodiment of Figure 10b the surface of the lower edge 2a of the housing 2 is at least partly reflective wherein the reflective surface can be used to form the second view for the image capturing element 6 as is illustrated with dotted lines 10d. The image capturing element 6 may be formed as a stationary element or a movable element, e.g. rotatable around a rotating axes. Hence, different views may be formed by rotating the image capturing element 6.

The apparatus 1 of the present invention can be used in many situations. For example, one or more apparatuses 1 can be located around a field, in an orchard, inside a warehouse, in a vehicle such as a ship transporting fruits, etc. so that the existence of different kinds of arthropods can be examined and classified and/or identified.

In some embodiments the image capturing may also comprise capturing a video or a stream of individual images.

The apparatus 1 may also be useful in vermin control because the apparatus 1 may provide information of existence and spreading of harmful arthropods and may also help Food Agencies, Customs, arthropod researchers etc. In the following some examples are provided. According to a first example there is provided a method for imaging arthropods comprising:

- detecting an arthropod;

- providing a first view to the arthropod;

- providing a second view to the arthropod; and

In some embodiments the method comprises capturing both the first view and the second view to the same image.

In some embodiments the method comprises capturing the first view and the second view to different images. In some embodiments of the method the detecting comprises initiating image capturing when the arthropod has been detected. In some embodiments of the method the detecting comprises one or more of the following:

- detecting when an arthropod is in an inlet of a housing of an apparatus;

- detecting when an arthropod is inside the housing of the apparatus; - detecting when an arthropod approaches the housing of the apparatus;

- detecting when an arthropod is at an inlet of the housing;

- detecting when an arthropod is within an imaging area. In some embodiments the method further comprises:

- determining the amount of illumination inside the housing; and

- illuminating at least a part of the imaging area, if the determining indicates that the amount of illumination is not enough for the image capturing.

In some embodiments the method further comprises determining white balance of the imaging area; and using the determined value in the determining the amount of illumination inside the housing. In some embodiments the method further comprises setting a delay, wherein the image capturing is performed after the delay has elapsed from the detection of the arthropod.

In some embodiments the method further comprises:

- examining if an image capturing element is in a power saving state;

- if so, waiting the duration of said delay and setting the image capturing element to a ready state.

In some embodiments of the method the detection of the arthropod is performed by using image information provided by an image capturing element. In some embodiments the method further comprises forming a notification when one or more arthropods have been detected.

In some embodiments the method further comprises analysing the captured image for classification or identification of the arthropod.

In some embodiments the method further comprises sending the captured image to an analyser for classification or identification of the arthropod. According to a second example there is provided an apparatus comprising:

- means for detecting an arthropod;

- means for providing a first view to the arthropod; and

In some embodiments the apparatus comprises means for capturing both the first view and the second view to the same image.

In some embodiments the apparatus comprises means for capturing the first view and the second view to different images.

In some embodiments the apparatus comprises means for initiating image capturing when the arthropod has been detected. In some embodiments the apparatus comprises a housing having at least one inlet.

In some embodiments of the apparatus the means for detecting comprising one or more of the following:

- means for detecting when an arthropod is in the inlet of the housing of the apparatus;

- means for detecting when an arthropod is inside the housing of the apparatus;

- means for detecting when an arthropod approaches the housing of the apparatus;

- means for detecting when an arthropod is at an inlet of the housing;

- means for detecting when an arthropod is within an imaging area. In some embodiments the apparatus further comprises:

- means for determining the amount of illumination inside the housing; and

- means for illuminating the arthropod, when the means for determining indicate that the amount of illumination is not enough for the image capturing.

In some embodiments the apparatus comprises means for determining white balance of the imaging area; and means for using the determined value in the determining the amount of illumination inside the housing.

In some embodiments of the apparatus the means for initiating image capturing comprises means for setting a delay, wherein the apparatus is adapted to perform the image capturing after the delay has elapsed from the detection of the arthropod.

In some embodiments of the apparatus the means for initiating image capturing comprises:

- means for examining, if an image capturing element is in a power saving state;

- means for waiting the duration of said delay and setting an image capturing element to a ready state, if the image capturing element is in the power saving state.

In some embodiments of the apparatus the means for detecting of the arthropod are located at an inlet of the housing.

In some embodiments of the apparatus the means for detecting the arthropod comprise an image capturing element.

In some embodiments the apparatus further comprises means for forming a notification when one or more the arthropods have been detected. In some embodiments the apparatus further comprises means for analysing the captured image for classification or identification of the arthropod. In some embodiments the apparatus further comprises means for sending the captured image to an analyser for classification or identification of the arthropod. In some embodiments of the apparatus the means for capturing an image comprise a camera of a mobile phone.

In some embodiments of the apparatus the housing comprises at least one wall, wherein at least one wall is at least partly transparent.

According to a third example there is provided an apparatus comprising:

- a sensor for detecting an arthropod;

- an optical element for providing at least a first view to the arthropod; and

- an image sensor for capturing at least one image of at least the first view and a second view of the arthropod.

In some embodiments of the apparatus the optical element is adapted for capturing both the first view and the second view to the same image.

In some embodiments the apparatus comprises:

- a first optical element for capturing the first view to a first image; and

- a second optical element for capturing the second view to a second image.

In some embodiments the apparatus comprises a housing having at least one inlet.

In some embodiments of the apparatus the sensor is adapted to perform one or more of the following:

- detecting when an arthropod is in the inlet of the housing of the apparatus;

- detecting when an arthropod is inside the housing of the apparatus; - detecting when an arthropod approaches the housing of the apparatus.

In some embodiments the apparatus further comprises:

- an illumination level detector for determining the amount of illumination inside the housing; and

- at least one illuminator for illuminating the arthropod.

In some embodiments the apparatus further comprises a mobile phone, wherein the image sensor comprises a camera of the mobile phone.

In some embodiments of the apparatus the optical element is a mirror.

In some embodiments of the apparatus the mirror comprises a first reflecting section for providing the second view; and a second reflecting section for providing a third view, further wherein a surface of the first reflecting section and a surface of the second reflecting section having a different angle with respect to the image sensor.

In some embodiments the apparatus further comprises a second optical element for providing the second view.

According to a fourth example there is provided an apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- detect an arthropod;

- provide a first view to the arthropod;

- provide a second view to the arthropod; and

- capture at least one image of at least the first view and the second view of the arthropod.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to capture both the first view and the second view to the same image. In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to capture the first view and the second view to different images.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to initiate image capturing when the arthropod has been detected.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- detect when an arthropod is in an inlet of a housing of an apparatus; - detect when an arthropod is inside the housing of the apparatus;

- detect when an arthropod approaches the housing of the apparatus;

- detect when an arthropod is at an inlet of the housing;

- detect when an arthropod is within an imaging area. In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- determine the amount of illumination inside the housing; and

- illuminate the arthropod, if the determining indicates that the amount of illumination is not enough for the image capturing.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to determine white balance of the imaging area; and use the determined value in the determining the amount of illumination inside the housing.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to set a delay, wherein the image capturing is performed after the delay has elapsed from the detection of the entering of the arthropod. In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- examine if an image capturing element is in a power saving state; - if so, wait the duration of said delay and set the image capturing element to a ready state.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to detect the arthropod by using image information provided by an image capturing element.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to form a notification when one or more the arthropods have been detected.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to analyse the captured image for classification or identification of the arthropod.

In some embodiments of the apparatus said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to send the captured image to an analyser for classification or identification of the arthropod.

The present invention is not limited to the above described embodiments but may be amended within the scope of the appended claims.

Claims

Claims:

1 . A method for imaging arthropods comprising:

- detecting an arthropod;

- providing a first view to the arthropod;

- providing a second view to the arthropod; and

2. The method according to claim 1 comprising capturing both the first view and the second view to the same image.

3. The method according to claim 1 comprising capturing the first view and the second view to different images.

4. The method according to claim 1 , 2 or 3, the detecting comprising initiating image capturing when the arthropod has been detected.

5. The method according to claim 1 , 2 or 3, the detecting comprising one or more of the following:

- detecting when an arthropod is in an inlet of a housing of an apparatus;

- detecting when an arthropod is inside the housing of the apparatus;

- detecting when an arthropod approaches the housing of the apparatus;

- detecting when an arthropod is at an inlet of the housing;

- detecting when an arthropod is within an imaging area.

6. The method according to claim 5 further comprising:

- determining the amount of illumination inside the housing; and

7. The method according to claim 6, wherein the method further comprises determining white balance of the imaging area; and using the determined value in the determining the amount of illumination inside the housing.

8. The method according to claim 1 , 2, 3, 5, 6 or 7, wherein the method further comprises setting a delay, wherein the image capturing is performed after the delay has elapsed from the detection of the arthropod.

9. The method according to claim 8, wherein the method further comprises:

- examining if an image capturing element is in a power saving state;

10. The method according to any of the claims 1 to 9, wherein the detection of the arthropod is performed by using image information provided by an image capturing element.

1 1 . The method according to any of the claims 1 to 10 further comprising forming a notification when one or more arthropods have been detected.

12. The method according to any of the claims 1 to 1 1 further comprising analysing the captured image for classification or identification of the arthropod.

13. The method according to any of the claims 1 to 12 further comprising sending the captured image to an analyser for classification or identification of the arthropod.

14. An apparatus comprising:

- means for detecting an arthropod;

- means for providing a first view to the arthropod; and

15. The apparatus according to claim 14 comprising means for capturing both the first view and the second view to the same image.

16. The apparatus according to claim 14 comprising means for capturing the first view and the second view to different images.

17. The apparatus according to claim 14, 15 or 16 comprising means for initiating image capturing when the arthropod has been detected.

18. The apparatus according to claim 14, 15 or 16 comprising a housing having at least one inlet.

19. The apparatus according to claim 14, 15, 16 or 18, the means for detecting comprising one or more of the following:

- means for detecting when an arthropod is inside the housing of the apparatus;

- means for detecting when an arthropod is at an inlet of the housing;

- means for detecting when an arthropod is within an imaging area.

20. The apparatus according to any of the claims 14 to 19 further comprising:

- means for determining the amount of illumination inside the housing; and

21 . The apparatus according to claim 20 comprising means for determining white balance of the imaging area; and means for using the determined value in the determining the amount of illumination inside the housing.

22. The apparatus according to any of the claims 14 to 21 , wherein the means for initiating image capturing comprises means for setting a delay, wherein the apparatus is adapted to perform the image capturing after the delay has elapsed from the detection of the arthropod.

23. The apparatus according to claim 22, wherein the means for initiating image capturing comprises:

- means for examining, if an image capturing element is in a power saving state; - means for waiting the duration of said delay and setting an image capturing element to a ready state, if the image capturing element is in the power saving state.

24. The apparatus according to any of the claims 14 to 23, wherein the means for detecting of the arthropod are located at an inlet of the housing.

25. The apparatus according to any of the claims 14 to 24, wherein the means for detecting the arthropod comprise an image capturing element.

26. The apparatus according to any of the claims 14 to 25 further comprising means for forming a notification when one or more the arthropods have been detected.

27. The apparatus according to any of the claims 14 to 26 further comprising means for analysing the captured image for classification or identification of the arthropod.

28. The apparatus according to any of the claims 14 to 27 further comprising means for sending the captured image to an analyser for classification or identification of the arthropod.

29. The apparatus according to any of the claims 14 to 28, wherein the means for capturing an image comprise a camera of a mobile phone.

30. The apparatus according to any of the claims 14 to 29, the housing comprising at least one wall, wherein at least one wall is at least partly transparent.

31 . The apparatus according to any of the claims 14 to 29, the housing comprising at least one wall, wherein at least one wall is at least partly transparent.

32. An apparatus comprising:

- a sensor for detecting an arthropod;

- an optical element for providing at least a first view to the arthropod; and - an image sensor for capturing at least one image of at least the first view and a second view of the arthropod.

33. The apparatus according to claim 32, wherein the optical element is adapted for capturing both the first view and the second view to the same image.

34. The apparatus according to claim 32 comprising:

- a first optical element for capturing the first view to a first image; and - a second optical element for capturing the second view to a second image.

35. The apparatus according to claim 32, 33 or 34 comprising a housing having at least one inlet.

36. The apparatus according to claim 35, wherein the sensor is adapted to perform one or more of the following:

- detecting when an arthropod is in the inlet of the housing of the apparatus;

- detecting when an arthropod is inside the housing of the apparatus;

- detecting when an arthropod approaches the housing of the apparatus.

37. The apparatus according to claim 35 or 36 further comprising:

- at least one illuminator for illuminating the arthropod.

38. The apparatus according to any of the claims 32 to 37 further comprising a mobile phone, wherein the image sensor comprises a camera of the mobile phone.

39. The apparatus according to any of the claims 32 to 38, wherein the optical element is a mirror.

40. The apparatus according to any of the claims 32 to 39, wherein the mirror comprises a first reflecting section for providing the second view; and a second reflecting section for providing a third view, further wherein a surface of the first reflecting section and a surface of the second reflecting section having a different angle with respect to the image sensor.

41 . The apparatus according to any of the claims 32 to 40 further comprising a second optical element for providing the second view.

42. A apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- detect an arthropod;

- provide a first view to the arthropod;

- provide a second view to the arthropod; and

43. The apparatus according to claim 42, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to capture both the first view and the second view to the same image.

44. The apparatus according to claim 42, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to capture the first view and the second view to different images.

45. The apparatus according to claim 42, 43 or 44, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to initiate image capturing when the arthropod has been detected.

46. The apparatus according to claim 42, 43 or 44, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- detect when an arthropod is in an inlet of a housing of an apparatus;

- detect when an arthropod is inside the housing of the apparatus; - detect when an arthropod approaches the housing of the apparatus;

- detect when an arthropod is at an inlet of the housing;

- detect when an arthropod is within an imaging area.

47. The apparatus according to claim 46, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- determine the amount of illumination inside the housing; and

48. The apparatus according to claim 47, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to determine white balance of the imaging area; and use the determined value in the determining the amount of illumination inside the housing.

49. The apparatus according to claim 41 , 42, 43, 45, 47 or 48, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to set a delay, wherein the image capturing is performed after the delay has elapsed from the detection of the entering of the arthropod.

50. The apparatus according to claim 49, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

- examine if an image capturing element is in a power saving state;

- if so, wait the duration of said delay and set the image capturing element to a ready state.

51 . The apparatus according to any of the claims 42 to 50, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to detect the arthropod by using image information provided by an image capturing element.

52. The apparatus according to any of the claims 42 to 51 , said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to form a notification when one or more the arthropods have been detected.

53. The apparatus according to any of the claims 42 to 52, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to analyse the captured image for classification or identification of the arthropod.

54. The apparatus according to any of the claims 42 to 53, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to send the captured image to an analyser for classification or identification of the arthropod.