JP2022106354A - Remote harvesting system - Google Patents

Abstract

To provide a remote harvesting system that allows a customer to easily identify a harvest (such as a crop) from a landscape image acquired remotely.SOLUTION: A first system 1 includes: a harvest side imaging unit 10 that can image a landscape including a harvest; and a harvest side image displaying unit 11 that displays a landscape image imaged by the harvest side imaging unit 10. A second system 3 includes: an image receiving unit 32 that acquires, via communication means, the landscape image imaged by the harvest side imaging unit 10; and a customer side image displaying unit 33 that displays the landscape image received by the image receiving unit 32. The second system 3 further includes: an extraction unit 21 that extracts the harvest in the landscape image imaged by the harvest side imaging unit 10; and an enhancement processing unit 22 that performs, on the basis of extraction information of the extraction unit 21, processing to highlight the image of the harvest in the landscape image extracted by the extraction unit 21. The landscape image displayed by the customer side image display unit 33 is the landscape image in which the harvest is emphatically displayed by the processing of the enhancement processing unit 22 .SELECTED DRAWING: Figure 1

Description

Application for application of Article 30, Paragraph 2 of the Patent Law (1) Toppan Press Release Publication date: October 26, 2nd year of Reiwa Publication address: https://www. toppan. co. jp / news / 2020/10 / newsrelease_201026_1. html (2) Exhibition date: November 15, 2nd year of Reiwa Exhibition name: Osaka Food Lab (inside the apple marche)

The present invention is a technique relating to a remote harvesting system that makes it possible to remotely specify a harvested product and give a harvesting instruction without being at an actual crop harvesting place such as a farm.
In the present invention, for example, an image pickup device is installed in a farm or an orchard where fruits and vegetables are produced, and an image of the photographed crop (harvest) is transmitted to the customer, so that the customer can remotely and pseudo-favorite. It is a technique for gaining the experience of harvesting crops.
In the present specification, the customer is not limited to a general consumer, but refers to a person other than the person who harvests the harvested product.

Traditionally, consumers (non-producers) purchase agricultural products such as fruits and vegetables at retail stores such as supermarkets. In addition, when actually looking at the growing condition of each crop and wanting to obtain a specific crop that they like, the consumer had to go directly to the harvesting place such as a farmer.
On the other hand, Patent Document 1 describes a remote fruit harvesting system that allows consumers and buyers to purchase fruits in a form similar to harvesting fruits while selecting them in a cultivation field such as a greenhouse or an orchard without visiting a grower. Is described. In this conventional system, a general consumer or the like can obtain a desired agricultural product by designating a video ID and a coordinate axis from a remote location using a video.
However, in this conventional technique, it is difficult for an amateur general consumer to understand the existence of the fruit to be selected in the landscape image only from the image of the landscape including the fruit, or the existence of each fruit is difficult to understand. There was a problem that it was difficult to judge whether or not the harvest time was appropriate.

Japanese Unexamined Patent Publication No. 2004-258983

The present invention has been made by paying attention to the above points, and an object of the present invention is to make it easier for a customer to identify a harvested product (agricultural product, etc.) from a landscape image acquired remotely.

In order to solve the problem, one aspect of the present invention is a system in which a first system on the harvester side and a second system on the customer side exchange data via a communication means, and the first system. The second system includes a harvest-side image pickup unit capable of imaging a landscape including a harvested product and a harvest-side image display unit capable of displaying a landscape image captured by the harvest-side image pickup unit. An image receiving unit that acquires a landscape image captured by the harvesting side imaging unit, and a customer-side image display unit that displays the landscape image received by the image receiving unit are provided, and further, the harvesting side imaging unit is provided. Based on the extraction information of the extraction unit that extracts the harvested product in the landscape image captured by the image, the image of the harvested product is highlighted on the landscape image that the extraction unit has extracted. It is a remote harvesting system that has a highlighting processing unit and the landscape image displayed by the customer side image display unit is a landscape image in which the harvested product is highlighted by the processing of the highlighting processing unit. be.

Further, another aspect of the present invention is a server used in the remote harvesting system having the above configuration and mediating data transfer between the first system and the second system, and the harvesting side imaging unit captures images. It is provided with an image providing unit that receives the landscape image and provides the received landscape image to the second system, and also has the extraction unit and the enhancement processing unit. The image providing unit includes the extraction unit and the enhancement processing unit. This is a server for a remote harvesting system that provides a second system with a landscape image that has been processed by the emphasis processing unit.

According to the aspect of the present invention, it becomes easy for the customer to identify each harvested product to be selected in the landscape image acquired via the communication means from the landscape image.
As a result, according to the object of the present invention, for example, even a general consumer can easily determine the existence of agricultural products and the appropriate harvest time.

It is a figure which shows the structure of the remote harvesting system which concerns on embodiment based on this invention. It is a figure which shows the structure of the 1st system which concerns on embodiment based on this invention. It is a figure which shows the structure of the server which concerns on embodiment based on this invention. It is a figure which shows the structure of the 2nd system which concerns on embodiment based on this invention. It is a figure which shows the example of the landscape image displayed on the customer side image display part made of a tablet or the like. It is a figure which shows the other structure of the 2nd system which concerns on embodiment based on this invention.

Next, an embodiment will be described in the present invention.
Here, the same components will be described with the same reference numerals unless there is a reason for convenience. Further, in each drawing, each component may be exaggerated and described, and the concept of the component may be shown differently from the actual system. Further, the present invention is not limited to the following embodiments, and can be embodied by appropriate combinations and modifications as long as the gist of the present invention is not deviated. Can be included.

In the example described below, mainly the case where the harvested product is an apple, which is a kind of agricultural product, will be described as an example.
However, the crops targeted by the present invention are not limited to crops consisting of trees such as apples, and may be crops such as strawberries and Chinese cabbage near the ground. Further, the harvested product is not limited to agricultural products, and may be animals such as livestock, fish, eggs, and native mushrooms.
Further, in the present embodiment, the harvested product to be imaged is a harvested product before harvesting, but the present invention may target a landscape including post-harvest agricultural products such as dug up sweet potatoes.

As shown in FIG. 1, the remote harvesting system of the present embodiment includes a first system 1, a second system 3, and a server 2, and the first system 1 and the second system 3 are wireless. It is a system that exchanges data via communication means.
The first system 1 is a system provided on the farmer side (harvester side).
The second system 3 is a system on the customer side that selects an apple (harvest) from the received landscape image and gives a harvest instruction to the first system 1. The customer may be a general consumer who wants to purchase the harvested product, or may be a farmer's manager.
The server 2 is a system that mediates the exchange of data between the first system 1 and the second system 3. The server 2 may be integrated into the first system 1.

<First system 1>
As shown in FIG. 2, the first system 1 includes a harvest side image pickup unit 10, a harvest side image display unit 11, a harvest product identification unit 12, a notification unit 14, and a harvest side communication unit 13.
[Harvest side imaging unit 10]
The harvest side imaging unit 10 is a device capable of imaging a landscape including a harvested product. The harvest side imaging unit 10 is composed of a smart glass camera unit, a mobile camera, a camera unit of a mobile terminal, and the like. It may have two or more harvest side imaging units 10.
For example, the harvested product imaging unit continuously transmits a still image (landscape image) continuously captured at a frame rate of 5 fps to the server 2 via the harvesting side communication unit 13, and harvests the landscape image. It is supplied to the side image display unit 11. The captured landscape image may be stored in a storage unit (not shown). The captured landscape image shall be a color image. It may be a 3D image. Further, the landscape image to be transmitted is not limited to these, and a so-called moving image having a frame rate of 30 fps or more may be used.

In the present embodiment, it is assumed that the harvester possesses an apparatus having the harvesting side imaging unit 10 and moves while projecting the apple to be harvested. The harvester may be moved by wearing the harvesting side imaging unit 10 while walking, or by attaching the harvesting side imaging unit 10 to a car, cart, or the like.

[Harvest side image display unit 11]
The harvest side image display unit 11 is a display device that displays a landscape image acquired from the harvest side image pickup unit 10. There may be two or more harvest side image display units 11. In the present embodiment, the case where the harvest side image display unit 11 is moved together with the harvest side image display unit 10 is illustrated, but the harvest side image display unit 11 may be held by a person other than the harvest side image display unit 10. ..
The harvest side image display unit 11 displays, for example, the latest landscape image acquired by the harvest side image pickup unit 10. Further, for example, the harvest side image display unit 11 may be able to display the landscape image selected by the second system 3 together with the latest landscape image.
The harvest side image display unit 11 is composed of a smart glass display unit, a mobile terminal display unit, and the like.

[Harvest identification part 12]
Based on the position identification information of the harvested product transmitted by the position information transmitting unit 35 of the second system 3, the harvested product specifying unit 12 transmits the harvested product specific information corresponding to the position identification information to the harvesting side image display unit 11. Perform the display process.
For example, the harvested product identification unit 12 may display a landscape image selected by the second system 3 (referred to as a first landscape image) or the latest landscape image (second landscape) displayed by the harvest side image display unit 11. A process of superimposing (adding) a pointer image on the position of the harvested product specified by the above-mentioned position specifying information is executed for (referred to as an image). In this case, the pointer image becomes the specific information of the harvested product.
Here, as the first landscape image, the landscape image sent to the second system 3 stored by the first system 1 can be used.

For example, information (pointer, etc.) according to the position identification information from the customer is projected on the lens of the smart glass, and it appears to overlap with the visual information actually seen by the harvester wearing the smart glass. You may perform the process as follows. In this case, in order to synchronize (align) the image on the customer side with the view seen through the lens by the harvester at that time, the pointer is projected onto the lens of the smart glass after correcting the coordinate axes. do.

When the position identification information of the apple (harvest) is universal coordinates, the position of the designated apple in the landscape image may be specified from the universal coordinates of the specific position of the landscape image currently being displayed. If the position identification information of the apple is, for example, the image identification information for specifying the landscape image in which the apple is specified and the position information of the specified apple in the landscape image, the above-mentioned specific image identification information and the current landscape image are used. The position of the apple in the current landscape image is specified by the interpolation of. Alternatively, the position of the apple may be displayed on the specific landscape image and displayed separately from the current landscape image.

Here, when the first landscape image is used, it may be realized by superimposing the coordinates of the pointer acquired from the second system 3 on the image stored by the first system 1 (because it is the same image).
When the second landscape image is used, it can be realized by using a method of performing image alignment processing. For example, the following method may be used.
That is, the difference between the image of a plurality of frames before (the image sent to the tablet) and the current image is calculated on the smart glasses side (first system 1), the tablet side (second system 3), or the server 2. In consideration of the result, a process of moving the pointer coordinates is performed, and the pointer is superimposed on the second landscape image. Differences between images can be performed by known image processing. At this time, the process of "moving the pointer" may be performed, or the process of fixing the coordinates of the pointer and "moving the image itself" may be performed.

If high-precision GPS is used, the GPS information of the reference image, the acceleration sensor of the first terminal, and the like can be saved together with the reference image, and the information of the GPS and the acceleration sensor of the reference image and the current image can be used. It is possible to calculate the relative positional relationship and calculate how much the image is misaligned even if the images do not overlap at all. For example, if the current image is moved a little further to the left, it will be left if it overlaps with the reference image. It is also possible to display a display that urges the person to move to, and display the pointer information in an overlapping manner when they overlap on the screen.

In addition, when the server processes, the image received from the smart glasses side (in the case of a moving image, the still image cut out) is saved in the server as a reference image, the reference image is processed and sent to the customer tablet, and the customer Only the coordinate information of the specific information may be acquired from the tablet, processed by superimposing it on the reference image, and transmitted to the smart glasses, and the smart glasses may be simply projected. In reality, it is preferable to access the server and display the image without sending it to the smart glasses. By the way, it is also possible to physically set the base point information of the point at the harvesting place (consisting of a pole or the like) and display it as a position from the set base point information on the captured image.
The work of superimposing the landscape image and the pointer does not have to be performed in the first system, and the landscape image and the pointer may be superposed on the second system and transmitted to the first system.
Further, apart from the smart glasses, a tablet may be provided as the harvest side image display unit 11.

[Notification unit 14]
When the first system 1 acquires the above-mentioned position identification information, the notification unit 14 notifies the stop instruction. The notification instruction notifies the operator of the harvest side image display unit 11 by voice, for example, "Please stop". A warning image such as "pause" may be displayed on the harvest side image display unit 11.
This makes it possible to increase the possibility that the apple selected by the customer is reflected in the latest landscape image captured by the harvesting side imaging unit 10.
<Server 2>
As shown in FIG. 3, the server 2 includes an image providing unit 20 and a database 24. The server 2 of the present embodiment further includes an extraction unit 21, an emphasis processing unit 22, and an information addition unit 23.

[Image providing unit 20]
The image providing unit 20 receives the landscape image captured by the harvesting side imaging unit 10 and performs a process of providing the received landscape image to the second system 3. The received image is appropriately stored in the database 24.
The image providing unit 20 has processed the landscape image in which the processing of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23 has been executed by the processing of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23. The landscape image of the above is provided to the second system 3 as the received landscape image.

[Extractor 21]
The extraction unit 21 executes a process of extracting the harvested product in the landscape image captured by the harvesting side imaging unit 10.
The extraction unit 21 of the present embodiment executes a process of extracting the harvested product in the landscape image from the landscape image received by the image providing unit 20.
In the extraction unit 21 of the present embodiment, the apple in the image is extracted by designating the range of the numerical value of HSV based on the color of the apple (red: the color expressing the maturity). For the extraction of the harvested product, a known extraction technique such as extraction based on the judgment based on the contour may be used.

When the color of the harvested product, such as apples, tomatoes, grapes, pears, and mandarins, is significantly different from the surrounding background, it is preferable to extract using color information. Furthermore, the accuracy can be improved by combining the shape information of the contour. Further, when the object has a temperature different from that of the surroundings, a temperature sensor may be combined and the temperature information may be used for extraction.
Here, apples may be extracted from landscape images based on machine learning, or apple maturity and the like may be displayed (differentiation information is displayed) from apple images.
In the landscape image, the partially visible apple may be treated as one apple only in the partially exposed part, or the apple is extracted by presuming that the shape of the apple is restored. You may try to do it.

[Emphasis processing unit 22]
Based on the extraction information of the extraction unit 21, the highlighting unit 22 performs a process of highlighting the image of the harvested product on the landscape image extracted by the extraction unit 21.
The highlighting processing unit 22 of the present embodiment executes a process of highlighting the harvested product in the landscape image with respect to the landscape image received by the image providing unit 20.
As the highlighting, for example, as shown in FIG. 5, the landscape image displayed on the display unit of the tablet 4 is highlighted by surrounding the extracted apple 101 with a frame 102, or a landscape other than the extracted apple 101 (background). ) Is highlighted by changing from a color image to a black-and-white image or by making it entirely white or gray, or by annotating that it is an apple. As a result, a highlighting process is performed in which selectable apples are raised.
Other highlights may be, for example, the frame surrounding the apple swaying, moving, changing color, or blinking. Further, the extracted apple (harvest) may be anthropomorphized so that a balloon may be emitted from the apple or the apple may be given a facial expression.

[Information Addition Unit 23]
The information addition unit 23 executes a process of adding selection determination information to each apple (harvest) in the landscape image to the landscape image extracted by the extraction unit 21.
For example, the area of red (the color of the mature part of the agricultural product) in the frame surrounding the extracted apple is calculated, and the calculated area is linked to the frame to display numbers (see reference numeral 103 in FIG. 5, in FIG. 5). Numbers are omitted). Based on the calculated area, the numbers in the order of apples having the largest area in the landscape image may be displayed as selection determination information, or the selection information may be displayed at the position of reference numeral 103 by color classification. This information serves as apple selection judgment information (differentiation information).

As the judgment information (differentiation information) for selecting another harvest, for example, the following can be exemplified.
-Emphasize the trauma of each apple by image recognition.
-By image recognition, rank by shape.
-Estimate the chlorophyll content from light transmission and display the maturity.
-The Brix value of near-infrared light is estimated from the light transmission, and the sugar content is displayed.
-Displays the dense state of apples from light transmission.
-Displays the state of internal browning inside the apple from light transmission.
-Displays apple scent information using the information acquired by the scent sensor.
-Use the information acquired by the ultrasonic sensor to display the sound information when hit.
-Display temperature (thermo) information if the harvest is based on temperature.
-Display information on the texture of the harvested product using the information acquired by the friction sensor.

In this case, it is preferable to provide a glove or the like that conveys the sense of touch on the second system side.
In addition, as the determination information (differentiation information) for selecting a harvested product, the determination information (differentiated information) of the harvested product may be presented according to the target harvested product.
The processing of the extraction unit 21, the emphasis processing unit 22, and the information addition unit 23 may be performed by the second system 3 as shown in FIG. 6, and may be executed by the second system 3. The first system 1 may have it.

<Second system 3>
The second system 3 is composed of tablet and PC applications.
As shown in FIG. 4, the second system 3 includes a customer-side communication unit 31, an image receiving unit 32, a customer-side image display unit 33, a harvest product designation unit 34, and a position information transmission unit 35.
The customer-side communication unit 31 transfers data to and from the server 2 via the communication means.

[Image receiver 32]
The image receiving unit 32 acquires a landscape image captured by the harvesting side imaging unit 10 from the server 2 via the customer side communication unit 31.
[Customer side image display unit 33]
The customer-side image display unit 33 displays the landscape image received by the image receiving unit 32.
Here, the landscape image acquired by the image receiving unit 32 is a landscape image after the processing of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23 is performed, but the landscape image is not limited to this.
For example, from the landscape images continuously acquired by the image receiving unit 32 and continuously displayed by the customer side image display unit 33, a specific landscape image is specified by the customer's selection, and the specified image information is transmitted to the server 2 side. The processing of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23 is executed only for the specified landscape image, and the image receiving unit 32 retransmits the processed shaped image from the server 2 side. It may be a configuration to be acquired.

[Harvest Designation Unit 34]
The harvest product designation unit 34 executes a process of selecting a specific harvest product in the image from the landscape image displayed by the customer side image display unit 33.
For example, when the harvest material designation unit 34 determines that a specific apple (harvest product) in a continuously changing landscape image is touched by a stick 5 or the like as shown in FIG. 5, the touched apple is selected. Judged as

[Location information transmitter 35]
When the position information transmission unit 35 determines that the harvest has been selected by the harvest designation unit 34, the position information transmission unit 35 determines that the coordinates of the selected harvest (coordinates of the contact positions in the landscape image) are selected by the harvest designation unit 34. As the position identification information of the object, it is transmitted to the first system 1 via the communication means.
The coordinates are preferably universal coordinates from the starting point of the specific position of the harvesting place. For example, the universal coordinates of the specified apple are calculated from the universal coordinates of the specified image of the apple. Further, the position-specific information of the harvested product may be composed of, for example, image-specific information for specifying a landscape image in which an apple is designated, and relative position information of the designated harvested product in the landscape image.

Here, as described above, the server may process the process of superimposing the pointer image on the landscape image using the first or second landscape image.
When the first landscape image is used, it is realized by superimposing the coordinates of the pointer acquired from the second system 3 on the image received from the first system 1 and stored in the database 24.
When the second landscape image is used, for example, the difference between the image of a plurality of frames before (the image sent to the tablet) and the current image is calculated by the server 2 and processed by moving the pointer coordinates in consideration of the result. .. Differences between images can be performed by known image processing. At this time, the process of "moving the pointer" may be performed, or the process of fixing the coordinates of the pointer and "moving the image itself" may be performed.

Then, when the server 2 processes, the image received from the smart glasses side (in the case of a moving image, the still image cut out) is saved in the server 2 as a reference image, the reference image is processed, and the image is transmitted to the customer tablet. , Only the coordinate information of the specific information is acquired from the customer's tablet, processed by superimposing it on the reference image, and transmitted to the smart glasses, and the smart glasses may be simply projected. In reality, it is preferable to access the server and display the image without sending it to the smart glasses. By the way, it is also possible to physically set the base point information of the point at the harvesting place (consisting of a pole or the like) and display it as a position from the set base point information on the captured image.

(Operation and others)
In the present embodiment, the harvester continuously images the landscape including the harvestable apples by the harvesting side imaging unit 10, and the captured landscape images are continuously presented to the customer side.
The customer looks at the landscape images continuously displayed on the customer side image display unit 33, and when he / she finds the apple he / she wants, he / she selects the apple by touching the apple with his / her finger or the stick 5. When an apple is selected, the selection is transmitted to the first system 1, the harvester is notified that the apple has been selected, and the information on the selected apple is displayed on the harvesting side image display unit. Specified by 11. The harvester then harvests the selected apples.

In the present embodiment, a landscape image highlighting selectable apples is provided to the customer side. As a result, it becomes easy to visually recognize each apple in the continuously changing landscape image, and it becomes easy to specify the apple.
Further, in the present embodiment, since the differentiation information is given to each apple, the customer can also obtain a judgment criterion as to which apple should be selected, which makes it easier to select the apple. ..
This makes it easier for general consumers to visually recognize the presence of apples in the changing landscape images, and customers (general consumers) prefer it remotely based on the continuously sent landscape images. It is possible to give instructions for harvesting apples.

For example, by displaying information on each red area, the maturity state and size of apples are presented to the customer as apple selection information.
In addition, when the customer selects an apple, the harvester is notified of the stop instruction so that the apple selected by the customer is positioned in the landscape image currently being captured, and the apple can be specified more accurately. It is possible to harvest the apples that have been harvested.
In addition, before harvesting, an inquiry "whether or not to harvest this apple" may be sent from the first system 1 to the second system 3 so that the designated apple can be harvested more reliably.

Here, the above description exemplifies a case where real images are continuously transmitted and a customer remotely selects an apple from a synchronized landscape image, but the present invention is not limited to this.
That is, it is not always necessary to synchronize the landscape images between the first system 1 and the second system 3. For example, landscape images are captured by the first system 1 in predetermined time (for example, several hours) units and sequentially stored in the database 24 of the server 2, and stored in the database 24 in the second system 3. The landscape images may be sequentially received and the apple selection process may be executed. In this case, the customer can take the time to select the apple at his / her favorite time.

Further, when the apple is selected, the harvester is notified of the stop instruction so that the selected apple is positioned in the current landscape image. As a result, it is possible to harvest the designated apples with higher accuracy. In the above description, the stop instruction (specific information of the apple) is transmitted to the first system 1 side when the apple is specified, but the present invention is not limited to this. For example, before the selection of the apple, when the customer recognizes the landscape image to select the apple, the first system 1 side may be instructed to stop the position of the image acquisition to be imaged.

As a result, the customer instructs the harvester not to move the harvesting side imaging unit 10 such as smart glasses, so that the current landscape image captured by the harvester (smart in the case of smart glasses). It is possible to reduce the discrepancy between the field of view that the glass wearer sees realistically) and the landscape image of apple selection.
At this time, for example, the current real image may be projected on the right eye side of the smart glass, and the landscape image in which the apple is selected may be projected on the left eye side.
Further, as the harvesting side image display unit 11 on the harvester side, a tablet may be provided in addition to the smart glasses. That is, there may be two or more harvest side image display units 11.
Further, on the harvester side, the harvester having the harvest side image pickup unit 10 and the harvester looking at the harvest side image display unit 11 may be different persons.

(others)
In this embodiment, the following configuration can also be adopted.
(1) A system in which a first system 1 on the harvester side and a second system 3 on the customer side exchange data via a communication means, and the first system 1 is a landscape including a harvested product. The second system 3 includes a harvest-side image pickup unit 10 capable of imaging the image, and a harvest-side image display unit 11 capable of displaying a landscape image captured by the harvest-side image pickup unit 10. An image receiving unit 32 that acquires a landscape image captured by the harvesting side imaging unit 10 and a customer side image display unit 33 that displays the landscape image received by the image receiving unit 32 are further provided. Based on the extraction information of the extraction unit 21 that extracts the harvested product in the landscape image captured by the unit 10 and the extraction information of the extraction unit 21, the image of the harvested product is emphasized with respect to the landscape image that the extraction unit 21 has extracted. The landscape image displayed by the customer-side image display unit 33, which has a highlighting processing unit 22 for displaying, is a landscape image in which the harvested product is highlighted by the processing of the highlighting processing unit 22. A remote harvesting system featuring.

(2) The harvesting side imaging unit 10 is a remote harvesting system characterized in that the landscape including the harvested product before harvesting is imaged.
(3) The landscape image is a color image, and the highlighting is performed by making an image other than the harvested product in the landscape image into a black-and-white image, displaying the harvested product in a frame, or adding an annotation. A remote harvesting system featuring.
(4) Further, the information addition unit 23 for adding the selection determination information of each harvested product in the landscape image to the landscape image is provided, and the selection determination information is added to the landscape image displayed by the customer side image display unit 33. A remote harvesting system characterized by being a landscape image.

(5) In the second system 3, the harvest product designation unit 34 that selects a specific harvest product in the landscape image from the landscape image displayed by the customer side image display unit 33, and the harvest product designation unit 34. The first system 1 includes a position information transmission unit 35 that transmits the position identification information of the harvested product selected by the above to the first system 1 via a communication means, and the first system 1 is transmitted by the position information transmission unit 35. A remote harvesting system including a harvesting identification unit 12 that displays the harvesting specific information corresponding to the position identification information on the harvesting side image display unit 11 based on the position identification information of the harvested product.

(6) The harvested product specifying unit 12 is a remote harvesting system characterized in that the specific information of the harvested product is added to the landscape image displayed on the harvesting side image display unit 11.
(7) The first system 1 is a remote harvesting system including a notification unit 14 that notifies a stop instruction when the position identification information is acquired.
(8) The remote harvesting system, wherein the extraction unit 21 and the emphasis processing unit 22 are included in the second system 3.

(9) The server 2 has a server 2 that mediates the exchange of data between the first system 1 and the second system 3, and the server 2 receives and receives a landscape image captured by the harvesting side imaging unit 10. The image providing unit 20 for providing the landscape image to the second system 3 is provided, the extraction unit 21 and the enhancement processing unit 22 are provided on the server 2, and the image providing unit 20 is the extraction unit 21. A remote harvesting system, characterized in that the landscape image processed by the enhancement processing unit 22 is provided to the second system 3.

(10) A server used in the remote harvesting system described above that mediates the exchange of data between the first system and the second system, and receives a landscape image captured by the harvesting side imaging unit. The image providing unit that provides the received landscape image to the second system is provided, and the extraction unit and the enhancement processing unit are provided. The image providing unit is processed by the extraction unit and the enhancement processing unit. A server for remote harvesting systems that provides processed landscape images to a second system.

1 First system 2 Server 3 Second system 4 Tablet 5 Stick 10 Harvest side image display unit 11 Harvest side image display unit 12 Harvest product identification unit 13 Harvest side communication unit 14 Notification unit 20 Image providing unit 21 Extraction unit 22 Emphasis processing Part 23 Information addition part 24 Database 31 Customer side communication part 32 Image receiving part 33 Customer side image display part 34 Harvest designation part 35 Position information transmission part 101 Apple 102 Frame

Claims (9)

The first system on the harvester side and the second system on the customer side exchange data via communication means.
The first system includes a harvest side image pickup unit capable of capturing a landscape including a harvested product, and a harvest side image display unit capable of displaying a landscape image captured by the harvest side image pickup unit.
The second system includes an image receiving unit that acquires a landscape image captured by the harvesting side imaging unit and a customer-side image display unit that displays the landscape image received by the image receiving unit via a communication means. Prepare,
Further, an extraction unit that extracts the harvested material in the landscape image captured by the harvesting side imaging unit,
Based on the extraction information of the extraction unit, the extraction unit has a highlighting processing unit that highlights the image of the harvested product on the landscape image that has been extracted.
The landscape image displayed by the customer-side image display unit is a landscape image in which the harvested product is highlighted by the processing of the highlighting processing unit.
A remote harvesting system that features that. The landscape image is a color image, and the highlighting is characterized by making an image other than the harvested product in the landscape image into a black-and-white image, displaying the harvested product in a frame, or adding an annotation. The remote harvesting system according to claim 1. Further, it is provided with an information addition unit that adds selection judgment information of each harvested product in the landscape image to the landscape image.
The remote harvesting system according to claim 1 or 2, wherein the landscape image displayed by the customer-side image display unit is a landscape image to which the selection determination information is added. In the second system, a harvest material designation unit that selects a specific harvest product in the landscape image from the landscape image displayed by the customer side image display unit, and a position of the harvest product selected by the harvest product designation unit. A location information transmission unit that transmits specific information to the first system via a communication means is provided.
In the first system, based on the position identification information of the harvested product transmitted by the position information transmitting unit, the harvested product identification unit that displays the harvested product identification information corresponding to the position identification information on the harvesting side image display unit. To prepare
The remote harvesting system according to any one of claims 1 to 3, wherein the remote harvesting system is characterized in that. The remote harvesting system according to claim 4, wherein the harvested product specifying unit adds specific information on the harvested product to a landscape image displayed on the harvesting side image display unit. The remote harvesting system according to claim 4 or 5, wherein the first system includes a notification unit that notifies a stop instruction when the position identification information is acquired. The remote harvesting system according to any one of claims 1 to 6, wherein the extraction unit and the emphasis processing unit are included in the second system. It has a server that mediates the exchange of data between the first system and the second system.
The server includes an image providing unit that receives a landscape image captured by the harvesting side imaging unit and provides the received landscape image to the second system.
The extraction unit and the emphasis processing unit are provided on the server.
The image providing unit provides the landscape image processed by the processing in the extraction unit and the enhancement processing unit to the second system.
The remote harvesting system according to any one of claims 1 to 7, wherein the remote harvesting system is characterized. A server used in the remote harvesting system according to any one of claims 1 to 8 and mediating data transfer between the first system and the second system.
It includes an image providing unit that receives the landscape image captured by the harvesting side imaging unit and provides the received landscape image to the second system, and also has the extraction unit and the enhancement processing unit.
The image providing unit is a server for a remote harvesting system that provides a landscape image processed by the extraction unit and the enhancement processing unit to a second system.

Images