JP7156412B2 - remote harvesting system - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act (1) Toppan Press Release Posting date: October 26, 2020 Posting address: https://www. toppan. co. jp/news/2020/10/newsrelease_201026_1. html (2) Exhibition date: November 15, 2020 Exhibition name: Osaka Food Lab (inside Apple Marche)

The present invention relates to a remote harvesting system that enables a user to remotely designate a harvested product and issue a harvesting instruction without being at a crop harvesting place such as an actual farm.
In the present invention, for example, an imaging device is installed in a farm where fruits and vegetables are grown, an orchard, etc., and an image of crops (harvested products) photographed is transmitted to the customer, so that the customer can remotely simulate the desired image. It is a technique for experiencing harvesting crops.
In this specification, the customer is not limited to a general consumer, and refers to a person other than a harvester.

Conventionally, consumers (non-producers) purchase agricultural products such as fruits and vegetables at retail stores such as supermarkets. In addition, when consumers want to actually see the growth state of individual crops and obtain a particular crop they like, they have to go directly to a harvesting place such as a farmer.
On the other hand, in Patent Document 1, a remote fruit harvesting system that allows consumers and buyers to purchase fruits in a manner similar to harvesting fruits while selecting them in a cultivation field such as a greenhouse or an orchard without going to a cultivation farm. is described. In this conventional system, a general consumer or the like can obtain a desired agricultural product by specifying a video ID and coordinate axes from a remote location using video.
However, in this prior art, it is difficult for general consumers who are amateurs to understand the presence of fruits to be selected in the landscape image only from the image of the scenery including the fruits, and the image of each fruit is difficult to understand. There was a problem that it was difficult to judge whether it was a proper harvest time.

JP-A-2004-258983

The present invention has been made in view of the above points, and an object of the present invention is to make it easier for a customer to identify crops (such as crops) from a landscape image obtained remotely.

To solve the problem, one aspect of the present invention is a system in which a first system on the harvester side and a second system on the customer side exchange data via communication means, wherein the first system comprises a harvesting-side imaging section capable of imaging a landscape including harvested products, and a harvesting-side image display section capable of displaying the landscape image captured by the harvesting-side imaging section, wherein the second system comprises communication means and a customer side image display unit for displaying the landscape image received by the image receiving unit, and further comprising: the harvesting side imaging unit an extracting unit for extracting the crops in the landscape image captured by the above, and based on the extraction information of the extracting unit, the landscape image extracted by the extracting unit is processed to highlight the image of the crops. and an emphasis processing unit, wherein the landscape image displayed by the customer-side image display unit is a landscape image in which harvested products are highlighted by the processing of the emphasis processing unit. be.

Another aspect of the present invention is a server that is used in the remote harvesting system configured as described above and mediates transmission and reception of data between the first system and the second system, wherein the harvesting-side imaging unit captures and an image providing unit for receiving the landscape image received from the landscape image and providing the received landscape image to the second system, the extracting unit and the enhancement processing unit, wherein the image providing unit includes the extracting unit and the A server for a remote harvesting system that provides a second system with a landscape image processed by the enhancement processing unit.

According to the aspect of the present invention, it becomes easier for the customer to specify each crop to be selected from the landscape image acquired via the communication means.
As a result, according to the object of the present invention, for example, even general consumers can easily judge the presence of agricultural products and the appropriate harvest time.

It is a figure showing composition of a remote harvesting system concerning an embodiment based on the present invention. It is a figure which shows the structure of the 1st system based on embodiment based on this invention. It is a figure which shows the structure of the server based on embodiment based on this invention. It is a figure which shows the structure of the 2nd system based on embodiment based on this invention. FIG. 10 is a diagram showing an example of a landscape image displayed on a customer-side image display unit such as a tablet; FIG. 10 is a diagram showing another configuration of the second system according to the embodiment based on the present invention;

Next, embodiments of the present invention will be described.
Here, the same components will be described with the same reference numerals unless there is a reason for convenience. In addition, in each drawing, each component may be exaggerated, and the concept of the component may be illustrated differently from the actual system. In addition, the present invention is not limited to the following embodiments, and can be embodied by appropriate combinations and modifications as long as they do not deviate from the gist of the invention. can be included.

In the example described below, a case where the harvested product is apples, which is a type of crop, will be mainly described as an example.
However, the harvested products targeted by the present invention are not limited to agricultural crops that grow on trees such as apples, and may be agricultural crops such as strawberries and Chinese cabbage that grow near the ground. Harvested products are not limited to agricultural products, and may be animals such as livestock, fish, eggs, wild mushrooms, and the like.
Also, in the present embodiment, harvested products to be imaged are harvested products before harvesting, but in the present invention, scenery including harvested crops such as dug up sweet potatoes may also be imaged.

As shown in FIG. 1, the remote harvesting system of this embodiment includes a first system 1, a second system 3, and a server 2. It is a system that exchanges data via communication means.
The first system 1 is a system provided on the farm side (harvester side).
The second system 3 is a customer side system that selects apples (harvested products) from the received landscape image and instructs the first system 1 to harvest them. The customer may be a general consumer who wants to purchase harvested products, or may be a manager of a farm.
The server 2 is a system that mediates the exchange of data between the first system 1 and the second system 3 . Server 2 may be integrated into first system 1 .

<First system 1>
The first system 1 includes, as shown in FIG. 2, a harvest-side imaging unit 10, a harvest-side image display unit 11, a harvest identification unit 12, a notification unit 14, and a harvest-side communication unit 13.
[Harvesting side imaging unit 10]
The harvesting-side imaging unit 10 is a device capable of imaging scenery including harvested products. The harvesting-side imaging unit 10 includes a camera unit of smart glasses, a mobile camera, a camera unit of a mobile terminal, and the like. Two or more harvesting-side imaging units 10 may be provided.
The harvest imaging unit continuously transmits still images (scenery images) continuously captured at a frame rate of, for example, 5 fps to the server 2 via the harvesting side communication unit 13, and also transmits the scenery images to the harvesting side. It is supplied to the side image display section 11 . A captured landscape image may be stored in a storage unit (not shown). The captured landscape image is assumed to be a color image. It may be a 3D image. Also, the landscape image to be transmitted is not limited to these, and a so-called moving image with a frame rate of 30 fps or higher may be used.

In the present embodiment, it is assumed that a harvester carries a device having the harvesting-side imaging unit 10 and moves while capturing apples to be harvested. The harvester may move by walking while wearing the harvesting-side imaging unit 10, or by attaching the harvesting-side imaging unit 10 to a car, cart, or the like.

[Harvesting side image display unit 11]
The harvesting-side image display section 11 is a display device that displays the landscape image acquired from the harvesting-side imaging section 10 . There may be two or more harvesting-side image display units 11 . In the present embodiment, a case where the harvesting-side image display unit 11 is moved together with the harvesting-side imaging unit 10 is exemplified, but the harvesting-side image display unit 11 and the harvesting-side imaging unit 10 may be provided by a different person. .
The harvesting-side image display unit 11 displays, for example, the latest landscape image acquired by the harvesting-side imaging unit 10 . Further, for example, the harvest-side image display unit 11 may display the landscape image selected by the second system 3 together with the latest landscape image.
The harvesting-side image display unit 11 is composed of a display unit of smart glasses, a display unit of a mobile terminal, and the like.

[Harvest identification unit 12]
Based on the position specifying information of the harvest transmitted by the position information transmitting unit 35 of the second system 3, the harvest specifying unit 12 sends the harvest specifying information corresponding to the position specifying information to the harvest-side image display unit 11. Perform display processing.
For example, the harvest identification unit 12 may select a landscape image (referred to as a first landscape image) selected by the second system 3 or a latest landscape image (second landscape image) displayed by the harvest-side image display unit 11. image) is superimposed (added) with a pointer image on the position of the harvest specified by the position specifying information. In this case, the pointer image becomes the specific information of the harvest.
Here, the scenery image sent to the second system 3 and saved by the first system 1 can be used as the first scenery image.

For example, instructions (pointers, etc.) information in response to location-specific information from customers is projected onto the lenses of smart glasses, and appears superimposed on the visual information that the harvester wearing the smart glasses actually sees. may be processed as follows. In this case, in order to synchronize (align) the customer's image with the field of view that the harvester sees through the lens at that time, the coordinate axes are corrected before projecting the pointer, etc. onto the lens of the smart glasses. do.

When the position specifying information of the apple (harvest) is universal coordinates, the position of the specified apple in the landscape image can be specified from the universal coordinates of the specific position of the currently displayed landscape image. If the position specifying information of the apple is, for example, the image specifying information specifying the scenery image specifying the apple and the position information of the apple specified in the scenery image, the image specifying information to be specified and the current scenery image. Identify the position of the apple in the current landscape image, such as by interpolation of . Alternatively, the position of the apple may be displayed on the specific landscape image, and displayed separately from the current landscape image.

Here, when using the first landscape image, the coordinates of the pointer obtained from the second system 3 may be superimposed on the image stored in the first system 1 (because it is the same image).
When the second landscape image is used, it can be realized by using a method of performing image alignment processing. For example, the following method may be used.
That is, the difference between the image several frames before (the image sent to the tablet) and the current image is calculated on the smart glass side (first system 1), the tablet side (second system 3), or the server 2, Based on the results, processing is performed to move the pointer coordinates, and the pointer is superimposed on the second landscape image. Differences between images can be obtained by known image processing. At this time, the process of "moving the pointer" may be performed, or the process of fixing the coordinates of the pointer and "moving the image itself" may be performed.

If a high-precision GPS is used, the GPS information of the reference image and information such as the acceleration sensor of the first terminal are saved together with the reference image. It is possible to calculate the relative positional relationship and calculate the degree of displacement even if the images do not overlap at all. It is also possible to make a display prompting the user to move to the direction of and, when overlapping on the screen, display the pointer information overlaid on the screen.

In addition, when the server processes, the image received from the smart glasses side (in the case of video, a still image cut out) is saved as a reference image in the server, and this reference image is processed and sent to the customer tablet, and the customer It is also possible to acquire only the coordinate information of the specific information from the tablet, superimpose it on the reference image, send it to the smart glasses, and display it on the smart glasses. Realistically, it is preferable to access the server and display the image itself without sending it to the smart glasses. By the way, it is also possible to physically set the base point information of the point at the harvesting place (constituted by a pole or the like) and display it as a position from the set base point information on the photographed image.
Note that the first system does not need to superimpose the landscape image and the pointer, and the second system may superimpose the landscape image and the pointer and transmit them to the first system.
Moreover, a tablet may be provided as the harvesting-side image display unit 11 separately from the smart glasses.

[Notification unit 14]
The notification unit 14 notifies a stop instruction when the first system 1 acquires the position specifying information. The notification instruction is to notify the operator of the harvesting side image display section 11 by voice, for example, "Please stop". A warning image such as “pause” may be displayed on the harvesting side image display section 11 .
As a result, it is possible to increase the possibility that the apple selected by the customer appears in the latest landscape image captured by the harvesting-side imaging unit 10 .
<Server 2>
The server 2 includes an image provider 20 and a database 24, as shown in FIG. The server 2 of this embodiment further includes an extraction unit 21 , an emphasis processing unit 22 , and an information addition unit 23 .

[Image providing unit 20]
The image providing unit 20 receives the landscape image captured by the harvesting-side imaging unit 10 and performs processing for providing the received landscape image to the second system 3 . The received image is stored in the database 24 as appropriate.
Note that the image providing unit 20 processes the scenery image processed by the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23, and processes the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23. is provided to the second system 3 as the received landscape image.

[Extraction unit 21]
The extracting unit 21 executes a process of extracting harvested items in the landscape image captured by the harvesting-side imaging unit 10 .
The extracting unit 21 of the present embodiment executes processing for extracting crops in the scenic image received by the image providing unit 20 .
The extraction unit 21 of the present embodiment extracts apples in an image by designating a range of HSV values based on the color of apples (red: a color representing the degree of maturity). A known extraction technique, such as extraction based on contour determination, may be used to extract the crop.

When the color of harvested products such as apples, tomatoes, grapes, pears, and mandarin oranges is significantly different from the surrounding background, it is preferable to extract using color information. Furthermore, by combining contour shape information, accuracy can be improved. In addition, when an object whose temperature is different from the surroundings is targeted, a temperature sensor may be combined to extract using temperature information.
Here, apples may be extracted from the landscape image based on machine learning, and apple maturity and the like may be displayed (differentiation information display) from the apple image.
It should be noted that a partially visible apple in a landscape image may be treated as a single apple with only the partially exposed portion, or an apple may be extracted by estimating so as to restore the shape of the apple. You may make it

[Enhancement processing unit 22]
Based on the extraction information of the extraction unit 21 , the enhancement processing unit 22 processes the scenery image extracted by the extraction unit 21 to highlight the image of the crop.
The highlighting processing unit 22 of the present embodiment executes processing for highlighting the crop in the scenery image received by the image providing unit 20 .
As the highlighting, for example, as shown in FIG. 5, the landscape image displayed on the display unit of the tablet 4 is highlighted by surrounding the extracted apple 101 with a frame 102, or the landscape (background) other than the extracted apple 101 is displayed. ) can be highlighted by changing from a color image to a black-and-white image, entirely white or gray, or by adding an annotation to the effect that it is an apple. As a result, the highlighting process is executed to highlight the selectable apples.
Other highlighting may include, for example, the frame surrounding the apple swaying, moving, changing color, or blinking. It is also possible to anthropomorphize an extracted apple (harvested product) so that a speech bubble comes out of the apple or an expression is given to the apple.

[Information addition unit 23]
The information addition unit 23 performs a process of adding selection determination information for each apple (harvest) in the scenery image to the scenery image extracted by the extraction unit 21 .
For example, the area of red (the color of the mature part of the crop) in the frame surrounding the extracted apple is calculated, and the calculated area is linked to the frame and displayed numerically (see reference numeral 103 in FIG. 5, in FIG. numbers omitted). Based on the calculated area, the numbers in order of the size of the apple in the landscape image may be displayed as the selection judgment information, or the selection information may be displayed by color classification at the position of the reference numeral 103 . This information becomes judgment information (differentiation information) for apple selection.

Examples of judgment information (differentiation information) for selecting other crops include the following.
・By image recognition, the injury of each apple is emphasized.
・Ranking is performed according to shape by image recognition.
・Indicates ripeness by estimating chlorophyll content from light transmission.
・The Brix value of near-infrared light is estimated from the light transmission, and the sugar content is displayed.
・Displays the dense state of apples from light transmission.
・Displays the state of internal browning inside the apple from light transmission.
・Display apple scent information using the information acquired by the scent sensor.
・Uses the information acquired by the ultrasonic sensor to display information about the sound when struck.
- Temperature (thermo) information is displayed for harvested products for which temperature is a criterion for judgment.
・Displays information on the texture of the harvest using the information acquired by the friction sensor.

In this case, it is preferable to provide a glove or the like on the side of the second system so that a tactile sensation can be transmitted.
Note that the judgment information (differentiation information) for selecting the harvested product may be presented according to the target harvested product (differentiation information).
The processes of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23 may be included in the second system 3 and executed by the second system 3, for example, as shown in FIG. The first system 1 may have it.

<Second system 3>
The second system 3 consists of tablet and PC applications.
The second system 3 includes a customer side communication section 31, an image receiving section 32, a customer side image display section 33, a harvest specifying section 34, and a position information transmitting section 35, as shown in FIG.
The customer-side communication unit 31 exchanges data with the server 2 via communication means.

[Image receiving unit 32]
The image receiving unit 32 acquires the landscape image captured by the harvesting-side imaging unit 10 from the server 2 via the customer-side communication unit 31 .
[Customer side image display unit 33]
The customer-side image display section 33 displays the scenery image received by the image reception section 32 .
Here, the scenery image acquired by the image receiving unit 32 is the scenery image after the processing of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23, but is not limited to this.
For example, a specific landscape image is selected by the customer from landscape images continuously acquired by the image receiving unit 32 and continuously displayed by the customer-side image display unit 33, and the identified image information is transmitted to the server 2 side. , the processing of the extraction unit 21, the enhancement processing unit 22, and the information addition unit 23 is executed only for the specified scenery image, and the image reception unit 32 re-transmits the shaped image after processing from the server 2 side It may be a configuration to be acquired.

[Harvest designation unit 34]
The harvest designation unit 34 executes a process of selecting a specific harvest in the landscape image displayed by the customer-side image display unit 33 .
For example, when the crop designation unit 34 determines that a specific apple (harvest) in the continuously changing landscape image has been touched with the stick 5 or the like, as shown in FIG. 5, the touched apple is selected. I judge that.

[Location information transmission unit 35]
When the position information transmitting unit 35 determines that the harvested product has been selected by the harvested product designation unit 34, the position information transmission unit 35 sends the coordinates of the selected harvested product (coordinates of the contact position in the landscape image) to the harvest selected by the harvested product designation unit 34. It is transmitted to the first system 1 via communication means as position specifying information of the object.
The coordinates are preferably universal coordinates starting from a specific location in the harvesting area. For example, the universal coordinates of a specified apple are calculated from the universal coordinates of an image in which an apple is specified. Further, the harvest position specifying information may be composed of, for example, image specifying information for specifying a landscape image designating an apple, and relative position information of the harvest designating within the landscape image.

Here, as described above, the server may process the process of superimposing the pointer image on the scenery image using the first or second scenery image.
When using the first scenery image, the coordinates of the pointer obtained from the second system 3 are superimposed on the image received from the first system 1 and stored in the database 24 .
When using the second landscape image, for example, the server 2 calculates the difference between the image several frames before (the image sent to the tablet) and the current image, and the pointer coordinates are moved based on the result. . Differences between images can be obtained by known image processing. At this time, the process of "moving the pointer" may be performed, or the process of fixing the coordinates of the pointer and "moving the image itself" may be performed.

Then, when the server 2 processes, the image received from the smart glasses side (still image cut out in the case of a video) is saved as a reference image in the server 2, and this reference image is processed and sent to the customer tablet. Alternatively, only the coordinate information of the specific information may be obtained from the customer tablet, superimposed on the reference image, transmitted to the smart glasses, and the smart glasses may display the image. Realistically, it is preferable to access the server and display the image itself without sending it to the smart glasses. By the way, it is also possible to physically set the base point information of the point at the harvesting place (constituted by a pole or the like) and display it as a position from the set base point information on the photographed image.

(Other operations)
In this embodiment, the harvester continuously captures the scenery including apples that can be harvested by the harvesting-side imaging unit 10, and the captured scenery images are continuously presented to the customer.
The customer looks at the scenery images continuously displayed on the customer side image display part 33, and when he finds the desired apple, he touches the apple with his finger or the stick 5 to select the apple. When an apple is selected, the selection is transmitted to the first system 1, the harvester is notified of the selection of the apple, and information on the selected apple is displayed on the harvest side image display unit. 11. The harvester then harvests the selected apples.

In this embodiment, the customer is provided with a landscape image in which selectable apples are highlighted. As a result, each apple in the landscape image that changes continuously becomes easier to see, and it becomes easier to specify the apple.
Furthermore, in the present embodiment, each apple is provided with differentiating information, so that the customer can obtain criteria for determining which apple to choose, making it easier to select apples. .
As a result, even general consumers can easily visually recognize the presence of apples in the changing landscape images, and customers (general consumers) can remotely simulate their preferences based on the landscape images that are continuously sent. It is possible to give instructions for harvesting apples.

For example, by displaying information on each red area, the ripening state and size of apples are presented to the customer as apple selection information.
In addition, when the customer selects an apple, by notifying the harvester of a stop instruction, the apple selected by the customer will be positioned in the landscape image that is currently being captured, allowing for more accurate designation. It is possible to harvest apples that have been harvested.
Before harvesting, the first system 1 may send an inquiry "whether or not to harvest this apple" to the second system 3 so that the designated apple can be harvested more reliably.

Here, the above description exemplifies a case in which real images are continuously transmitted and the customer remotely selects an apple from a synchronized scenery image, but the present invention is not limited to this.
That is, the first system 1 and the second system 3 do not necessarily have to synchronize the scenery images. For example, in units of a predetermined time (for example, several hours), the first system 1 captures scenery images and sequentially stores them in the database 24 of the server 2, and the second system 3 stores them in the database 24. It is also possible to sequentially receive the scenery images that have been received and execute the apple selection processing. In this case, the customer can take time to carefully select apples at a desired time.

In addition, when the apples are selected, the selected apples are positioned in the current landscape image by notifying the harvester of a stop instruction. As a result, it becomes possible to harvest apples specified with higher accuracy. In the above description, a stop instruction (specific information about apple) is sent to the first system 1 side when apple is specified, but the present invention is not limited to this. For example, before the apple is selected, when the customer recognizes the landscape image from which the apple is to be selected, an instruction to stop the image capturing position to be captured may be sent to the first system 1 side.

As a result, the customer instructs the harvester not to move the harvesting-side imaging unit 10 such as smart glasses, so that the current landscape image captured by the harvester (in the case of smart glasses, smart It is possible to reduce the deviation between the field of view that the glasses wearer sees realistically and the landscape image of the apple selection.
At this time, for example, the current real image may be displayed on the right eye side of the smart glasses, and the landscape image with the apple selected may be displayed on the left eye side.
In addition, the harvester may have a tablet as the harvesting-side image display unit 11 in addition to the smart glasses. That is, there may be two or more harvesting-side image display units 11 .
Also, on the harvester side, the harvester who has the harvesting-side imaging unit 10 and the harvester who is looking at the harvesting-side image display unit 11 may be different persons.

(others)
In this embodiment, the following configuration can also be taken.
(1) A system in which a first system 1 on the harvester side and a second system 3 on the customer side exchange data via communication means. and a harvesting-side image display unit 11 capable of displaying the landscape image captured by the harvesting-side imaging unit 10, and the second system 3 communicates with , an image receiving unit 32 for acquiring the scenery image captured by the harvesting side imaging unit 10, and a customer side image display unit 33 for displaying the scenery image received by the image receiving unit 32, and further, the harvesting side imaging unit An extraction unit 21 for extracting crops in the scenery image captured by the unit 10, and an image of the crops is emphasized in the scenery image extracted by the extraction unit 21 based on the extraction information of the extraction unit 21. an emphasis processing unit 22 for performing display processing, and the landscape image displayed by the customer-side image display unit 33 is a landscape image in which the crops are emphasized by the processing of the emphasis processing unit 22. A remote harvesting system characterized by:

(2) A remote harvesting system characterized in that the harvesting-side imaging unit 10 captures an image of a landscape including harvested products before harvesting.
(3) The scenery image is a color image, and the above-mentioned highlighting is performed by making images other than the crops in the scenery image black-and-white images, by enclosing the crops in a frame, or by attaching an annotation. A remote harvesting system characterized by:
(4) Further, an information addition unit 23 is provided for adding selection judgment information for each crop in the scenery image to the scenery image, and the scenery image displayed by the customer side image display unit 33 is added with the selection judgment information. A remote harvesting system, characterized in that it is a landscape image that has been processed.

(5) The second system 3 includes a crop designation unit 34 for selecting a specific crop in the scenery image displayed by the customer-side image display unit 33; a location information transmitting unit 35 for transmitting location specifying information of the harvest selected by the A remote harvesting system, comprising: a harvest specifying unit 12 for displaying, on the harvesting side image display unit 11, harvest specifying information corresponding to the position specifying information of the harvest based on the position specifying information of the harvest.

(6) A remote harvesting system, wherein the harvest identification unit 12 adds identification information of the harvest to the landscape image displayed on the harvest-side image display unit 11 .
(7) The remote harvesting system, wherein the first system 1 includes a notification unit 14 that notifies a stop instruction when the position specifying information is obtained.
(8) A remote harvesting system, wherein the extraction unit 21 and the enhancement processing unit 22 are included in the second system 3 .

(9) It has a server 2 that mediates transmission and reception of data between the first system 1 and the second system 3, and the server 2 receives and receives landscape images captured by the harvest-side imaging unit 10. and an image providing unit 20 for providing the second system 3 with the landscape image obtained by the processing, the extracting unit 21 and the enhancement processing unit 22 are provided in the server 2, and the image providing unit 20 is provided with the extracting unit 21 and providing the second system 3 with the scenery image processed by the processing in the enhancement processing unit 22.

(10) A server that is used in the remote harvesting system described above and mediates transmission and reception of data between the first system and the second system, and receives a landscape image captured by the harvesting-side imaging unit; An image providing unit for providing the received scenery image to the second system, and the extracting unit and the enhancement processing unit, wherein the image providing unit performs processing in the extraction unit and the enhancement processing unit. A server for a remote harvesting system that provides processed landscape images to a second system.

1 First system 2 Server 3 Second system 4 Tablet 5 Stick 10 Harvesting-side imaging unit 11 Harvesting-side image display unit 12 Harvested product specifying unit 13 Harvesting-side communication unit 14 Reporting unit 20 Image providing unit 21 Extracting unit 22 Emphasizing processing Section 23 Information addition section 24 Database 31 Customer side communication section 32 Image reception section 33 Customer side image display section 34 Harvested item designation section 35 Position information transmission section 101 Apple 102 Frame

Claims (6)

A system in which a first system on the harvester side and a second system on the customer side exchange data via communication means,
A first system includes a harvesting-side imaging unit capable of imaging a landscape including harvested products, and a harvesting-side image display unit capable of displaying the landscape image captured by the harvesting-side imaging unit,
The second system comprises, via a communication means, an image receiving section that acquires the scenery image captured by the harvesting side imaging section, and a customer side image display section that displays the scenery image received by the image receiving section. prepared,
Furthermore, an extraction unit for extracting the crop in the landscape image captured by the harvest-side imaging unit;
an enhancement processing unit that performs processing to highlight and display an image of harvested products in the scenery image extracted by the extraction unit based on the extraction information of the extraction unit;
the landscape image displayed by the customer-side image display unit is a landscape image in which harvested products are highlighted by the processing of the emphasis processing unit ;
The second system includes a crop designating unit that selects a specific crop in the landscape image from the landscape image displayed by the customer-side image display unit; a location information transmission unit that transmits the specific information to the first system via the communication means;
The first system includes a harvest specifying unit that displays, on the harvest-side image display unit, harvest specifying information corresponding to the position specifying information of the harvest, based on the position specifying information of the harvest transmitted by the position information transmitting unit. with
The first system includes a notification unit that notifies a stop instruction when the position specifying information is acquired,
The stop instruction is information that instructs the scenery image currently being captured to stop the position of the image to be captured.
A remote harvesting system characterized by: The scenery image is a color image, and the highlighting is performed by making images other than the crops in the scenery image black-and-white images, by enclosing the harvests in a frame, or by adding an annotation. The remote harvesting system of Claim 1. Furthermore, an information addition unit for adding selection judgment information for each harvest in the landscape image to the landscape image,
the landscape image displayed by the customer-side image display unit is a landscape image to which the selection judgment information is added ;
The selection judgment information is differentiation information about the harvest for selecting the harvest,
3. The remote harvesting system according to claim 1 or 2, characterized in that: 4. The harvest product specifying unit according to any one of claims 1 to 3, wherein the harvest product specifying unit adds the harvest product specifying information to the landscape image displayed on the harvesting-side image display unit. remote harvesting system. 5. The remote harvesting system according to any one of claims 1 to 4 , wherein the extraction unit and the enhancement processing unit are provided in a second system. Having a server that mediates transmission and reception of data between the first system and the second system,
The server includes an image providing unit that receives the scenery image captured by the harvesting side imaging unit and provides the received scenery image to the second system,
The extraction unit and the enhancement processing unit are provided in the server,
The image providing unit provides the landscape image processed by the extraction unit and the enhancement processing unit to the second system.
The remote harvesting system according to any one of claims 1 to 5 , characterized in that:

Images