WO2022118772A1 - 自動走行システム、自動走行方法、及び自動走行プログラム - Google Patents
自動走行システム、自動走行方法、及び自動走行プログラム Download PDFInfo
- Publication number
- WO2022118772A1 WO2022118772A1 PCT/JP2021/043531 JP2021043531W WO2022118772A1 WO 2022118772 A1 WO2022118772 A1 WO 2022118772A1 JP 2021043531 W JP2021043531 W JP 2021043531W WO 2022118772 A1 WO2022118772 A1 WO 2022118772A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- route
- work vehicle
- traveling
- work
- processing unit
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 53
- 238000012545 processing Methods 0.000 claims abstract description 162
- 238000001514 detection method Methods 0.000 claims abstract description 97
- 230000008859 change Effects 0.000 claims description 22
- 238000003384 imaging method Methods 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 description 31
- 238000004891 communication Methods 0.000 description 23
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 10
- 238000005259 measurement Methods 0.000 description 10
- 238000009434 installation Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 3
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000003337 fertilizer Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 239000002828 fuel tank Substances 0.000 description 1
- 239000003502 gasoline Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000009331 sowing Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0214—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/22—Command input arrangements
- G05D1/221—Remote-control arrangements
- G05D1/222—Remote-control arrangements operated by humans
- G05D1/224—Output arrangements on the remote controller, e.g. displays, haptics or speakers
- G05D1/2244—Optic
- G05D1/2245—Optic providing the operator with a purely computer-generated representation of the environment of the vehicle, e.g. virtual reality
- G05D1/2246—Optic providing the operator with a purely computer-generated representation of the environment of the vehicle, e.g. virtual reality displaying a map of the environment
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/617—Safety or protection, e.g. defining protection zones around obstacles or avoiding hazards
- G05D1/622—Obstacle avoidance
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/648—Performing a task within a working area or space, e.g. cleaning
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01B—SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL
- A01B69/00—Steering of agricultural machines or implements; Guiding agricultural machines or implements on a desired track
- A01B69/007—Steering or guiding of agricultural vehicles, e.g. steering of the tractor to keep the plough in the furrow
- A01B69/008—Steering or guiding of agricultural vehicles, e.g. steering of the tractor to keep the plough in the furrow automatic
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2105/00—Specific applications of the controlled vehicles
- G05D2105/15—Specific applications of the controlled vehicles for harvesting, sowing or mowing in agriculture or forestry
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2107/00—Specific environments of the controlled vehicles
- G05D2107/20—Land use
- G05D2107/21—Farming, e.g. fields, pastures or barns
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2109/00—Types of controlled vehicles
- G05D2109/10—Land vehicles
Definitions
- the present invention relates to an automatic driving system for automatically driving a work vehicle, an automatic driving method, and an automatic driving program.
- the work vehicle is equipped with obstacle sensors such as infrared sensors and ultrasonic sensors, and detects obstacles in the detection area during automatic driving.
- the detection area is set in a fan shape, for example, within a predetermined distance (for example, 10 m) in front of the obstacle sensor in a plan view.
- a predetermined distance for example, 10 m
- the operator is notified, and collision avoidance control or the like for stopping the work vehicle is performed (for example, Patent Document 1). reference).
- obstacle sensors can be added as an option, and can be installed on all sides of the work vehicle so that blind spots do not occur.
- a blind spot may occur depending on the work content. For example, when the work machine is used in a state of being offset to one side from the work vehicle to the left or right as in mowing work, a blind spot is generated in the offset direction. In order to eliminate the blind spot in the offset direction, it is necessary to install an obstacle sensor on the work equipment as well. In this way, if the obstacle sensors are installed so as to be able to handle all the work, the number of obstacle sensors increases and the cost increases. On the other hand, if the number of obstacle sensors is reduced, the blind spots are increased and the safety is lowered.
- An object of the present invention is to provide an automatic driving system, an automatic driving method, and an automatic driving program capable of preventing an increase in cost while ensuring the safety of a work vehicle.
- the automatic traveling system includes a route acquisition processing unit and a notification processing unit for notifying.
- the route acquisition processing unit acquires the travel route of the work vehicle.
- the notification processing unit is installed in the work vehicle on the travel path acquired by the route acquisition processing unit, and is in a direction different from the direction of the detection area of the detection unit that detects obstacles around the work vehicle.
- an inquiry as to whether or not to start the automatic traveling of the work vehicle is notified.
- one or a plurality of processors acquire a traveling route of a work vehicle, and the traveling route is installed in the working vehicle to detect obstacles around the working vehicle. This is a method of notifying an inquiry as to whether or not to start automatic traveling of the work vehicle when a first traveling route in a direction different from the direction of the detection area of the detection unit is included.
- the automatic traveling program acquires a traveling route of a work vehicle and a direction of a detection area of a detection unit installed on the work vehicle and detecting an obstacle around the work vehicle on the traveling route.
- This is a program for causing one or a plurality of processors to notify an inquiry as to whether or not to start automatic traveling of the work vehicle when a first traveling route in a direction different from the above is included.
- an automatic driving system an automatic driving method, and an automatic driving program that can prevent an increase in cost while ensuring the safety of a work vehicle.
- FIG. 1 is a block diagram showing a configuration of an automated driving system according to an embodiment of the present invention.
- FIG. 2 is an external view showing an example of a work vehicle according to an embodiment of the present invention.
- FIG. 3 is a diagram showing an example of a traveling path of a work vehicle according to an embodiment of the present invention.
- FIG. 4A is a diagram showing the positions of obstacle sensors installed in the work vehicle according to the embodiment of the present invention.
- FIG. 4B is a diagram showing the positions of cameras installed in the work vehicle according to the embodiment of the present invention.
- FIG. 5 is a diagram showing an example of work vehicle information used in the automatic traveling system according to the embodiment of the present invention.
- FIG. 6 is a diagram showing an example of travel route information used in the automatic travel system according to the embodiment of the present invention.
- FIG. 7 is a diagram showing an example of travelability information used in the automatic traveling system according to the embodiment of the present invention.
- FIG. 8A is a diagram showing an example of a route selection screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 8B is a diagram showing an example of a route selection screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 9A is a diagram showing an example of a selection screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 9B is a diagram showing an example of a selection screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 10A is a diagram showing an example of a traveling state screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 10A is a diagram showing an example of a traveling state screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 10B is a diagram showing an example of a traveling state screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 10C is a diagram showing an example of a traveling state screen displayed on the operation terminal according to the embodiment of the present invention.
- FIG. 11 is a flowchart showing an example of a procedure of automatic driving processing executed by the automatic driving system according to the embodiment of the present invention.
- the automatic traveling system 1 includes a work vehicle 10 and an operation terminal 20.
- the work vehicle 10 and the operation terminal 20 can communicate with each other via the communication network N1.
- the work vehicle 10 and the operation terminal 20 can communicate via a mobile phone line network, a packet line network, or a wireless LAN.
- the work vehicle 10 is a tractor
- the work vehicle 10 may be a rice transplanter, a combine harvester, a construction machine, a snowplow, or the like.
- the work vehicle 10 is a so-called robot tractor having a configuration capable of automatically traveling (autonomous traveling) along a preset travel path R in a field F (see FIG. 3).
- the work vehicle 10 can automatically travel along the travel path R generated in advance with respect to the field F based on the position information of the current position of the work vehicle 10 calculated by the positioning device 17. ..
- the work vehicle 10 reciprocates in parallel from the work start position S to the work end position G in the work area of the field F shown in FIG.
- the outer peripheral side of the field F is, for example, a headland area, and the work vehicle 10 makes a turning run.
- the travel route R is not limited to the route shown in FIG. 3, and is appropriately set according to the work content.
- the work vehicle 10 includes a vehicle control device 11, a storage unit 12, a traveling device 13, a working machine 14, a camera 15, a communication unit 16, a positioning device 17, an obstacle sensor 18, and detection.
- a processing device 19 and the like are provided.
- the vehicle control device 11 is electrically connected to a storage unit 12, a traveling device 13, a working machine 14, a positioning device 17, and the like.
- the vehicle control device 11 and the positioning device 17 may be capable of wireless communication.
- the camera 15 and the obstacle sensor 18 are electrically connected to the detection processing device 19.
- the storage unit 12 is a non-volatile storage unit such as an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores various types of information.
- the storage unit 12 stores a control program such as an automatic driving program for causing the vehicle control device 11 to execute the automatic driving process (see FIG. 11) described later.
- the automatic traveling program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, is read by a predetermined reading device (not shown), and is stored in the storage unit 12.
- the automatic traveling program may be downloaded from the server (not shown) to the work vehicle 10 via the communication network N1 and stored in the storage unit 12. Further, the storage unit 12 stores data of the travel path R generated by the operation terminal 20 and the like.
- the traveling device 13 is a driving unit for traveling the work vehicle 10. As shown in FIG. 2, the traveling device 13 includes an engine 131, front wheels 132, rear wheels 133, a transmission 134, a front axle 135, a rear axle 136, a handle 137, and the like. The front wheels 132 and the rear wheels 133 are provided on the left and right sides of the work vehicle 10, respectively. Further, the traveling device 13 is not limited to the wheel type provided with the front wheels 132 and the rear wheels 133, and may be a crawler type provided with crawlers provided on the left and right sides of the work vehicle 10.
- the engine 131 is a drive source such as a diesel engine or a gasoline engine that is driven by using fuel supplied to a fuel tank (not shown).
- the traveling device 13 may include an electric motor as a drive source together with the engine 131 or in place of the engine 131.
- a generator (not shown) is connected to the engine 131, and electric power is supplied from the generator to electric parts such as a vehicle control device 11 provided on the work vehicle 10 and a battery.
- the battery is charged by the electric power supplied from the generator.
- the electric parts such as the vehicle control device 11 and the positioning device 17 provided in the work vehicle 10 can be driven by the electric power supplied from the battery even after the engine 131 is stopped.
- the driving force of the engine 131 is transmitted to the front wheels 132 via the transmission 134 and the front axle 135, and is transmitted to the rear wheels 133 via the transmission 134 and the rear axle 136. Further, the driving force of the engine 131 is also transmitted to the working machine 14 via the PTO shaft (not shown).
- the traveling device 13 performs the traveling operation according to the command of the vehicle control device 11.
- the working machine 14 is, for example, a mower, a tiller, a plow, a fertilizer applicator, a sowing machine, or the like, and can be attached to and detached from the working vehicle 10. As a result, the work vehicle 10 can perform various operations using each of the work machines 14. In the present embodiment, the case where the working machine 14 is a mower will be described as an example.
- the work machine 14 is mounted at an offset to the left or right side with respect to the work vehicle 10.
- the work vehicle 10 is offset to one of the left and right sides, and a directly mounted work machine 14 is attached to the work vehicle 10 to run in the field to perform mowing work and the like.
- the work machine 14 is not limited to the directly mounted work machine (see FIG. 2) fixed to the work vehicle 10, and may be a tow type work machine towed by the work vehicle 10.
- the obstacle sensor 18 is a sensor that detects an obstacle in a predetermined detection area K0 by using infrared rays, ultrasonic waves, or the like.
- the obstacle sensor 18 may be a rider sensor (distance sensor) capable of measuring the distance to the object to be measured (obstacle) in three dimensions using a laser, or the object to be measured using ultrasonic waves. It may be a sonar sensor having a plurality of sonars capable of measuring the distance to.
- the obstacle sensor 18 is installed at the front of the machine body of the work vehicle 10 (see FIGS. 2 and 4A), and detects an obstacle in front of the work vehicle 10.
- the obstacle sensor 18 is configured to be able to detect an obstacle in a predetermined detection area K0 set in advance.
- the obstacle sensor 18 is configured to be able to detect an obstacle in the detection area K0 having a width of about 10 m in front of the work vehicle 10 and a width of about 4 m.
- the obstacle sensor 18 detects an object, a person, or the like that has entered the detection area K0.
- the obstacle sensor 18 transmits the measurement information to the detection processing device 19.
- the obstacle sensor 18 is installed only in the front part of the work vehicle 10. As a result, the cost of the work vehicle 10 can be suppressed as compared with the case where a plurality of obstacle sensors 18 are installed.
- the obstacle sensor 18 can be installed at a place other than the front part of the work vehicle 10.
- the obstacle sensor 18 can be installed in the rear part, the right side part, the left side part, the work machine 14, and the like of the work vehicle 10.
- the user can additionally install the obstacle sensor 18 according to the work content.
- the operator who owns a plurality of work vehicles 10 can install the obstacle sensor 18 at a different position for each work vehicle 10 according to the work content.
- the obstacle sensor 18 is an example of the detection unit of the present invention.
- the detection processing device 19 can communicate with the obstacle sensor 18 by electrically connecting the obstacle sensor 18 to the work vehicle 10. When the detection processing device 19 becomes able to communicate with the obstacle sensor 18, the detection processing device 19 acquires the number of obstacle sensors 18 and the identification information (device information) of each obstacle sensor 18.
- the camera 15 is a digital camera that captures an image of a subject and outputs it as digital image data.
- the camera 15 continuously captures a subject at a predetermined frame rate, generates a frame image having a predetermined resolution, and sequentially transmits the frame image to the detection processing device 19.
- the camera 15 is an example of the monitoring unit and the imaging unit of the present invention.
- the monitoring unit of the present invention is not limited to the camera 15, and may be a sensor having a function different from that of the obstacle sensor 18 (for example, a sensor having a lower detection accuracy than the obstacle sensor 18).
- a camera 15F (hereinafter also referred to as “camera 1”) is installed at the front of the work vehicle 10, and a camera 15B (hereinafter also referred to as “camera 2”) is installed at the rear of the work vehicle 10.
- a camera 15R (hereinafter also referred to as “camera 3”) is installed on the right side of the work vehicle 10, and a camera 15L (hereinafter also referred to as “camera 4”) is installed on the left side of the work vehicle 10.
- the camera 15C (hereinafter, also referred to as “camera 5”) is installed on the right front side of the working machine 14.
- the camera 15 may be installed on the work vehicle 10 with, for example, double-sided tape.
- each camera 15 is set with a predetermined imaging range (detection area) in which imaging is possible.
- the camera 15F images the image pickup area K1 in front of the work vehicle 10
- the camera 15B images the image pickup area K2 behind the work vehicle 10
- the camera 15R images the image pickup area K3 on the right side of the work vehicle 10.
- the camera 15L images the image pickup area K4 on the left side of the work vehicle 10
- the camera 15C images the image pickup area K5 on the right front side of the work machine 14.
- Each camera 15 captures each imaging area at a predetermined frame rate, and sequentially transmits the captured images to the detection processing device 19.
- the detection processing device 19 transmits the captured image and the detection result (determination result) described later to the vehicle control device 11 and the operation terminal 20.
- the detection processing device 19 can communicate with the camera 15 by electrically connecting the camera 15 to the work vehicle 10.
- the detection processing device 19 acquires the number of cameras 15 and the identification information (device information) of each camera 15. Further, the detection processing device 19 outputs the acquired number information and identification information of the cameras 15 to the vehicle control device 11, and the vehicle control device 11 outputs the number information and identification information to the operation terminal 20.
- the operator can add a camera 15 or change the installation position.
- the steering wheel 137 is an operation unit operated by an operator or a vehicle control device 11.
- the angle of the front wheels 132 is changed by a hydraulic power steering mechanism (not shown) or the like in response to the operation of the steering wheel 137 by the vehicle control device 11, and the traveling direction of the work vehicle 10 is changed.
- the traveling device 13 includes a shift lever (not shown), an accelerator, a brake, and the like operated by the vehicle control device 11. Then, in the traveling device 13, the gear of the transmission 134 is switched to a forward gear, a back gear, or the like in response to the operation of the shift lever by the vehicle control device 11, and the traveling mode of the work vehicle 10 is switched to forward or reverse. .. Further, the vehicle control device 11 operates the accelerator to control the rotation speed of the engine 131. Further, the vehicle control device 11 operates the brake and uses an electromagnetic brake to brake the rotation of the front wheels 132 and the rear wheels 133.
- the positioning device 17 is a communication device including a positioning control unit 171, a storage unit 172, a communication unit 173, a positioning antenna 174, and the like.
- the positioning device 17 is provided above the cabin 138 on which the operator is boarded. Further, the installation location of the positioning device 17 is not limited to the cabin 138. Further, the positioning control unit 171, the storage unit 172, the communication unit 173, and the positioning antenna 174 of the positioning device 17 may be dispersedly arranged at different positions in the work vehicle 10. As described above, the battery is connected to the positioning device 17, and the positioning device 17 can operate even when the engine 131 is stopped. Further, as the positioning device 17, for example, a mobile phone terminal, a smartphone, a tablet terminal, or the like may be substituted.
- the positioning control unit 171 is a computer system including one or more processors and a storage memory such as a non-volatile memory and a RAM.
- the storage unit 172 is a program for causing the positioning control unit 171 to execute the positioning process, and a non-volatile memory for storing data such as positioning information and movement information.
- the program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, is read by a predetermined reading device (not shown), and is stored in the storage unit 172.
- the program may be downloaded from the server (not shown) to the positioning device 17 via the communication network N1 and stored in the storage unit 172.
- the communication unit 173 connects the positioning device 17 to the communication network N1 by wire or wirelessly, and executes data communication according to a predetermined communication protocol with an external device such as a base station server via the communication network N1. Communication interface.
- the positioning antenna 174 is an antenna that receives radio waves (GNSS signals) transmitted from satellites.
- GNSS signals radio waves
- the positioning control unit 171 calculates the current position of the work vehicle 10 based on the GNSS signal received from the satellite by the positioning antenna 174. For example, when the work vehicle 10 automatically travels in the field F and the positioning antenna 174 receives radio waves (transmission time, orbit information, etc.) transmitted from each of the plurality of satellites, the positioning control unit 171 performs positioning. The distance between the antenna 174 and each satellite is calculated, and the current position (latitude and longitude) of the work vehicle 10 is calculated based on the calculated distance.
- the positioning control unit 171 calculates the current position of the work vehicle 10 by using the correction information corresponding to the base station (reference station) close to the work vehicle 10, and the real-time kinematic method (RTK-GPS positioning method (RTK method)). )) Positioning may be performed. In this way, the work vehicle 10 automatically travels by using the positioning information by the RTK method.
- RTK-GPS positioning method RTK method
- the vehicle control device 11 and the detection processing device 19 have control devices such as a CPU, ROM, and RAM.
- the CPU is a processor that executes various arithmetic processes.
- the ROM is a non-volatile storage unit in which control programs such as a BIOS and an OS for causing the CPU to execute various arithmetic processes are stored in advance.
- the RAM is a volatile or non-volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the vehicle control device 11 and the detection processing device 19 control the work vehicle 10 by executing various control programs stored in advance in the ROM or the storage unit 12 on the CPU.
- the detection processing device 19 acquires measurement information from the obstacle sensor 18 and determines whether or not an obstacle is included in the detection area K0 based on the measurement information.
- the detection processing apparatus 19 includes various processing units such as an acquisition processing unit 111 and a detection processing unit 112.
- the detection processing device 19 functions as the various processing units by executing various processing according to the automatic traveling program on the CPU. Further, a part or all of the processing unit may be composed of an electronic circuit.
- the automatic traveling program may be a program for making a plurality of processors function as the processing unit.
- the acquisition processing unit 111 acquires measurement information from one or more obstacle sensors 18. Specifically, the acquisition processing unit 111 acquires the measurement information of the detection area K0 from the obstacle sensor 18 installed at the front of the work vehicle 10. For example, when an obstacle (person) enters the detection area K0, the acquisition processing unit 111 acquires the measurement distance measured by the obstacle sensor 18.
- the acquisition processing unit 111 acquires captured images from one or more cameras 15. For example, the acquisition processing unit 111 frames the captured images of the imaging areas K1 to K5 from each of the five cameras 15F, 15B, 15R, 15L, and 15C installed in the working vehicle 10 and the working machine 14. Get every time. The acquisition processing unit 111 stores the acquired image in the storage unit 12 together with the acquisition time. Further, the acquisition processing unit 111 outputs the acquired image data of the captured image to the operation terminal 20.
- the detection processing unit 112 detects an obstacle based on the measurement information acquired by the acquisition processing unit 111. Specifically, the detection processing unit 112 determines whether or not an obstacle is included in the detection area K0 based on the measurement information. The detection processing unit 112 outputs the detection result to the operation terminal 20.
- the vehicle control device 11 controls the operation of the work vehicle 10 in response to various user operations on the work vehicle 10. Further, the vehicle control device 11 executes the automatic traveling process of the work vehicle 10 based on the current position of the work vehicle 10 calculated by the positioning device 17 and the travel path R generated in advance.
- the vehicle control device 11 includes various processing units such as a traveling processing unit 113.
- the vehicle control device 11 functions as the various processing units by executing various processes according to the automatic traveling program on the CPU. Further, a part or all of the processing unit may be composed of an electronic circuit.
- the automatic traveling program may be a program for making a plurality of processors function as the processing unit.
- the travel processing unit 113 controls the travel of the work vehicle 10. Specifically, the travel processing unit 113 starts the automatic travel of the work vehicle 10 when the work start instruction is acquired from the operation terminal 20. For example, when the operator presses the work start button on the operation screen of the operation terminal 20, the operation terminal 20 outputs a work start instruction to the work vehicle 10. When the work start instruction is acquired from the operation terminal 20, the travel processing unit 113 starts the automatic travel of the work vehicle 10. As a result, the work vehicle 10 starts automatic traveling according to the travel path R, and starts the work by the work machine 14. The travel path R on which the work vehicle 10 travels is generated by, for example, the operation terminal 20. The work vehicle 10 acquires a travel route R from the operation terminal 20 and automatically travels in the field F according to the travel route R.
- the traveling processing unit 113 stops the automatic traveling of the work vehicle 10 when the traveling stop instruction is acquired from the operation terminal 20. For example, when the operator presses the travel stop button on the operation screen of the operation terminal 20, the operation terminal 20 outputs a travel stop instruction to the work vehicle 10.
- the traveling processing unit 113 stops the automatic traveling of the work vehicle 10 when the detection processing unit 112 detects an obstacle. For example, when the detection processing unit 112 detects an obstacle within a range of 3 m to 8 m in front of the work vehicle 10, the travel processing unit 113 decelerates the work vehicle 10. Further, when the detection processing unit 112 detects an obstacle within a range of up to 3 m in front of the work vehicle 10, the travel processing unit 113 stops the work vehicle 10 (emergency stop).
- the operation terminal 20 is an information processing device including an operation control unit 21, a storage unit 22, an operation display unit 23, a communication unit 24, and the like.
- the operation terminal 20 may be composed of a mobile terminal such as a tablet terminal or a smartphone.
- the communication unit 24 connects the operation terminal 20 to the communication network N1 by wire or wirelessly, and data communication according to a predetermined communication protocol with one or more external devices such as a work vehicle 10 via the communication network N1. Is a communication interface for executing.
- the operation display unit 23 is a user interface including a display unit such as a liquid crystal display or an organic EL display that displays various information, and an operation unit such as a touch panel, a mouse, or a keyboard that accepts operations.
- a display unit such as a liquid crystal display or an organic EL display that displays various information
- an operation unit such as a touch panel, a mouse, or a keyboard that accepts operations.
- the operator can operate the operation unit to register various information (work vehicle information, field information, work information, etc., which will be described later). Further, the operator can operate the operation unit to give a work start instruction, a running stop instruction, and the like to the work vehicle 10. Further, the operator can grasp the traveling state of the working vehicle 10 that automatically travels in the field F according to the traveling route R from the traveling locus displayed on the operation terminal 20 at a place away from the working vehicle 10. ..
- the storage unit 22 is a non-volatile storage unit such as an HDD or SSD that stores various types of information.
- the storage unit 22 stores a control program such as an automatic driving program for causing the operation control unit 21 to execute the automatic driving process (see FIG. 11) described later.
- the automatic traveling program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, is read by a predetermined reading device (not shown), and is stored in the storage unit 22.
- the automatic traveling program may be downloaded from the server (not shown) to the operation terminal 20 via the communication network N1 and stored in the storage unit 22.
- the storage unit 22 has work vehicle information D1 which is information about the work vehicle 10, travel route information D2 which is information about the travel route, and information indicating whether or not the work vehicle 10 can travel on the travel route. Data such as travelability information D3 is stored.
- FIG. 5 is an example of work vehicle information D1.
- the work vehicle information D1 includes information such as a vehicle number, a model, an installation position of the obstacle sensor 18, and a travelable route for each work vehicle 10.
- the vehicle number is identification information of the work vehicle 10.
- the model is the model of the work vehicle 10.
- the installation position of the obstacle sensor 18 is the installation position of the obstacle sensor 18 in the work vehicle 10.
- the travelable route is a travel route on which the work vehicle 10 can travel, which is set according to the installation position of the obstacle sensor 18.
- the work vehicle 10 can detect an obstacle when traveling forward, but when traveling backward and when traveling backward. Obstacles in the traveling direction cannot be detected when traveling inward. Therefore, for example, for the work vehicle T4 in which the obstacle sensor 18 is installed only in the front part of the work vehicle 10, "impossible” is registered in the reverse route and the inner loop route. Further, for example, for the work vehicle T2 in which the obstacle sensor 18 is installed in the front portion and the rear portion of the work vehicle 10, "possible” is registered in the reverse route and "impossible” is registered in the inner loop route.
- the storage unit 22 may store the work vehicle information D1 relating to one work vehicle 10 or the work vehicle information D1 relating to a plurality of work vehicles 10. For example, when a specific operator owns a plurality of work vehicles 10, the work vehicle information D1 for each work vehicle 10 is stored in the storage unit 22.
- FIG. 6 is an example of the travel route information D2.
- the travel route information D2 includes information such as a route name, a field name, an address, a field area, a working time, and a route content for each travel route.
- the route name is a route name of the traveling route R generated by the operation terminal 20.
- the field name is the name of the work target field for which the traveling route is set.
- the address is the address of the field, and the field area is the area of the field.
- the working time is the time required for working in the field by the working vehicle 10.
- the route content is information indicating whether or not the traveling route includes a reverse route and whether or not the traveling route includes an inner loop route.
- the storage unit 22 may store the travel route information D2 relating to one travel route, or may store the travel route information D2 relating to a plurality of travel routes. For example, when a specific operator generates a plurality of travel routes for one or a plurality of fields owned by the operator, the travel route information D2 for each travel route is stored in the storage unit 22. In addition, one traveling route may be set for one field, or a plurality of traveling routes may be set.
- FIG. 7 is an example of travelability information D3.
- the travelability information D3 indicates whether or not the work vehicle 10 can travel on each travel route registered in the travel route information D2 for each work vehicle 10 registered in the work vehicle information D1.
- the information to be shown is registered.
- the travel routes R1 and R2 including at least one of "reverse” and “inner loop” are “impossible”. Is registered, and "OK" is registered for the traveling route R3 that does not include both "backward” and "inner loop".
- a part or all of the information such as the work vehicle information D1, the travel route information D2, and the travelability information D3 may be stored in the server accessible from the operation terminal 20.
- the operator may perform an operation of registering the work vehicle information D1, the travel route information D2, and the travelability information D3 on the server (for example, a personal computer).
- the operation control unit 21 may acquire the information from the server and execute each process such as the automatic driving process (see FIG. 11) described later.
- the operation control unit 21 has control devices such as a CPU, ROM, and RAM.
- the CPU is a processor that executes various arithmetic processes.
- the ROM is a non-volatile storage unit in which control programs such as a BIOS and an OS for causing the CPU to execute various arithmetic processes are stored in advance.
- the RAM is a volatile or non-volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the operation control unit 21 controls the operation terminal 20 by executing various control programs stored in advance in the ROM or the storage unit 22 on the CPU.
- the operation control unit 21 includes a vehicle setting processing unit 211, a field setting processing unit 212, a work setting processing unit 213, a route generation processing unit 214, a route acquisition processing unit 215, a determination processing unit 216, and a notification processing. It includes various processing units such as unit 217, output processing unit 218, and display processing unit 219.
- the operation control unit 21 functions as the various processing units by executing various processes according to the control program on the CPU. Further, a part or all of the processing unit may be composed of an electronic circuit.
- the control program may be a program for causing a plurality of processors to function as the processing unit.
- the vehicle setting processing unit 211 sets information about the work vehicle 10 (hereinafter referred to as work vehicle information).
- the vehicle setting processing unit 211 refers to the model of the work vehicle 10, the position where the positioning antenna 174 is attached in the work vehicle 10, the type of the work machine 14, the size and shape of the work machine 14, and the work vehicle 10 of the work machine 14.
- Information such as the position, the working vehicle speed and engine rotation speed of the work vehicle 10, the turning vehicle speed and engine rotation speed of the work vehicle 10 is set by the operator performing an operation registered in the operation terminal 20. ..
- the field setting processing unit 212 sets information about the field F (hereinafter referred to as field information).
- the field setting processing unit 212 registers information such as the position and shape of the field F, the work start position S for starting the work, the work end position G for ending the work (see FIG. 3), the work direction, and the like on the operation terminal 20.
- the information is set by performing the operation.
- the work direction means a direction in which the work vehicle 10 is driven while working with the work machine 14 in the work area which is the area excluding the non-work area such as the headland and the non-cultivated land from the field F.
- the operator gets on the work vehicle 10 and operates so as to make one round around the outer circumference of the field F, and records the transition of the position information of the positioning antenna 174 at that time. By doing so, it can be acquired automatically. Further, the position and shape of the field F are based on a polygon obtained by the operator operating the operation terminal 20 and designating a plurality of points on the map while the map is displayed on the operation terminal 20. You can also get it.
- the region specified by the position and shape of the acquired field F is a region (traveling region) in which the work vehicle 10 can travel.
- the work setting processing unit 213 sets information (hereinafter referred to as work information) regarding how the work is concretely performed. As work information, the work setting processing unit 213 skips, which is the presence or absence of cooperative work between the work vehicle 10 (unmanned tractor) and the manned work vehicle 10, and the number of work routes to be skipped when the work vehicle 10 turns on the headland. The number, the width of the headland, the width of the non-cultivated land, etc. can be set.
- the route generation processing unit 214 generates a travel route R, which is a route for automatically traveling the work vehicle 10, based on the setting information.
- the travel route R is, for example, a work route from the work start position S to the work end position G (see FIG. 3).
- the travel route R shown in FIG. 3 is a route for reciprocating the work vehicle 10 in parallel in the work area of the field F.
- the route generation processing unit 214 generates and stores the travel route R of the work vehicle 10 based on the setting information set by the vehicle setting processing unit 211, the field setting processing unit 212, and the work setting processing unit 213. Can be done.
- the route generation processing unit 214 generates a travel route R (see FIG. 3) based on the work start position S and the work end position G registered in the field setting.
- the travel route R is not limited to the route shown in FIG.
- the operation control unit 21 stores the work vehicle information D1 (see FIG. 5), the travel route information D2 (see FIG. 6), and the travelability information D3 (see FIG. 7) in the storage unit 22. Specifically, the operation control unit 21 has the work vehicle information D1 and the travel route information D2 based on the setting information set by the vehicle setting processing unit 211, the field setting processing unit 212, and the work setting processing unit 213. And the travelability information D3 is stored in the storage unit 22.
- the route acquisition processing unit 215 acquires the travel route R of the work vehicle 10. Specifically, the operator is generated by the route generation processing unit 214 on the route selection screen P1 (see FIG. 8A and the like) displayed on the operation terminal 20 when the work by the work vehicle 10 is started in the predetermined field F. A desired travel route R is selected from the route list A1 including the plurality of travel routes R.
- the route acquisition processing unit 215 acquires a route selected by the operator (hereinafter, referred to as a selected route).
- FIG. 8A shows a state in which the selection route of “Route 001” is selected for the No. 1 field by the operator.
- FIG. 8B shows a state in which the selection route of “Route 002” is selected for the No. 1 field by the operator.
- the route acquisition processing unit 215 is an example of the route acquisition processing unit of the present invention.
- the determination processing unit 216 includes a travel route (corresponding to the first travel route of the present invention) in a direction different from the direction of the detection area K0 of the obstacle sensor 18 in the selection route acquired by the route acquisition processing unit 215. Judge whether or not. For example, when the work vehicle 10 performing the work is the work vehicle T4 (see FIG. 5) having the obstacle sensor 18 only in the front portion, the selected route acquired by the route acquisition processing unit 215 is the route name “R1”. (See FIG. 6), the determination processing unit 216 determines that a rear travel route (reverse route) different from the direction (forward) of the detection area K0 of the obstacle sensor 18 is included. The reverse route is an example of the first traveling route of the present invention.
- the selected route acquired by the route acquisition processing unit 215 is the route name ".
- the determination processing unit 216 determines that an inner traveling route (inner loop route) different from the direction (forward) of the detection area K0 of the obstacle sensor 18 is included. ..
- the inner loop route is an example of the first traveling route of the present invention.
- the notification processing unit 217 automatically travels the work vehicle 10 when the selection route acquired by the route acquisition processing unit 215 includes a travel route in a direction different from the direction of the detection area K0 of the obstacle sensor 18. Notify the inquiry as to whether or not to start. For example, as shown in FIG. 8A, when the operator selects the route "001" (corresponding to the route name "R1") and presses the route determination button B1 in the work by the work vehicle T4 (see FIG. 5), the selection route is described. Including a traveling route (reverse route) in a direction different from the direction (forward) of the detection area K0, the notification processing unit 217 causes the operation terminal 20 to display the inquiry shown in FIG. 9A.
- the notification processing unit 217 is an example of the notification processing unit of the present invention.
- the notification processing unit 217 causes the operation terminal 20 to display a work start instruction for starting automatic traveling of the selected route or a selection screen P2 capable of selecting a route change instruction for changing the selected route.
- the notification processing unit 217 displays warning information on the selection screen P2 that calls attention when the automatic traveling of the selected route is started.
- the notification processing unit 217 starts automatic driving in a state where the rear obstacle sensor 18 necessary for traveling on the reverse route is not installed on the selection screen P2 and the rear obstacle sensor 18 is not installed. In that case, the user monitors and ensures safety, permits automatic driving in a state where the obstacle sensor 18 at the rear is not installed, and displays a warning message M1 including disclaimers.
- the notification processing unit 217 has a work start button B2 that gives an instruction (work start instruction) to start automatic driving on the selection screen P2 in this state (a state in which the obstacle sensor 18 at the rear is not installed).
- the change button B3 that gives an instruction to change the setting of the selected route (route change instruction) is displayed.
- the notification processing unit 217 causes the operation terminal 20 to display the selection screen P2 shown in FIG. 9B.
- the notification processing unit 217 causes the operation terminal 20 to display the route selection screen P1 (see FIGS. 8A and 8B) again.
- the operator can change the selected route on the route selection screen P1.
- the notification processing unit 217 may present a traveling route that does not include the reverse route when the change button B3 is selected (route change instruction) by the operator on the route selection screen P1 shown in FIG. 8A. good. Further, the notification processing unit 217 may present a traveling route that does not include the inner loop route when the change button B3 is selected (route change instruction) by the operator on the route selection screen P1 shown in FIG. 8B. That is, when the route change instruction is selected, the notification processing unit 217 does not include a travel route (first travel route of the present invention) in a direction different from the direction of the detection area K0 of the obstacle sensor 18. To present. This makes it possible to prevent a traveling route including a traveling route (for example, a reverse route, an inner loop route) in a direction different from the direction of the detection area K0 of the obstacle sensor 18 from being selected as the selection route.
- a traveling route including a traveling route for example, a reverse route, an inner loop route
- the output processing unit 218 When the operator presses the work start button B2 on the selection screen P2, the output processing unit 218 outputs the information of the selection route to the work vehicle 10.
- the data of the travel route R (selection route) generated in the operation terminal 20 is transferred to the work vehicle 10 and stored in the storage unit 12, and the current position of the work vehicle 10 is determined by the positioning antenna 174. It is configured to be able to travel autonomously along the traveling route R while detecting.
- the current position of the work vehicle 10 usually coincides with the position of the positioning antenna 174.
- the work vehicle 10 is configured to be able to automatically travel when the current position is located inside the field F, and cannot automatically travel when the current position is located outside the field F (public road, etc.). It is configured in. Further, the work vehicle 10 is configured to be able to automatically travel, for example, when the current position coincides with the work start position S.
- the traveling processing unit 113 starts automatic traveling. Then, the work by the working machine 14 (see FIG. 2) is started. That is, the operation control unit 21 permits the automatic traveling of the work vehicle 10 on condition that the current position coincides with the work start position S.
- the conditions for permitting the automatic traveling of the work vehicle 10 are not limited to the above conditions.
- the travel processing unit 113 of the work vehicle 10 automatically travels the work vehicle 10 from the work start position S to the work end position G based on the travel route R (selection route) acquired from the operation terminal 20. Further, when the work vehicle 10 finishes the work, the travel processing unit 113 may automatically travel from the work end position G to the entrance of the field F.
- the operation control unit 21 can receive the state (position, traveling speed, etc.) of the work vehicle 10 from the work vehicle 10 and display it on the operation display unit 23.
- the operation control unit 21 is provided with a monitoring unit (camera, sensor, etc.) capable of monitoring a predetermined area in a direction different from the direction of the detection area K0 of the obstacle sensor 18 in the work vehicle 10.
- a monitoring unit camera, sensor, etc.
- a camera 15 an example of the monitoring unit of the present invention
- a direction different from the direction of the detection area K0 of the obstacle sensor 18 in the image pickup area is installed in the work vehicle 10. It is possible to select the work start instruction for automatic driving.
- the notification processing unit 217 when the detection area K0 of the obstacle sensor 18 is in front of the work vehicle 10 and the selected path includes the reverse path, the camera 15B set in the image pickup area K2 works behind. When installed in the vehicle 10, the notification processing unit 217 displays the work start button B2 on the selection screen P2. On the other hand, when the camera 15B is not installed in the work vehicle 10, the notification processing unit 217 does not display the work start button B2 on the selection screen P2.
- the operation control unit 21 may be configured to allow traveling in the direction of the predetermined area when the predetermined area can be monitored by at least one of the obstacle sensor 18 and the camera 15.
- the display processing unit 219 causes the operation terminal 20 to display the captured image captured by the camera 15 while the work vehicle 10 is automatically traveling. Specifically, as shown in FIG. 10A, the display processing unit 219 displays a camera image display column C1 for displaying the captured image of each camera 15 on the traveling state screen P3 displaying the automatic traveling state of the work vehicle 10. Display. The current state of the work vehicle 10 being automatically driven is displayed in real time on the running state screen P3. The operator can grasp the current running state and working state of the work vehicle 10 on the running state screen P3.
- the display processing unit 219 causes the camera image display field C1 to display each image display field L1 according to a preset layout.
- FIG. 10A shows an example of the traveling state screen P3 in which the captured image is displayed in each image display column L1.
- the captured image displayed in each image display field L1 is updated in real time.
- the numbers "1" to "5" in each image display column L1 are the cameras 15F (camera 1), 15B (camera 2), 15R (camera 3), 15L (camera 4), and 15C (camera 5) shown in FIG. 4B. Corresponds to.
- FIG. 10A and the like a display example of an actual captured image is omitted.
- the display processing unit 219 emphasizes and displays the image captured by the camera 15 including the direction different from the direction of the detection area K0 of the obstacle sensor 18 in the imaging area on the traveling state screen P3. For example, as shown in FIG. 10B, when the detection area K0 of the obstacle sensor 18 is in front of the work vehicle 10 and the selection path includes the reverse path, the display processing unit 219 includes the rear side in the image pickup area K2. The image captured by the camera 15B (camera 2) is enlarged and displayed. The display processing unit 219 may display, light, or blink the image display field L1 corresponding to the camera 15B (camera 2) in color.
- the display processing unit 219 may display only the image display field L1 corresponding to the camera 15B (camera 2) in the camera image display field C1 and hide the image display field L1 corresponding to the other camera 15. good.
- the display processing unit 219 is an example of the display processing unit of the present invention.
- the display processing unit 219 has an image pickup area on the right side.
- the image captured by the camera 15R (camera 3) included in K3 and the image captured by the camera 15C (camera 5) including the front of the working machine 14 in the imaging area K5 are enlarged and displayed.
- the operator can monitor the direction by the image captured by the camera 15 that has captured the direction.
- the detection processing unit 112 of the work vehicle 10 may detect an obstacle based on an image captured by the camera 15 that captures a direction different from the direction of the detection area K0 of the obstacle sensor 18. For example, the detection processing unit 112 analyzes the captured image to detect a specific obstacle such as a person or an object. Further, the traveling processing unit 113 may stop the automatic traveling of the work vehicle 10 when the detection processing unit 112 detects an obstacle based on the captured image.
- the operation terminal 20 may be able to access the website (agricultural support site) of the agricultural support service provided by the server (not shown) via the communication network N1.
- the operation terminal 20 can function as an operation terminal of the server by executing the browser program by the operation control unit 21.
- the server includes each of the above-mentioned processing units and executes each process.
- each function of the vehicle control device 11 and the detection processing device 19 described above may be included in the operation control unit 21 of the operation terminal 20. That is, for example, the operation control unit 21 may acquire measurement information from each obstacle sensor 18 of the work vehicle 10 and execute a process of detecting an obstacle. Further, each function of the detection processing device 19 (acquisition processing unit 111 and detection processing unit 112) may be included in the vehicle control device 11.
- the present invention is an invention of an automatic driving method in which the vehicle control device 11, the detection processing device 19, and the operation control unit 21 execute a part or all of the automatic driving process, or a part of the automatic driving method, or a part of the automatic driving method.
- the whole may be regarded as an invention of an automatic driving program for causing the vehicle control device 11 and the operation control unit 21 to execute the whole process.
- the automatic driving process may be executed by one or a plurality of processors.
- step S1 the operation control unit 21 causes the operation terminal 20 to display the route selection screen P1 (see FIG. 8A and the like).
- step S2 the operation control unit 21 acquires the selected route selected by the operator from the route list A1 including the plurality of traveling routes R generated by the route generation process on the route selection screen P1.
- step S3 the operation control unit 21 determines whether or not the acquired selected route includes a traveling route in a direction different from the direction of the detection area K0 of the obstacle sensor 18.
- the operation control unit 21 has acquired the selected route as the route name.
- the traveling route of "R1" see FIG. 6
- the operation control unit 21 uses the acquired selection route as the route.
- the traveling route see FIG. 6) of the name "R2"
- step S4 When the selected route includes a traveling route in a direction different from the direction of the detection area K0 of the obstacle sensor 18 (S3: Yes), the process proceeds to step S4. On the other hand, when the selected route does not include a traveling route in a direction different from the direction of the detection area K0 of the obstacle sensor 18 (S3: No), the process proceeds to step S6.
- step S4 the operation control unit 21 notifies an inquiry as to whether or not to start the automatic running of the work vehicle 10.
- the operation control is performed.
- the unit 21 causes the operation terminal 20 to display the selection screen P2 shown in FIG. 9A.
- the control unit 21 causes the operation terminal 20 to display the selection screen P2 shown in FIG. 9B.
- the operation control unit 21 gives an instruction (work start instruction) to start automatic driving on the selection screen P2 with the warning message M1 and the state as it is (the state where the obstacle sensor 18 at the rear is not installed).
- the start button B2 and the change button B3 for changing the setting of the selected route (route change instruction) are displayed.
- step S5 the operation control unit 21 determines whether or not the work start instruction has been accepted.
- the process proceeds to step S6.
- the operation control unit 21 does not accept the work start instruction (S5: No)
- the process proceeds to step S51.
- step S51 the operation control unit 21 determines whether or not the route change instruction has been accepted.
- the process returns to step S1. If the operation control unit 21 does not accept the route change instruction (S51: No), the process returns to step S5.
- step S6 the vehicle control device 11 starts the automatic running of the work vehicle 10. Specifically, when the operation control unit 21 outputs the information of the selected route to the work vehicle 10, the vehicle control device 11 acquires the selected route and starts automatic traveling along the selected route.
- step S7 the operation control unit 21 emphasizes and displays the image captured by the camera 15 including the direction different from the direction of the detection area K0 of the obstacle sensor 18 in the imaging area on the traveling state screen P3.
- the operation control unit 21 includes the rear side in the image pickup area K2.
- the image captured by the camera 15B (camera 2) is enlarged and displayed.
- step S8 the detection processing device 19 determines whether or not an obstacle has been detected. Specifically, the detection processing device 19 determines whether or not an obstacle is included in the detection area K0 based on the measurement information of the obstacle sensor 18. When the detection processing device 19 detects an obstacle (S8: Yes), the processing proceeds to step S9. On the other hand, when the detection processing device 19 does not detect an obstacle (S8: No), the processing proceeds to step S10.
- step S9 the vehicle control device 11 stops the automatic running of the work vehicle 10. After that, when the obstacle is removed, the vehicle control device 11 restarts the automatic driving based on, for example, an operator's instruction.
- step S10 the vehicle control device 11 determines whether or not the work vehicle 10 has completed the work.
- the process ends.
- the work vehicle 10 has not completed the work (S10: No)
- the process returns to step S7.
- the detection processing device 19 does not detect an obstacle
- the detection processing device 19 runs and works while monitoring by the obstacle sensor 18 and the camera 15 until the predetermined work is completed.
- the vehicle control device 11, the detection processing device 19, and the operation control unit 21 execute the automatic driving process as described above.
- the automatic traveling system 1 acquires the traveling route (selection route) of the work vehicle 10, is installed in the work vehicle 10 on the selection route, and has an obstacle around the work vehicle 10.
- a traveling path in a direction different from the direction of the detection area K0 of the obstacle sensor 18 for detecting an object is included, an inquiry as to whether or not to start automatic traveling of the work vehicle 10 is notified.
- the selected route includes a traveling route in a direction different from the direction of the detection area K0 of the obstacle sensor 18, the automatic traveling system 1 includes a warning message M1 on the selection screen P2 (FIG. 9A, FIG. 9B) is displayed on the operation terminal 20 to alert the operator, thereby ensuring the safety of the work vehicle 10.
- the operator can start the automatic running of the work vehicle 10 by monitoring the area that cannot be detected by the obstacle sensor 18. Further, the automatic traveling system 1 can ensure safety by capturing an area that cannot be detected by the obstacle sensor 18 with the camera 15 and displaying the captured image on the operation terminal 20. Therefore, since it is not necessary to install the obstacle sensor 18 in all directions of the work vehicle 10, it is possible to prevent an increase in cost while ensuring the safety of the work vehicle 10.
- the present invention is not limited to the above-described embodiment, and may be the following embodiment.
- the notification processing unit 217 notifies an inquiry as to whether or not to start the automatic running of the work vehicle 10 at the time when the automatic running of the work vehicle 10 is started. Specifically, the notification processing unit 217 can select a work start instruction for starting automatic traveling of the selected route or a route change instruction for changing the selected route at the time when the work start instruction is given to the work vehicle 10.
- the selection screen P2 is displayed on the operation display unit 23.
- the notification processing unit 217 may notify an inquiry as to whether or not to start the automatic traveling of the work vehicle 10 at the time when the travel route of the work vehicle 10 is generated. Specifically, the notification processing unit 217 can select a work start instruction for starting automatic traveling of the selected route or a route change instruction for changing the generated route when the route of the work vehicle 10 is generated. The selection screen P2 may be displayed on the operation display unit 23. As a result, by notifying the inquiry when the route is generated, it is possible to alert the operator before the work start time.
- the notification processing unit 217 may notify the inquiry at each of the time when the travel route of the work vehicle 10 is generated and the time when the automatic travel of the work vehicle 10 is started. As a result, even if the work vehicle 10 is different between the time when the traveling route is generated and the time when the automatic traveling is started, the operator is alerted and safety is ensured by notifying the inquiry at both times. can do.
- the notification processing unit 217 may notify the inquiry for each selection route. good.
- the selection route can be set for each of the plurality of work vehicles 10 in one operation terminal 20.
- the notification processing unit 217 of the operation terminal 20 can select a work start instruction for starting automatic traveling of the selected route or a route change instruction for changing the selected route for each selected route.
- P2 is displayed on the operation display unit 23.
- the operation control unit 21 may present to the operator a work vehicle 10 suitable for the selection route among the plurality of work vehicles 10. For example, when the operator owns a plurality of work vehicles 10 and each work vehicle 10 has an obstacle sensor 18 at a different position, when the operator selects a field and a travel route, the operation control unit 21 causes the operation control unit 21 to use the travel route. A work vehicle 10 having an obstacle sensor 18 whose direction is included in the detection area K0 is extracted and presented to the operator. As a result, the work can be performed by the work vehicle 10 that does not generate a blind spot in the traveling path.
- the operation control unit 21 can determine the optimum work vehicle 10 for the travel route (selection route) by referring to the work vehicle information D1, the travel route information D2, and the travel availability information D.
- the operation control unit 21 may present to the operator a travel route suitable for the work vehicle 10 among a plurality of travel routes. For example, when the operator sets a plurality of travel routes and the operator selects the field, the work vehicle 10, and the work machine 14, the operation control unit 21 extracts the travel routes that can be traveled by the work vehicle 10. , Present to the operator. As a result, the work vehicle 10 can travel on a travel route that does not generate a blind spot.
- the operation control unit 21 can determine the optimum travel route (selection route) for the work vehicle 10 by referring to the work vehicle information D1, the travel route information D2, and the travel availability information D.
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mechanical Engineering (AREA)
- Soil Sciences (AREA)
- Environmental Sciences (AREA)
- Guiding Agricultural Machines (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
図1及び図2に示すように、作業車両10は、車両制御装置11、記憶部12、走行装置13、作業機14、カメラ15、通信部16、測位装置17、障害物センサ18、及び検出処理装置19などを備える。車両制御装置11は、記憶部12、走行装置13、作業機14、及び測位装置17などに電気的に接続されている。なお、車両制御装置11及び測位装置17は、無線通信可能であってもよい。また、カメラ15及び障害物センサ18は、検出処理装置19に電気的に接続されている。
図1に示すように、操作端末20は、操作制御部21、記憶部22、操作表示部23、及び通信部24などを備える情報処理装置である。操作端末20は、タブレット端末、スマートフォンなどの携帯端末で構成されてもよい。
P3において、作業車両10の現在の走行状況及び作業状況を把握することができる。
以下、図11を参照しつつ、車両制御装置11、検出処理装置19、及び操作制御部21によって実行される前記自動走行処理の一例について説明する。例えば、前記自動走行処理は、オペレータが作業車両10の走行経路を設定する操作を開始した場合に車両制御装置11、検出処理装置19、及び操作制御部21によって開始される。
Claims (10)
- 作業車両の走行経路を取得することと、
前記走行経路に、前記作業車両に設置され、前記作業車両の周囲の障害物を検出する検出部の検出エリアの方向とは異なる方向の第1走行経路が含まれる場合に、前記作業車両の自動走行を開始するか否かの問い合わせを報知することと、
を実行する自動走行方法。 - 前記走行経路の前記自動走行を開始させる作業開始指示、又は、前記走行経路を変更する経路変更指示を選択可能な選択画面を表示させる、
請求項1に記載の自動走行方法。 - さらに、前記走行経路の前記自動走行を開始させる場合の注意を喚起する警告情報を前記選択画面に表示させる、
請求項2に記載の自動走行方法。 - 前記経路変更指示が選択された場合に、前記第1走行経路を含まない走行経路を提示する、
請求項2又は3に記載の自動走行方法。 - 前記第1走行経路の方向の所定エリアを監視可能な監視部が前記作業車両に設置されている場合に、前記作業開始指示を選択可能とする、
請求項2~4のいずれかに記載の自動走行方法。 - 前記監視部は、前記所定エリアを撮像する撮像部であって、
前記撮像部による撮像画像を強調して表示させる、
請求項5に記載の自動走行方法。 - 複数の前記作業車両のそれぞれに対応して前記走行経路が設定されている場合において、
前記走行経路ごとに、前記第1走行経路が含まれる場合に前記問い合わせを報知する、
請求項1~6のいずれかに記載の自動走行方法。 - 前記走行経路を生成した時点及び前記自動走行を開始する時点のそれぞれにおいて、前記問い合わせを報知する、
請求項1~7のいずれかに記載の自動走行方法。 - 作業車両の走行経路を取得する経路取得処理部と、
前記経路取得処理部により取得される前記走行経路に、前記作業車両に設置され、前記作業車両の周囲の障害物を検出する検出部の検出エリアの方向とは異なる方向の第1走行経路が含まれる場合に、前記作業車両の自動走行を開始するか否かの問い合わせを報知する報知処理部と、
を備える自動走行システム。 - 作業車両の走行経路を取得することと、
前記走行経路に、前記作業車両に設置され、前記作業車両の周囲の障害物を検出する検出部の検出エリアの方向とは異なる方向の第1走行経路が含まれる場合に、前記作業車両の自動走行を開始するか否かの問い合わせを報知することと、
を一又は複数のプロセッサーに実行させるための自動走行プログラム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202180076410.2A CN116569122A (zh) | 2020-12-02 | 2021-11-29 | 自动行驶系统、自动行驶方法以及自动行驶程序 |
KR1020237015509A KR20230113535A (ko) | 2020-12-02 | 2021-11-29 | 자동 주행 시스템, 자동 주행 방법, 및 자동 주행 프로그램 |
US18/039,948 US20240004390A1 (en) | 2020-12-02 | 2021-11-29 | Automatic traveling system, automatic traveling method, and automatic traveling program |
EP21900525.3A EP4256927A1 (en) | 2020-12-02 | 2021-11-29 | Automatic traveling system, automatic traveling method, and automatic traveling program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020200357A JP7485591B2 (ja) | 2020-12-02 | 2020-12-02 | 自動走行システム、自動走行方法、及び自動走行プログラム |
JP2020-200357 | 2020-12-02 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022118772A1 true WO2022118772A1 (ja) | 2022-06-09 |
Family
ID=81854124
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/043531 WO2022118772A1 (ja) | 2020-12-02 | 2021-11-29 | 自動走行システム、自動走行方法、及び自動走行プログラム |
Country Status (6)
Country | Link |
---|---|
US (1) | US20240004390A1 (ja) |
EP (1) | EP4256927A1 (ja) |
JP (1) | JP7485591B2 (ja) |
KR (1) | KR20230113535A (ja) |
CN (1) | CN116569122A (ja) |
WO (1) | WO2022118772A1 (ja) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015147149A1 (ja) | 2014-03-28 | 2015-10-01 | ヤンマー株式会社 | 自律走行作業車両 |
US20170118915A1 (en) * | 2015-11-03 | 2017-05-04 | Claas Selbstfahrende Erntemaschinen Gmbh | Surroundings detection device for agricultural work machines |
JP2017221222A (ja) * | 2017-09-13 | 2017-12-21 | ヤンマー株式会社 | 自律走行作業システム |
JP2019097454A (ja) * | 2017-11-30 | 2019-06-24 | 井関農機株式会社 | 作業車両 |
JP2020129995A (ja) * | 2019-02-14 | 2020-08-31 | 株式会社クボタ | 農業機械 |
JP2020171318A (ja) * | 2020-07-16 | 2020-10-22 | 株式会社クボタ | 自動走行作業車 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7016751B2 (ja) | 2018-03-29 | 2022-02-07 | ヤンマーパワーテクノロジー株式会社 | 運転支援システム |
-
2020
- 2020-12-02 JP JP2020200357A patent/JP7485591B2/ja active Active
-
2021
- 2021-11-29 WO PCT/JP2021/043531 patent/WO2022118772A1/ja active Application Filing
- 2021-11-29 KR KR1020237015509A patent/KR20230113535A/ko unknown
- 2021-11-29 CN CN202180076410.2A patent/CN116569122A/zh active Pending
- 2021-11-29 EP EP21900525.3A patent/EP4256927A1/en active Pending
- 2021-11-29 US US18/039,948 patent/US20240004390A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015147149A1 (ja) | 2014-03-28 | 2015-10-01 | ヤンマー株式会社 | 自律走行作業車両 |
US20170118915A1 (en) * | 2015-11-03 | 2017-05-04 | Claas Selbstfahrende Erntemaschinen Gmbh | Surroundings detection device for agricultural work machines |
JP2017221222A (ja) * | 2017-09-13 | 2017-12-21 | ヤンマー株式会社 | 自律走行作業システム |
JP2019097454A (ja) * | 2017-11-30 | 2019-06-24 | 井関農機株式会社 | 作業車両 |
JP2020129995A (ja) * | 2019-02-14 | 2020-08-31 | 株式会社クボタ | 農業機械 |
JP2020171318A (ja) * | 2020-07-16 | 2020-10-22 | 株式会社クボタ | 自動走行作業車 |
Also Published As
Publication number | Publication date |
---|---|
CN116569122A (zh) | 2023-08-08 |
JP7485591B2 (ja) | 2024-05-16 |
US20240004390A1 (en) | 2024-01-04 |
JP2022088098A (ja) | 2022-06-14 |
EP4256927A1 (en) | 2023-10-11 |
KR20230113535A (ko) | 2023-07-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022118772A1 (ja) | 自動走行システム、自動走行方法、及び自動走行プログラム | |
WO2022118771A1 (ja) | 自動走行システム、自動走行方法、及び自動走行プログラム | |
US20240004396A1 (en) | Autonomous Travel System, Autonomous Travel Method, And Autonomous Travel Program | |
WO2022130945A1 (ja) | 自動走行システム、自動走行方法、及び自動走行プログラム | |
WO2022118773A1 (ja) | 自動走行システム、自動走行方法、及び自動走行プログラム | |
JP7492469B2 (ja) | 自動走行方法、自動走行システム、及び自動走行プログラム | |
EP4295655A1 (en) | Display method, display terminal, and display program | |
US20240004384A1 (en) | Autonomous travel method, autonomous travel system, and autonomous travel program | |
US20240040948A1 (en) | Setting method, automatic run method, setting system, and setting program | |
US20240046716A1 (en) | Automatic run method, automatic run system, and automatic run program | |
JP2023010152A (ja) | 自動走行方法、自動走行システム、及び自動走行プログラム | |
JP2022061394A (ja) | 自律走行システム、自律走行方法、及び自律走行プログラム | |
JP2022078440A (ja) | 作業車両の制御システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21900525 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180076410.2 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18039948 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021900525 Country of ref document: EP Effective date: 20230703 |