WO2021075541A1 - Cargo handling work assistance device for cargo handling vehicle - Google Patents

Cargo handling work assistance device for cargo handling vehicle Download PDF

Info

Publication number
WO2021075541A1
WO2021075541A1 PCT/JP2020/039067 JP2020039067W WO2021075541A1 WO 2021075541 A1 WO2021075541 A1 WO 2021075541A1 JP 2020039067 W JP2020039067 W JP 2020039067W WO 2021075541 A1 WO2021075541 A1 WO 2021075541A1
Authority
WO
WIPO (PCT)
Prior art keywords
cargo handling
mark
handling vehicle
support device
work support
Prior art date
Application number
PCT/JP2020/039067
Other languages
French (fr)
Japanese (ja)
Inventor
琢磨 小野
結香子 安立
健人 榊原
稜 中屋
Original Assignee
株式会社豊田自動織機
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社豊田自動織機 filed Critical 株式会社豊田自動織機
Publication of WO2021075541A1 publication Critical patent/WO2021075541A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66FHOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
    • B66F9/00Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
    • B66F9/06Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
    • B66F9/075Constructional features or details
    • B66F9/20Means for actuating or controlling masts, platforms, or forks
    • B66F9/24Electrical devices or systems

Definitions

  • This disclosure relates to a cargo handling work support device for a cargo handling vehicle.
  • the fork positioning support device for a forklift disclosed in Patent Document 1 accepts the designation of a target point for moving the tip of the fork in the image displayed on the display.
  • the support device calculates the distance from the reference point at the tip of the fork to the target point.
  • the assistive device tracks the target point in the updated stereo image and outputs the calculated distance to the display.
  • the support device calculates the distance from the reference point, that is, the midpoint of the line segment connecting the tip of the left fork and the tip of the right fork to the target point.
  • numerical values indicating the calculated distance the distance along the x-axis, the distance along the y-axis, and the distance along the z-axis are displayed at the lower right of the screen. Further, on the same screen, three dotted arrows having a length corresponding to the distance along the x-axis, the distance along the y-axis, and the distance along the z-axis connecting the reference point to the target point are displayed.
  • the purpose of the present disclosure is to provide a cargo handling work support device for a cargo handling vehicle that can improve visibility.
  • the cargo handling work support device for a cargo handling vehicle includes a camera arranged to image the periphery of the cargo handling vehicle, a display unit configured to display a camera image captured by the camera, and a display unit.
  • the display unit includes a superimposition unit configured to superimpose and display information supporting the cargo handling work on the drawing area on the display screen of the cargo handling target whose position has been measured on the camera image.
  • FIG. 6A is a diagram for explaining the display contents on the display unit in the first state
  • FIG. 6B is a partially enlarged view of FIG. 6A
  • FIG. 8A is a diagram for explaining the display contents on the display unit in the second state
  • FIG. 8B is a partially enlarged view of FIG.
  • FIG. 8A Schematic plan view showing a pallet in the workplace and a forklift in the third state. The figure for demonstrating the display content in the display part in a 3rd state.
  • FIG. 11A is a schematic side view showing a pallet and a forklift in the workplace according to the modified example
  • FIG. 11B is a diagram for explaining the display contents on the display unit according to the modified example.
  • the cargo handling work support device for a cargo handling vehicle is used for a forklift remote control system, which is a remote control system for a cargo handling vehicle.
  • the forklift remote control system 10 includes a reach-type forklift 20 which is a cargo handling vehicle, and a remote control device 40 used for remotely controlling the traveling of the forklift 20 and the cargo handling by the cargo handling device.
  • the forklift 20 is arranged in the workplace. The operator can remotely control the forklift 20 in the work place from the operation room by using the remote control device 40.
  • the operator starts remote control of the forklift 20 from the state where the forklift 20 is located at a place away from the pallet in the work place. For example, the operator brings the forklift 20 closer to the pallet and inserts the fork into the hole of the pallet. By such an operation, the pallet can be used for loading or unloading.
  • the forklift 20 includes a machine base 21.
  • Reach legs 22a and 22b are arranged on the front side of the machine base 21.
  • the reach legs 22a and 22b extend forward.
  • the reach leg 22a is arranged on the right side in the traveling direction
  • the reach leg 22b is arranged on the left side in the traveling direction.
  • a right front wheel 23a is arranged at the front of the reach leg 22a.
  • a left front wheel 23b is arranged at the front of the reach leg 22b. In this way, the front wheels 23a and 23b are arranged on the front side of the machine base 21.
  • rear wheels 24 and caster wheels (training wheels) 25 are arranged at the rear of the machine base 21.
  • the rear wheel 24 is arranged on the left side of the machine base 21.
  • the caster wheel 25 is arranged on the right side of the machine base 21.
  • the rear wheels 24 are drive wheels and steering wheels.
  • the forklift 20 travels by rotating three wheels, that is, two front wheels 23a and 23b, and one rear wheel 24.
  • the machine base 21 is equipped with a traveling motor 26 which is a driving source of the forklift 20 and a battery 27 which is a power source of the traveling motor 26.
  • the traveling motor 26 When the traveling motor 26 is driven, the rear wheels 24 rotate.
  • the forklift 20 is provided with a cargo handling device 28 in front of the machine base 21.
  • the cargo handling device 28 includes a mast 29.
  • the mast 29 moves back and forth along the reach legs 22a and 22b by driving a reach cylinder (not shown).
  • Forks 30a and 30b are attached to the front of the mast 29 via the lift bracket 31.
  • Each fork 30a, 30b has a claw (hereinafter, referred to as a fork claw) Nf extending in the front direction, specifically, when the tilt angle is 0, in the horizontal direction.
  • the forks 30a and 30b move up and down along the mast 29. That is, the forklift 20 includes a fork claw Nf, which is a cargo handling portion that moves up and down.
  • the operator can operate by sitting in the driver's seat of the forklift 20.
  • the cargo handling vehicle may be an unmanned forklift without a driver's seat.
  • the forklift 20 is provided with a standing type driver's cab 32 at the rear of the machine base 21.
  • Steering tables 33a and 33b are arranged in front of and to the left of the driver's cab 32, respectively.
  • a direction lever 34 for traveling the forklift 20 and a plurality of cargo handling levers 35 for operating the cargo handling device 28 are arranged on the steering table 33a.
  • the direction lever 34 is operated to rotate the rear wheel 24 to drive the vehicle.
  • a steering wheel 36 for steering the rear wheels 24 is arranged on the steering table 33b.
  • a brake pedal 37 is arranged on the floor surface of the driver's cab 32.
  • the machine base 21 has two pillars 38 and a head guard 39.
  • the two pillars 38 are erected on the machine base 21.
  • the head guard 39 is fixed to the upper end of the pillar 38.
  • the driver's cab 32 is surrounded by two pillars 38 and a head guard 39.
  • the head guard 39 has a plate shape that extends in the horizontal direction, and has a square shape in a plan view.
  • the forklift 20 includes a forklift-mounted device 50.
  • the forklift-mounted device 50 includes a controller 51, a radio unit 52 which is a vehicle communication unit, an image processing unit 53, a radio 54 which is a vehicle communication unit, and two cameras 71 and 72.
  • the remote control device 40 includes an operation room side device 60 and radios 64 and 65 which are operation device communication units.
  • the operation room side device 60 includes a controller 61, an operation unit 62, and a display unit (monitor) 63.
  • the controllers 51 and 61 can be configured as a circuitry.
  • the circuit is one of 1) one or more processors that operate according to a computer program (software), 2) dedicated hardware (integrated circuit for specific applications: ASIC) that executes at least a part of various processes. Includes the above dedicated hardware circuits, or 3) combinations thereof.
  • the processor includes a CPU and a memory such as a RAM and a ROM, and the memory stores a program code or an instruction configured to cause the CPU to execute a process.
  • Memory or computer-readable media includes any available medium accessible by a general purpose or dedicated computer.
  • Radios 64 and 65 are located in the workplace.
  • the controller 61 is arranged in the operation room.
  • the controller 61 is connected to the radio 64 by a wired L1.
  • the controller 61 is connected to the radio 65 by a wired L2.
  • the wireless device 64 of the remote control device 40 and the wireless unit 52 of the forklift-mounted device 50 can perform wireless communication in both directions.
  • the radio 54 of the forklift-mounted device 50 can wirelessly communicate with the radio 65 of the remote control device 40.
  • the forklift 20 has a radio unit 52 and a radio 54
  • the remote control device 40 has a radio unit 52, a radio 54, and radios 64 and 65 that perform wireless communication.
  • the controller 61 of the remote control device 40 is connected to the operation unit 62 and the display unit 63.
  • the operation unit 62 is operated when the operator remotely controls the forklift 20.
  • the operation contents of the forklift 20 (lift, reach, tilt operation command values, speed, acceleration, steering angle operation command values, etc.) by the operator are sent to the controller 61.
  • the controller 61 wirelessly transmits vehicle control signals, for example, lift, reach, and tilt operation command values, and speed, acceleration, and steering angle operation command values to the radio unit 52 of the forklift-mounted device 50 via the radio 64. Send with.
  • the controller 51 In the forklift-mounted device 50, the controller 51, the wireless unit 52, and the image processing unit 53 are connected so as to be able to communicate with each other (for example, CAN communication).
  • the controller 51 can drive a traveling system actuator (for example, a traveling motor 26 and a steering motor (not shown)) and a cargo handling system actuator (for example, a lift cylinder, a reach cylinder, and a tilt cylinder (not shown)) according to an instruction from the remote control device 40. ..
  • the wireless unit 52 wirelessly transmits vehicle information including the vehicle speed of the forklift 20 and abnormality information (for example, obstacle detection information) to the controller 61 via the radio 64.
  • the controller 61 can remotely control the traveling of the forklift 20 and the cargo handling by the cargo handling device 28 via the radio 64, the radio unit 52, and the controller 51. That is, the operator remotely controls the forklift 20 by using the operation unit 62 of the remote control device 40 instead of the operation unit (direction lever 34, cargo handling lever 35, handle 36 or brake pedal 37) in FIG. can do.
  • the controller 61 sends the operation content to the forklift 20 via the radio 64.
  • the forklift 20 receives the operation content sent from the remote control device 40 via the wireless unit 52.
  • the controller 51 drives the actuator to execute a desired operation.
  • the camera 71 is arranged in the center of the lift bracket 31.
  • the camera 71 is attached so as to face forward and downward in order to image the front of the fork claw Nf.
  • the camera 71 takes an image of the lower part of the forklift 20 around the vehicle in the traveling direction while the vehicle is traveling.
  • the camera 72 is attached to the upper surface of the left reach leg 22b so as to face forward.
  • the camera 72 images the left front of the forklift 20. That is, the camera 72 monitors the obstacle at the leg destination.
  • the controller 51 sends the images captured by the cameras 71 and 72 to the remote control device 40 via the image processing unit 53 and the radio 54.
  • the remote control device 40 receives the camera image sent from the forklift 20 via the radio 65.
  • the controller 61 displays the camera image on the display unit 63 of the remote control device 40.
  • the display unit 63 is, for example, a desktop type display. The operator can operate while looking at the camera image displayed on the display unit 63.
  • FIG. 5 shows the center Cpf of the front surface 101 of the pallet 100, the midpoint Cfh of the line segment connecting the front wheels 23a and 23b, and the axle Axfh of the front wheels 23a and 23b.
  • the orthogonal line Lr1 passes through the midpoint Cfh and is orthogonal to the axle Axfh.
  • the shortest distance line Lmi is a straight line indicating the shortest distance from the midpoint Cfh to the virtual plane including the front surface 101.
  • the shortest distance line Lmi passes through the midpoint Cfh and is orthogonal to the virtual plane including the front surface 101. As shown in FIG. 7, lateral displacement is prevented by aligning the center Cpf on the shortest distance line Lmi.
  • the pallet 100 has a first pallet hole 102 on the right side and a second pallet hole 103 on the left side.
  • the pallet holes 102 and 103 have a rectangular cross section.
  • the front surface 101 of the pallet 100 When the front surface 101 of the pallet 100 is viewed from the front, the front surface 101 has a first pallet hole 102 opened between the center and the right end in the width direction, and a second pallet hole 102 between the center and the left end. 103 is open.
  • the front surface 101 has a right end mark 104 in the right end region (between the right end and the first pallet hole 102) as shown in FIG. 6A, and a left end region (left end and the second pallet hole 102) as shown in FIG. 6B.
  • the leftmost mark 105 is attached (between 103).
  • the controller 61 detects the position of the pallet 100 and the center of the pallet front surface 101 by reading the marks 104 and 105 with a camera.
  • the controller 61 which is a measurement unit, measures the position of the pallet 100, which is the cargo handling target, by image recognition based on the camera image.
  • the midpoint Cfh shown in FIG. 7 is the turning center.
  • the forklift 20 turns in-situ and aligns the orthogonal line Lr1 with the center Cpf as shown in FIG. This is an operation for preventing the angle shift.
  • the controller 61 which is a superimposing unit, can display the first mark Gm1 and the second mark Gm2 (see FIGS. 6A and 6B) on the display unit 63 so as to superimpose on the camera image.
  • Marks Gm1 and Gm2 are examples of information that supports cargo handling work.
  • the first mark Gm1 is displayed at a position having the plane coordinates of the first intersection where the virtual plane including the front surface 101 and the orthogonal line Lr1 intersect and the same height as the center Cpf.
  • the second mark Gm2 is displayed at a position having the plane coordinates of the second intersection where the virtual plane including the front surface 101 and the shortest distance line Lmi intersect and the same height as the center Cpf.
  • the marks Gm1 and Gm2 are guide marks for notifying that the plane coordinates on the shortest distance line Lmi match the center Cpf and that the plane coordinates on the orthogonal line Lr1 match the center Cpf.
  • the first mark Gm1 and the second mark Gm2 may be displayed at positions different from the center Cpf.
  • the mark Gm1 may be a figure of ⁇
  • the mark Gm2 may be a diamond-shaped figure.
  • the marks Gm1 and Gm2 can be displayed in different colors. Each of the marks Gm1 and Gm2 can indicate a change in the situation by changing the display color thereof.
  • the mark Gm1 and the mark Gm2 overlap in the camera image.
  • the positional relationship when the forklift 20 faces the front surface 101 of the pallet straight is called the front position.
  • directing the front of the cargo handling vehicle to the front of the cargo handling object is referred to as "alignment".
  • the axle Axfh of the forklift 20 is parallel to the pallet front 101.
  • the marks Gm1 and Gm2 are used to face the front surface of the cargo handling vehicle to the front surface of the cargo handling object.
  • FIG. 5 shows a schematic plane of the pallet 100 and the forklift 20 in the workplace.
  • FIG. 6A shows the display contents on the display unit 63 when the forklift 20 approaches the front surface 101 of the pallet 100 from an oblique right direction.
  • FIG. 7 shows a schematic plane of the pallet 100 and the forklift 20 in the second state in the workplace, and the display contents on the display unit 63 at that time are shown in FIGS. 8A and 8B.
  • FIG. 9 shows a schematic plane of the pallet 100 and the forklift 20 in the third state in the workplace
  • FIG. 10 shows the display contents on the display unit 63 at that time.
  • the controller 61 measures the position of the pallet 100 by image recognition based on the camera image in the first state.
  • the lateral displacement amount ⁇ L and the angular deviation amount ⁇ with respect to the front position in the first state become zero by the operation described later.
  • the lateral displacement amount ⁇ L is the distance between the vertical line and the turning center with respect to the front surface 101 extending from the center Cpf.
  • the angle deviation amount ⁇ is an angle formed by the shortest distance line Lmi and the orthogonal line Lr1.
  • the second mark Gm2 is displayed superimposed on the front surface 101, and the first mark Gm1 is displayed superimposed on the left end region (left end mark 105) of the front surface 101. That is, the first mark Gm1 is displayed at a position horizontally deviated from the second mark Gm2, and the mark Gm1 and the mark Gm2 do not overlap.
  • the mark Gm1 is displayed in red and the mark Gm2 is also displayed in red.
  • the controller 61 may indicate that the first state is reached when the marks Gm1 and Gm2 overlap the front surface 101 or when the marks 104 and 105 are read by the camera.
  • the first state can be indicated by, for example, changing the display colors of the marks Gm1 and Gm2.
  • the operator performs an operation of aligning the plane coordinates of the intersection of the shortest distance line Lmi and the virtual plane with the center Cpf, as shown in FIGS. 7, 8A and 8B.
  • the forklift 20 is made to go straight from the first state shown in FIG.
  • the second state is reached in which the shortest distance line Lmi and the center Cpf overlap in a plan view.
  • the second state as shown in FIG. 7, since the plane coordinates of the second intersection coincide with the plane coordinates of the center Cpf, the lateral displacement amount ⁇ L becomes zero. At this time, the amount of angular deviation ⁇ with respect to the front position remains.
  • the color of the mark Gm2 can be changed. Specifically, the color of the mark Gm2 is changed from the previous red color to green color. Therefore, the second state is indicated by the change in the color of the mark Gm2. At this time, as shown in FIGS. 8A and 8B, the mark Gm1 and the mark Gm2 do not overlap in the camera image of the display unit 63.
  • the operator turns right at the maximum steering angle as shown in FIGS. 9 and 10.
  • the orthogonal line Lr1 becomes the third state where the orthogonal line Lr1 overlaps with the center Cpf in a plan view.
  • the mark Gm1 and the mark Gm2 overlap and the color of the mark Gm1 is changed. Specifically, the color of the mark Gm1 is changed from red to green. In this way, the third state is indicated by the change in the color of the mark Gm1.
  • the operator sees that the color of the mark Gm1 has changed, recognizes that the third state has been reached, and stops the turning of the forklift 20. As a result, the forklift 20 is arranged at a front position directly facing the front surface 101 of the pallet.
  • the operator moves the forks 30a and 30b upward or downward to adjust the heights of the forks 30a and 30b. Then, the forks 30a and 30b are moved forward and inserted into the holes 102 and 103 of the pallet 100. When the insertion is completed, the operator lifts the pallet 100. Further, the operator moves the forklift 20 backward and moves the pallet 100 to a desired place.
  • the forklift 20 can be correctly aligned with the pallet 100 with high accuracy and with little lateral deviation and angular deviation. This makes it possible to insert the fork claw Nf into the pallet holes 102 and 103.
  • the palette 100 is measured by image recognition of the camera. As a result, the operator can know at which position on the camera screen the palette 100 is displayed. Information (marks Gm1 and Gm2) is superimposed and drawn on the area where the palette 100 is displayed on the camera image.
  • information (marks Gm1, Gm2) is displayed on the cargo handling target of the camera image. This eliminates the need for the operator to check other indicators. Therefore, the operator does not need to move the line of sight, and intuitive operation is possible. In addition, it is possible to prevent confusion due to excessive information.
  • the cargo handling work support device of the forklift 20 has a camera 71 that images the periphery of the forklift 20, a display unit 63 for displaying the camera image captured by the camera 71, and a position on the camera image on the display unit 63.
  • the controller 61 is a superimposing unit that superimposes and displays information (marks Gm1 and Gm2) that support cargo handling work on a drawing area on the display screen of the measured cargo handling object (pallet 100). Therefore, when looking at the pallet 100, which is the cargo handling target, the movement of the line of sight can be reduced and the visibility can be improved.
  • the information (marks Gm1, Gm2) to be supported is superimposed on the cargo handling target (picking target), and the movement of the line of sight is reduced (minimized) when the cargo handling target (pallet 100) is being viewed. Visibility can be improved.
  • the cargo handling work support device for the cargo handling vehicle is used in the forklift remote control system 10, which is a remote control system for the cargo handling vehicle.
  • the remote control system 10 for a forklift includes a cargo handling vehicle (forklift 20) and a remote control device 40.
  • the forklift 20 includes a cargo handling device 28 on the machine base 21 and a vehicle communication unit (radio unit 52 and radio 54).
  • the remote control device 40 has an operation device communication unit (radio 64, 65) that performs wireless communication with the radio unit 52 and the radio 54, and is used for remotely controlling the traveling of the forklift 20 and the cargo handling by the cargo handling device 28. Be done. Therefore, when the operator remotely controls the forklift 20 according to only the image of the camera, the visibility can be improved.
  • the embodiment may be changed as follows, for example.
  • the cargo handling work support device is equipped with a notification unit, and the notification of this notification unit indicates that "the first state has been reached", "the second state has been reached", or "the third state has been reached”. At least one of them may be shown.
  • the notification unit may be, for example, a speaker that emits sound, a lamp that emits light, or a vibrator that emits vibration.
  • the notification unit may change the quality or pattern of sound, light, or vibration when performing different notifications.
  • the notification unit may be a part of the display unit (monitor).
  • the information that supports cargo handling work is not limited to marks Gm1 and Gm2, but may be numbers, for example.
  • the lateral displacement amount ⁇ L and the angular deviation amount ⁇ may be expressed numerically on the camera screen.
  • the mark may be used for adjusting the height of the fork claw Nf, which is a cargo handling portion.
  • the pallet 100 is placed on the shelf board 301 of the rack 300.
  • the difference ⁇ H in the height of the fork claw Nf with respect to the height of the pallet 100 is measured by image recognition of the camera.
  • An indicator 200 representing the difference ⁇ H is superimposed on the screen of the display unit 63 shown in FIG. 11B.
  • On the indicator 200 a center point 201 in the height direction on the front surface 101 of the pallet and an index 202 indicating the height of the fork claw Nf with respect to the center point 201 are drawn.
  • the difference between the center point 201 and the index 202 on the indicator 200 corresponds to the difference ⁇ H between the height of the pallet 100 and the height of the fork claw Nf.
  • the cargo handling target may be the cargo itself.
  • ⁇ Information (marks Gm1, Gm2) may be displayed at a position that does not overlap with the front 101. In short, the information may be displayed on the display screen of the cargo handling target.
  • the center Cpf of the front surface 101 of the pallet may be detected from the contour of the pallet by, for example, image recognition without using the marks 104 and 105.
  • the position of the cargo handling target with the sensor may be measured in three dimensions using the sensor, for example.
  • the cargo handling target is the section of the shelf board on which the load is placed in the rack.
  • the cargo handling target is the section of the rack shelf board, and it is advisable to mark the rack shelf board when you want to place the load in the narrow space between the luggage on the rack shelf board.
  • the camera When performing loading work, if it becomes difficult to image the front of the vehicle, the camera may be placed at the left end or the right end of the lift bracket 31.
  • the cargo handling work support device of the cargo handling vehicle may be used for, for example, a manned forklift.
  • the manned forklift may include a camera and a display.
  • the cargo handling vehicle may be a counter-type forklift.
  • the cargo handling vehicle may be a vehicle other than a forklift.

Landscapes

  • Engineering & Computer Science (AREA)
  • Transportation (AREA)
  • Structural Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Civil Engineering (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Geology (AREA)
  • Mechanical Engineering (AREA)
  • Forklifts And Lifting Vehicles (AREA)

Abstract

This cargo handling work assistance device for a cargo handling vehicle comprises: a camera that is disposed so as to capture an image of the surroundings of the cargo handling vehicle; a display unit that is configured so as to display the camera image captured by the camera; and an overlay unit that is configured so as to display information for assisting in cargo handling work in the display unit by overlaying the same on the camera image, at the drawing area on the display screen of a cargo to be handled, the position of which has been measured.

Description

荷役車両の荷役作業支援装置Cargo handling work support device for cargo handling vehicles
 本開示は、荷役車両の荷役作業支援装置に関するものである。 This disclosure relates to a cargo handling work support device for a cargo handling vehicle.
 特許文献1に開示のフォークリフトのフォーク位置決め支援装置は、ディスプレイに表示された画像内でフォーク先端を移動させる目標点の指定を受け付ける。支援装置は、フォーク先端の基準点から目標点までの距離を算出する。支援装置は、更新されたステレオ画像内で目標点を追跡し、算出された距離をディスプレイに出力する。詳しくは、支援装置は、基準点、すなわち左側のフォークの先端と右側のフォークの先端とを結ぶ線分の中点から目標点までの距離を計算する。計算された距離を示す数値として、x軸に沿う距離、y軸に沿う距離、及びz軸に沿う距離が画面右下に表示される。さらに、同じ画面に、基準点から目標点までを結ぶ、x軸に沿う距離、y軸に沿う距離、z軸に沿う距離にそれぞれ対応した長さの3つの点線の矢印が表示される。 The fork positioning support device for a forklift disclosed in Patent Document 1 accepts the designation of a target point for moving the tip of the fork in the image displayed on the display. The support device calculates the distance from the reference point at the tip of the fork to the target point. The assistive device tracks the target point in the updated stereo image and outputs the calculated distance to the display. Specifically, the support device calculates the distance from the reference point, that is, the midpoint of the line segment connecting the tip of the left fork and the tip of the right fork to the target point. As numerical values indicating the calculated distance, the distance along the x-axis, the distance along the y-axis, and the distance along the z-axis are displayed at the lower right of the screen. Further, on the same screen, three dotted arrows having a length corresponding to the distance along the x-axis, the distance along the y-axis, and the distance along the z-axis connecting the reference point to the target point are displayed.
特開2013-86959号公報Japanese Unexamined Patent Publication No. 2013-86959
 荷役車両であるフォークリフトの荷役作業を支援する際に、目標点であるパレットとフォーク先端との偏差情報が、画面上に映し出されたパレットとは離れた位置に描画されていると、視線の移動距離が大きく作業がしにくい。 When supporting the cargo handling work of a forklift, which is a cargo handling vehicle, if the deviation information between the pallet, which is the target point, and the tip of the fork is drawn at a position away from the pallet projected on the screen, the line of sight moves. The distance is large and it is difficult to work.
 本開示の目的は、視認性を向上することができる荷役車両の荷役作業支援装置を提供することにある。 The purpose of the present disclosure is to provide a cargo handling work support device for a cargo handling vehicle that can improve visibility.
 本開示の一態様に係る荷役車両の荷役作業支援装置は、荷役車両の周辺を撮像するように配置されたカメラと、前記カメラが撮像したカメラ画像を表示するように構成された表示部と、前記表示部において前記カメラ画像に、位置を計測した荷役対象の表示画面上の描画領域に荷役作業を支援する情報を重畳して表示させるように構成された重畳部と、を備える。 The cargo handling work support device for a cargo handling vehicle according to one aspect of the present disclosure includes a camera arranged to image the periphery of the cargo handling vehicle, a display unit configured to display a camera image captured by the camera, and a display unit. The display unit includes a superimposition unit configured to superimpose and display information supporting the cargo handling work on the drawing area on the display screen of the cargo handling target whose position has been measured on the camera image.
実施形態に係るフォークリフト用遠隔操作システムの電気的構成を示すブロック図。The block diagram which shows the electric structure of the remote control system for a forklift which concerns on embodiment. 実施形態に係るフォークリフトを示す概略側面図。The schematic side view which shows the forklift which concerns on embodiment. 図2のフォークリフトの一部を破断して示す概略斜視図。The schematic perspective view which shows by breaking a part of the forklift of FIG. 図2のフォークリフトを模式的に示す平面図。The plan view which shows typically the forklift of FIG. 作業場でのパレット及び第1状態のフォークリフトを示す概略平面図。Schematic plan view showing a pallet in the workplace and a forklift in the first state. 図6Aは第1状態における表示部での表示内容を説明するための図で、図6Bは図6Aの一部拡大図。FIG. 6A is a diagram for explaining the display contents on the display unit in the first state, and FIG. 6B is a partially enlarged view of FIG. 6A. 作業場でのパレット及び第2状態のフォークリフトを示す概略平面図。Schematic plan view showing a pallet in the workplace and a forklift in the second state. 図8Aは第2状態における表示部での表示内容を説明するための図で、図8Bは図8Aの一部拡大図。FIG. 8A is a diagram for explaining the display contents on the display unit in the second state, and FIG. 8B is a partially enlarged view of FIG. 8A. 作業場でのパレット及び第3状態のフォークリフトを示す概略平面図。Schematic plan view showing a pallet in the workplace and a forklift in the third state. 第3状態における表示部での表示内容を説明するための図。The figure for demonstrating the display content in the display part in a 3rd state. 図11Aは変更例に係る作業場でのパレット及びフォークリフトを示す概略側面図、図11Bは変更例に係る表示部での表示内容を説明するための図。FIG. 11A is a schematic side view showing a pallet and a forklift in the workplace according to the modified example, and FIG. 11B is a diagram for explaining the display contents on the display unit according to the modified example.
 以下、荷役車両の荷役作業支援装置の一実施形態を図面に従って説明する。 Hereinafter, an embodiment of the cargo handling work support device for the cargo handling vehicle will be described with reference to the drawings.
 本実施形態に係る荷役車両の荷役作業支援装置は、荷役車両用遠隔操作システムであるフォークリフト用遠隔操作システムに用いられる。 The cargo handling work support device for a cargo handling vehicle according to the present embodiment is used for a forklift remote control system, which is a remote control system for a cargo handling vehicle.
 図1に示すように、フォークリフト用遠隔操作システム10は、荷役車両であるリーチ式のフォークリフト20と、フォークリフト20の走行及び荷役装置による荷役を遠隔操作するのに用いられる遠隔操作装置40と、を備えている。フォークリフト20は作業場に配置される。操作者は、遠隔操作装置40を用いて操作室から作業場にあるフォークリフト20を遠隔操作することができる。 As shown in FIG. 1, the forklift remote control system 10 includes a reach-type forklift 20 which is a cargo handling vehicle, and a remote control device 40 used for remotely controlling the traveling of the forklift 20 and the cargo handling by the cargo handling device. I have. The forklift 20 is arranged in the workplace. The operator can remotely control the forklift 20 in the work place from the operation room by using the remote control device 40.
 フォークリフト20が作業場においてパレットから離れた場所に位置している状態から、操作者はフォークリフト20の遠隔操作を開始する。例えば、操作者は、フォークリフト20をパレットに近づけてパレットの穴にフォークを差し込む動作を行わせる。こうした動作により、パレットによる荷取りまたは荷置きを行うことができる。 The operator starts remote control of the forklift 20 from the state where the forklift 20 is located at a place away from the pallet in the work place. For example, the operator brings the forklift 20 closer to the pallet and inserts the fork into the hole of the pallet. By such an operation, the pallet can be used for loading or unloading.
 図2及び図3に示すように、フォークリフト20は機台21を備える。機台21の前側にはリーチレグ22a,22bが配置されている。リーチレグ22a,22bは前方に向かって延びている。詳しくは、リーチレグ22aは進行方向右側に配置され、リーチレグ22bは進行方向左側に配置されている。リーチレグ22aの前部には右前輪23aが配置されている。リーチレグ22bの前部には左前輪23bが配置されている。このように、機台21の前側には前輪23a,23bが配置されている。 As shown in FIGS. 2 and 3, the forklift 20 includes a machine base 21. Reach legs 22a and 22b are arranged on the front side of the machine base 21. The reach legs 22a and 22b extend forward. Specifically, the reach leg 22a is arranged on the right side in the traveling direction, and the reach leg 22b is arranged on the left side in the traveling direction. A right front wheel 23a is arranged at the front of the reach leg 22a. A left front wheel 23b is arranged at the front of the reach leg 22b. In this way, the front wheels 23a and 23b are arranged on the front side of the machine base 21.
 図2、図3及び図4に示すように、機台21の後部には、後輪24とキャスタホイール(補助輪)25が配置されている。後輪24は機台21の左側に配置されている。キャスタホイール25は機台21の右側に配置されている。後輪24は、駆動輪及び操舵輪である。 As shown in FIGS. 2, 3 and 4, rear wheels 24 and caster wheels (training wheels) 25 are arranged at the rear of the machine base 21. The rear wheel 24 is arranged on the left side of the machine base 21. The caster wheel 25 is arranged on the right side of the machine base 21. The rear wheels 24 are drive wheels and steering wheels.
 図2及び図4に示すように、フォークリフト20は3つの車輪、すなわち2つの前輪23a,23b、及び、1つの後輪24の回転により走行する。図2に示すように、機台21には、フォークリフト20の駆動源である走行モータ26と、走行モータ26の電力源であるバッテリ27が搭載されている。走行モータ26が駆動すると、後輪24が回転する。 As shown in FIGS. 2 and 4, the forklift 20 travels by rotating three wheels, that is, two front wheels 23a and 23b, and one rear wheel 24. As shown in FIG. 2, the machine base 21 is equipped with a traveling motor 26 which is a driving source of the forklift 20 and a battery 27 which is a power source of the traveling motor 26. When the traveling motor 26 is driven, the rear wheels 24 rotate.
 図2に示すように、フォークリフト20は、機台21の前方に、荷役装置28を備える。荷役装置28はマスト29を備える。マスト29は、リーチシリンダ(図示せず)の駆動により、リーチレグ22a,22bに沿って前後に移動する。マスト29の前方には、フォーク30a,30bがリフトブラケット31を介して取り付けられている。各フォーク30a,30bは、前方、詳しくはティルト角が0の時に水平方向に延びる爪(以下、フォーク爪という)Nfを有する。フォーク30a,30bは、マスト29に沿って昇降する。即ち、フォークリフト20は、上下動する荷役部であるフォーク爪Nfを備える。 As shown in FIG. 2, the forklift 20 is provided with a cargo handling device 28 in front of the machine base 21. The cargo handling device 28 includes a mast 29. The mast 29 moves back and forth along the reach legs 22a and 22b by driving a reach cylinder (not shown). Forks 30a and 30b are attached to the front of the mast 29 via the lift bracket 31. Each fork 30a, 30b has a claw (hereinafter, referred to as a fork claw) Nf extending in the front direction, specifically, when the tilt angle is 0, in the horizontal direction. The forks 30a and 30b move up and down along the mast 29. That is, the forklift 20 includes a fork claw Nf, which is a cargo handling portion that moves up and down.
 操作者は、フォークリフト20の運転席に着座して操作することが可能である。荷役車両は、運転席を備えない無人フォークリフトであってもよい。 The operator can operate by sitting in the driver's seat of the forklift 20. The cargo handling vehicle may be an unmanned forklift without a driver's seat.
 図3に示すように、フォークリフト20は、立席タイプの運転室32を機台21の後部に備える。運転室32の前方及び左方には、それぞれステアリングテーブル33a,33bが配置されている。ステアリングテーブル33aには、フォークリフト20を走行させるためのディレクションレバー34と、荷役装置28を動作させるための複数の荷役レバー35とが配置されている。ディレクションレバー34は、後輪24を回転させて車両を走行させるべく操作される。ステアリングテーブル33bには、後輪24の操舵を行うためのハンドル36が配置されている。運転室32の床面にはブレーキペダル37が配置されている。 As shown in FIG. 3, the forklift 20 is provided with a standing type driver's cab 32 at the rear of the machine base 21. Steering tables 33a and 33b are arranged in front of and to the left of the driver's cab 32, respectively. On the steering table 33a, a direction lever 34 for traveling the forklift 20 and a plurality of cargo handling levers 35 for operating the cargo handling device 28 are arranged. The direction lever 34 is operated to rotate the rear wheel 24 to drive the vehicle. A steering wheel 36 for steering the rear wheels 24 is arranged on the steering table 33b. A brake pedal 37 is arranged on the floor surface of the driver's cab 32.
 図2及び図3に示すように、機台21は2本のピラー38とヘッドガード39を有する。2本のピラー38は機台21上に立てられている。ヘッドガード39はピラー38の上端に固定されている。運転室32は、2本のピラー38と、ヘッドガード39とにより囲まれている。ヘッドガード39は、水平方向に拡がる板状であり、平面視において四角形状を有する。 As shown in FIGS. 2 and 3, the machine base 21 has two pillars 38 and a head guard 39. The two pillars 38 are erected on the machine base 21. The head guard 39 is fixed to the upper end of the pillar 38. The driver's cab 32 is surrounded by two pillars 38 and a head guard 39. The head guard 39 has a plate shape that extends in the horizontal direction, and has a square shape in a plan view.
 図1に示すように、フォークリフト20は、フォークリフト搭載機器50を備える。フォークリフト搭載機器50は、コントローラ51と、車両通信部である無線ユニット52と、画像処理部53と、車両通信部である無線機54と、2台のカメラ71,72とを含む。 As shown in FIG. 1, the forklift 20 includes a forklift-mounted device 50. The forklift-mounted device 50 includes a controller 51, a radio unit 52 which is a vehicle communication unit, an image processing unit 53, a radio 54 which is a vehicle communication unit, and two cameras 71 and 72.
 遠隔操作装置40は、操作室側機器60と、操作装置通信部である無線機64,65とを有する。操作室側機器60は、コントローラ61と、操作部62と、表示部(モニタ)63とを含む。 The remote control device 40 includes an operation room side device 60 and radios 64 and 65 which are operation device communication units. The operation room side device 60 includes a controller 61, an operation unit 62, and a display unit (monitor) 63.
 コントローラ51,61は、回路(circuitry)として構成し得る。回路は、1)コンピュータプログラム(ソフトウェア)に従って動作する1つ以上のプロセッサ、2)各種処理のうち少なくとも一部の処理を実行する専用のハードウェア(特定用途向け集積回路:ASIC)等の1つ以上の専用のハードウェア回路、或いは3)それらの組み合わせ、を含む。プロセッサは、CPU並びに、RAM及びROM等のメモリを含み、メモリは、処理をCPUに実行させるように構成されたプログラムコードまたは指令を格納している。メモリすなわちコンピュータ可読媒体は、汎用または専用のコンピュータでアクセスできるあらゆる利用可能な媒体を含む。 The controllers 51 and 61 can be configured as a circuitry. The circuit is one of 1) one or more processors that operate according to a computer program (software), 2) dedicated hardware (integrated circuit for specific applications: ASIC) that executes at least a part of various processes. Includes the above dedicated hardware circuits, or 3) combinations thereof. The processor includes a CPU and a memory such as a RAM and a ROM, and the memory stores a program code or an instruction configured to cause the CPU to execute a process. Memory or computer-readable media includes any available medium accessible by a general purpose or dedicated computer.
 無線機64,65は作業場に配置されている。コントローラ61は操作室に配置される。コントローラ61は有線L1により無線機64と接続されている。コントローラ61は有線L2により無線機65と接続されている。 Radios 64 and 65 are located in the workplace. The controller 61 is arranged in the operation room. The controller 61 is connected to the radio 64 by a wired L1. The controller 61 is connected to the radio 65 by a wired L2.
 作業場において、遠隔操作装置40の無線機64とフォークリフト搭載機器50の無線ユニット52とは双方向に無線通信できる。作業場において、フォークリフト搭載機器50の無線機54は遠隔操作装置40の無線機65に無線で通信できる。 In the workplace, the wireless device 64 of the remote control device 40 and the wireless unit 52 of the forklift-mounted device 50 can perform wireless communication in both directions. In the workplace, the radio 54 of the forklift-mounted device 50 can wirelessly communicate with the radio 65 of the remote control device 40.
 このように、フォークリフト20は無線ユニット52及び無線機54を有し、遠隔操作装置40は、無線ユニット52と、無線機54と、無線通信を行う無線機64,65とを有する。 As described above, the forklift 20 has a radio unit 52 and a radio 54, and the remote control device 40 has a radio unit 52, a radio 54, and radios 64 and 65 that perform wireless communication.
 遠隔操作装置40のコントローラ61は操作部62及び表示部63と接続されている。操作部62は、操作者がフォークリフト20を遠隔操作する際に操作される。操作者によるフォークリフト20の操作内容(リフト、リーチ、ティルトの操作指令値、及び、速度、加速度、操舵角の操作指令値等)がコントローラ61に送られる。コントローラ61は、車両制御信号、例えば、リフト、リーチ、ティルトの操作指令値、及び、速度、加速度、操舵角の操作指令値を、無線機64を介してフォークリフト搭載機器50の無線ユニット52に無線で送信する。 The controller 61 of the remote control device 40 is connected to the operation unit 62 and the display unit 63. The operation unit 62 is operated when the operator remotely controls the forklift 20. The operation contents of the forklift 20 (lift, reach, tilt operation command values, speed, acceleration, steering angle operation command values, etc.) by the operator are sent to the controller 61. The controller 61 wirelessly transmits vehicle control signals, for example, lift, reach, and tilt operation command values, and speed, acceleration, and steering angle operation command values to the radio unit 52 of the forklift-mounted device 50 via the radio 64. Send with.
 フォークリフト搭載機器50において、コントローラ51と無線ユニット52と画像処理部53とは、相互に通信(例えばCAN通信)可能に接続されている。コントローラ51は遠隔操作装置40からの指示により走行系アクチュエータ(例えば、走行モータ26及び図示しない操舵モータ)及び荷役系アクチュエータ(例えば、図示しないリフトシリンダ、リーチシリンダ、ティルトシリンダ)を駆動することができる。 In the forklift-mounted device 50, the controller 51, the wireless unit 52, and the image processing unit 53 are connected so as to be able to communicate with each other (for example, CAN communication). The controller 51 can drive a traveling system actuator (for example, a traveling motor 26 and a steering motor (not shown)) and a cargo handling system actuator (for example, a lift cylinder, a reach cylinder, and a tilt cylinder (not shown)) according to an instruction from the remote control device 40. ..
 無線ユニット52は、フォークリフト20の車速を含む車両情報、異常情報(例えば、障害物検知情報)を、無線機64を介してコントローラ61に無線送信する。 The wireless unit 52 wirelessly transmits vehicle information including the vehicle speed of the forklift 20 and abnormality information (for example, obstacle detection information) to the controller 61 via the radio 64.
 図1において、コントローラ61は、無線機64、無線ユニット52及びコントローラ51を介してフォークリフト20の走行及び荷役装置28による荷役を遠隔操作することができる。つまり、操作者は、図3での操作部(ディレクションレバー34、荷役レバー35、ハンドル36またはブレーキペダル37)に代えて、遠隔操作装置40の操作部62を使用して、フォークリフト20を遠隔操作することができる。 In FIG. 1, the controller 61 can remotely control the traveling of the forklift 20 and the cargo handling by the cargo handling device 28 via the radio 64, the radio unit 52, and the controller 51. That is, the operator remotely controls the forklift 20 by using the operation unit 62 of the remote control device 40 instead of the operation unit (direction lever 34, cargo handling lever 35, handle 36 or brake pedal 37) in FIG. can do.
 操作者が、遠隔操作装置40の操作部62を用いて所望の操作を行うと、コントローラ61が無線機64を介して操作内容をフォークリフト20に送る。フォークリフト20は、無線ユニット52を介して、遠隔操作装置40から送られた操作内容を受信する。すると、コントローラ51がアクチュエータを駆動して、所望の動作が実行される。 When the operator performs a desired operation using the operation unit 62 of the remote control device 40, the controller 61 sends the operation content to the forklift 20 via the radio 64. The forklift 20 receives the operation content sent from the remote control device 40 via the wireless unit 52. Then, the controller 51 drives the actuator to execute a desired operation.
 図2及び図4に示すように、カメラ71は、リフトブラケット31の中央に配置されている。カメラ71は、フォーク爪Nfの前方を撮像するために、前方下方を向くように取り付けられている。カメラ71は、走行中において車両の周辺であるフォークリフト20の進行方向前方の下方を撮像する。カメラ72は、左のリーチレグ22bの上面に、前方を向くように取り付けられている。カメラ72は、フォークリフト20の左前方を撮像する。即ち、カメラ72は、レグ先の障害物を監視する。 As shown in FIGS. 2 and 4, the camera 71 is arranged in the center of the lift bracket 31. The camera 71 is attached so as to face forward and downward in order to image the front of the fork claw Nf. The camera 71 takes an image of the lower part of the forklift 20 around the vehicle in the traveling direction while the vehicle is traveling. The camera 72 is attached to the upper surface of the left reach leg 22b so as to face forward. The camera 72 images the left front of the forklift 20. That is, the camera 72 monitors the obstacle at the leg destination.
 図1に示すように、コントローラ51は、カメラ71,72が撮像した画像を、画像処理部53及び無線機54を介して遠隔操作装置40に送る。遠隔操作装置40は、無線機65を介して、フォークリフト20から送られたカメラ画像を受信する。コントローラ61は、そのカメラ画像を、遠隔操作装置40の表示部63に表示する。表示部63は、例えばディスクトップ型ディスプレイである。操作者は表示部63に表示されたカメラ画像を見ながら操作することができる。 As shown in FIG. 1, the controller 51 sends the images captured by the cameras 71 and 72 to the remote control device 40 via the image processing unit 53 and the radio 54. The remote control device 40 receives the camera image sent from the forklift 20 via the radio 65. The controller 61 displays the camera image on the display unit 63 of the remote control device 40. The display unit 63 is, for example, a desktop type display. The operator can operate while looking at the camera image displayed on the display unit 63.
 図5は、パレット100の前面101の中心Cpf、前輪23a,23bを結ぶ線分の中点Cfh、及び、前輪23a,23bの車軸Axfhを示す。直交線Lr1は、中点Cfhを通り、かつ、車軸Axfhと直交する。最短距離線Lmiは、中点Cfhから、前面101を含む仮想平面への最短距離を示す直線である。最短距離線Lmiは、中点Cfhを通り、かつ、前面101を含む仮想平面と直交する。図7に示すように、最短距離線Lmi上に中心Cpfを合わせることにより、横ずれが防止される。 FIG. 5 shows the center Cpf of the front surface 101 of the pallet 100, the midpoint Cfh of the line segment connecting the front wheels 23a and 23b, and the axle Axfh of the front wheels 23a and 23b. The orthogonal line Lr1 passes through the midpoint Cfh and is orthogonal to the axle Axfh. The shortest distance line Lmi is a straight line indicating the shortest distance from the midpoint Cfh to the virtual plane including the front surface 101. The shortest distance line Lmi passes through the midpoint Cfh and is orthogonal to the virtual plane including the front surface 101. As shown in FIG. 7, lateral displacement is prevented by aligning the center Cpf on the shortest distance line Lmi.
 図5に示すように、パレット100は右側の第1パレット穴102及び左側の第2パレット穴103を有する。パレット穴102,103は、断面長方形状を有する。パレット100の前面101を正面から見た場合に、前面101には、幅方向の中央と右端との間に第1パレット穴102が開口しており、中央と左端との間に第2パレット穴103が開口している。 As shown in FIG. 5, the pallet 100 has a first pallet hole 102 on the right side and a second pallet hole 103 on the left side. The pallet holes 102 and 103 have a rectangular cross section. When the front surface 101 of the pallet 100 is viewed from the front, the front surface 101 has a first pallet hole 102 opened between the center and the right end in the width direction, and a second pallet hole 102 between the center and the left end. 103 is open.
 前面101には、図6Aに示すように右端領域(右端と第1パレット穴102との間)に右端マーク104が付されており、図6Bに示すように左端領域(左端と第2パレット穴103との間)に左端マーク105が付されている。コントローラ61は、マーク104,105をカメラで読み取ることによりパレット100の位置及びパレット前面101の中心を検出する。 The front surface 101 has a right end mark 104 in the right end region (between the right end and the first pallet hole 102) as shown in FIG. 6A, and a left end region (left end and the second pallet hole 102) as shown in FIG. 6B. The leftmost mark 105 is attached (between 103). The controller 61 detects the position of the pallet 100 and the center of the pallet front surface 101 by reading the marks 104 and 105 with a camera.
 より詳細には、計測部であるコントローラ61は、カメラ画像に基づいて画像認識により荷役対象であるパレット100の位置を計測する。 More specifically, the controller 61, which is a measurement unit, measures the position of the pallet 100, which is the cargo handling target, by image recognition based on the camera image.
 フォークリフト20がその場旋回、即ち、最大操舵角での旋回をする場合、図7に示す中点Cfhが旋回中心となる。フォークリフト20は、その場旋回して、図9に示すように、直交線Lr1を中心Cpfに合わせる。これは、角度ずれ防止のための動作である。 When the forklift 20 makes an in-situ turn, that is, turns at the maximum steering angle, the midpoint Cfh shown in FIG. 7 is the turning center. The forklift 20 turns in-situ and aligns the orthogonal line Lr1 with the center Cpf as shown in FIG. This is an operation for preventing the angle shift.
 重畳部であるコントローラ61は、カメラ画像に重畳するように、第1マークGm1及び第2マークGm2(図6A及び図6Bを参照)を表示部63に表示させることができる。マークGm1,Gm2は、荷役作業を支援する情報の例である。第1マークGm1は、前面101を含む仮想平面と直交線Lr1が交差する第1交差点の平面座標と、中心Cpfと同じ高さとを有する位置に表示される。第2マークGm2は、前面101を含む仮想平面と最短距離線Lmiが交差する第2交差点の平面座標と、中心Cpfと同じ高さとを有する位置に表示される。マークGm1,Gm2は、最短距離線Lmi上の平面座標が中心Cpfと合ったこと、及び、直交線Lr1上の平面座標が中心Cpfと合ったことを知らせるためのガイドマークである。第1マークGm1および第2マークGm2は、中心Cpfと異なる高さの位置に表示してもよい。 The controller 61, which is a superimposing unit, can display the first mark Gm1 and the second mark Gm2 (see FIGS. 6A and 6B) on the display unit 63 so as to superimpose on the camera image. Marks Gm1 and Gm2 are examples of information that supports cargo handling work. The first mark Gm1 is displayed at a position having the plane coordinates of the first intersection where the virtual plane including the front surface 101 and the orthogonal line Lr1 intersect and the same height as the center Cpf. The second mark Gm2 is displayed at a position having the plane coordinates of the second intersection where the virtual plane including the front surface 101 and the shortest distance line Lmi intersect and the same height as the center Cpf. The marks Gm1 and Gm2 are guide marks for notifying that the plane coordinates on the shortest distance line Lmi match the center Cpf and that the plane coordinates on the orthogonal line Lr1 match the center Cpf. The first mark Gm1 and the second mark Gm2 may be displayed at positions different from the center Cpf.
 例えば、図6Bに示すように、マークGm1は×の図形であってもよく、図6Aに示すように、マークGm2は菱形の図形であってもよい。マークGm1,Gm2は互いに異なる色で表示することができる。マークGm1,Gm2の各々は、その表示色を変化させることによって、状況の変化を示すことができる。フォークリフト20が前面101にまっすぐ向き合うと、カメラ画像においてマークGm1とマークGm2が重なる。 For example, as shown in FIG. 6B, the mark Gm1 may be a figure of ×, and as shown in FIG. 6A, the mark Gm2 may be a diamond-shaped figure. The marks Gm1 and Gm2 can be displayed in different colors. Each of the marks Gm1 and Gm2 can indicate a change in the situation by changing the display color thereof. When the forklift 20 faces the front surface 101 straight, the mark Gm1 and the mark Gm2 overlap in the camera image.
 図9に示すように、フォークリフト20がパレット前面101にまっすぐ向き合ったときの位置関係を正面位置という。本開示において、荷役車両の正面を荷役対象の前面とまっすぐ向き合わせることを「位置合わせ」という。正面対位置において、フォークリフト20の車軸Axfhはパレット前面101と平行になっている。マークGm1,Gm2は、荷役車両の正面を荷役対象の前面に向き合わせるために使用される。 As shown in FIG. 9, the positional relationship when the forklift 20 faces the front surface 101 of the pallet straight is called the front position. In the present disclosure, directing the front of the cargo handling vehicle to the front of the cargo handling object is referred to as "alignment". In the front-to-front position, the axle Axfh of the forklift 20 is parallel to the pallet front 101. The marks Gm1 and Gm2 are used to face the front surface of the cargo handling vehicle to the front surface of the cargo handling object.
 次に、作用について説明する。 Next, the action will be explained.
 以下、表示部63の表示内容として、カメラ71,72のうちのカメラ71が撮像したカメラ画像を用いて説明する。 Hereinafter, as the display content of the display unit 63, a camera image captured by the camera 71 among the cameras 71 and 72 will be described.
 図5は、作業場でのパレット100及びフォークリフト20の概略平面を示す。フォークリフト20がパレット100の前面101に対して右斜め方向から近づいていく時の表示部63での表示内容を図6Aに示す。 FIG. 5 shows a schematic plane of the pallet 100 and the forklift 20 in the workplace. FIG. 6A shows the display contents on the display unit 63 when the forklift 20 approaches the front surface 101 of the pallet 100 from an oblique right direction.
 図5に示す第1状態から、操作者が操作すると、図7に示す第2状態にする。図7は作業場でのパレット100及び第2状態のフォークリフト20の概略平面を示し、その時の表示部63での表示内容を図8A及び図8Bに示す。 When the operator operates from the first state shown in FIG. 5, it changes to the second state shown in FIG. FIG. 7 shows a schematic plane of the pallet 100 and the forklift 20 in the second state in the workplace, and the display contents on the display unit 63 at that time are shown in FIGS. 8A and 8B.
 図7に示す第2状態から、操作者が操作すると、図9に示す第3状態にする。図9は作業場でのパレット100及び第3状態のフォークリフト20の概略平面を示し、その時の表示部63での表示内容を図10に示す。 When the operator operates from the second state shown in FIG. 7, it changes to the third state shown in FIG. FIG. 9 shows a schematic plane of the pallet 100 and the forklift 20 in the third state in the workplace, and FIG. 10 shows the display contents on the display unit 63 at that time.
 図5、図6A及び図6Bに示すように、コントローラ61は、第1状態において、カメラ画像に基づいて画像認識によりパレット100の位置を計測する。第1状態における正面位置に対する横ずれ量ΔL及び角度ずれ量Δθは、後に説明する動作によってゼロになる。図5において横ずれ量ΔLは、中心Cpfから延びる前面101に対する垂線と旋回中心との距離である。図5において角度ずれ量Δθは、最短距離線Lmiと直交線Lr1とでなす角度である。 As shown in FIGS. 5, 6A and 6B, the controller 61 measures the position of the pallet 100 by image recognition based on the camera image in the first state. The lateral displacement amount ΔL and the angular deviation amount Δθ with respect to the front position in the first state become zero by the operation described later. In FIG. 5, the lateral displacement amount ΔL is the distance between the vertical line and the turning center with respect to the front surface 101 extending from the center Cpf. In FIG. 5, the angle deviation amount Δθ is an angle formed by the shortest distance line Lmi and the orthogonal line Lr1.
 図6A及び図6Bに示す例では、第2マークGm2は前面101に重畳して表示されており、第1マークGm1は前面101の左端領域(左端マーク105)に重畳して表示されている。すなわち、第1マークGm1は第2マークGm2から水平にずれた位置に表示され、マークGm1とマークGm2とは重なっていない。表示部63のカメラ画像においてマークGm1は赤色にて表示されるとともにマークGm2も赤色にて表示される。 In the examples shown in FIGS. 6A and 6B, the second mark Gm2 is displayed superimposed on the front surface 101, and the first mark Gm1 is displayed superimposed on the left end region (left end mark 105) of the front surface 101. That is, the first mark Gm1 is displayed at a position horizontally deviated from the second mark Gm2, and the mark Gm1 and the mark Gm2 do not overlap. In the camera image of the display unit 63, the mark Gm1 is displayed in red and the mark Gm2 is also displayed in red.
 コントローラ61は、マークGm1,Gm2が前面101に重なったとき、または、マーク104,105をカメラで読み取ったときに、第1状態になったことを示してもよい。第1状態になったことは、例えば、マークGm1,Gm2の表示色を変化させることによって示すことができる。 The controller 61 may indicate that the first state is reached when the marks Gm1 and Gm2 overlap the front surface 101 or when the marks 104 and 105 are read by the camera. The first state can be indicated by, for example, changing the display colors of the marks Gm1 and Gm2.
 第1状態から、操作者は、第1ステップとして、図7、図8A及び図8Bに示すように、最短距離線Lmiと仮想平面との交差点の平面座標を中心Cpfに合わせる操作を行う。具体的には、図5に示す第1状態から、フォークリフト20を直進させる。第1状態からフォークリフト20が直進する過程で、平面視において最短距離線Lmiと中心Cpfが重なる第2状態になる。第2状態では、図7に示すように、第2交差点の平面座標が中心Cpfの平面座標と一致するので、横ずれ量ΔLがゼロになる。このとき、正面位置に対する角度ずれ量Δθは残っている。 From the first state, as the first step, the operator performs an operation of aligning the plane coordinates of the intersection of the shortest distance line Lmi and the virtual plane with the center Cpf, as shown in FIGS. 7, 8A and 8B. Specifically, the forklift 20 is made to go straight from the first state shown in FIG. In the process of the forklift 20 traveling straight from the first state, the second state is reached in which the shortest distance line Lmi and the center Cpf overlap in a plan view. In the second state, as shown in FIG. 7, since the plane coordinates of the second intersection coincide with the plane coordinates of the center Cpf, the lateral displacement amount ΔL becomes zero. At this time, the amount of angular deviation Δθ with respect to the front position remains.
 第2状態になると、マークGm2の色が変えられる。具体的には、マークGm2の色が、それまでの赤色から緑色に変えられる。したがって、第2状態になったことは、マークGm2の色の変化によって示される。このとき、図8A及び図8Bに示すように、表示部63のカメラ画像においてマークGm1とマークGm2とは重なっていない。 In the second state, the color of the mark Gm2 can be changed. Specifically, the color of the mark Gm2 is changed from the previous red color to green color. Therefore, the second state is indicated by the change in the color of the mark Gm2. At this time, as shown in FIGS. 8A and 8B, the mark Gm1 and the mark Gm2 do not overlap in the camera image of the display unit 63.
 第2状態から、操作者は、第2ステップとして、図9及び図10に示すように、最大操舵角で右旋回する。第2状態になったことを示した後に、フォークリフト20が最大操舵角で旋回する過程で、平面視において直交線Lr1が中心Cpfと重なる第3状態になる。これにより、角度ずれ量Δθはゼロになる(Δθ=0)。 From the second state, as the second step, the operator turns right at the maximum steering angle as shown in FIGS. 9 and 10. After indicating that the second state has been reached, in the process of turning the forklift 20 at the maximum steering angle, the orthogonal line Lr1 becomes the third state where the orthogonal line Lr1 overlaps with the center Cpf in a plan view. As a result, the angle deviation amount Δθ becomes zero (Δθ = 0).
 第3状態になると、図10に示すように、マークGm1とマークGm2が重なるとともに、マークGm1の色が変えられる。具体的には、マークGm1の色が、赤色から緑色に変えられる。このように、第3状態になったことは、マークGm1の色の変化によって示される。操作者は、マークGm1の色が変化したのを見て、第3状態になったことを認知し、フォークリフト20の旋回を停止する。これにより、フォークリフト20は、パレット前面101にまっすぐ向き合った正面位置に配置される。 In the third state, as shown in FIG. 10, the mark Gm1 and the mark Gm2 overlap and the color of the mark Gm1 is changed. Specifically, the color of the mark Gm1 is changed from red to green. In this way, the third state is indicated by the change in the color of the mark Gm1. The operator sees that the color of the mark Gm1 has changed, recognizes that the third state has been reached, and stops the turning of the forklift 20. As a result, the forklift 20 is arranged at a front position directly facing the front surface 101 of the pallet.
 第3状態になると、操作者は、フォーク30a,30bを上方または下方に移動させてフォーク30a,30bの高さを調整する。そして、フォーク30a,30bを前方に移動させ、パレット100の穴102,103に差し込む。差し込みが終わったら操作者はパレット100を持ち上げる。さらに、操作者はフォークリフト20を後方に移動させ、パレット100を所望の場所に移動させる。 In the third state, the operator moves the forks 30a and 30b upward or downward to adjust the heights of the forks 30a and 30b. Then, the forks 30a and 30b are moved forward and inserted into the holes 102 and 103 of the pallet 100. When the insertion is completed, the operator lifts the pallet 100. Further, the operator moves the forklift 20 backward and moves the pallet 100 to a desired place.
 機台21がパレット100にアプローチする際、横ずれと共に角度ずれがあると、フォーク爪Nfをパレット穴102,103に差し込むことが難しい。本実施形態では、フォークリフト20をパレット100に、高精度に横ずれと角度ずれが少ない状態で正しく位置合わせすることができる。これにより、フォーク爪Nfをパレット穴102,103に差し込むことが可能となる。 When the machine base 21 approaches the pallet 100, it is difficult to insert the fork claws Nf into the pallet holes 102 and 103 if there is an angular deviation as well as a lateral deviation. In the present embodiment, the forklift 20 can be correctly aligned with the pallet 100 with high accuracy and with little lateral deviation and angular deviation. This makes it possible to insert the fork claw Nf into the pallet holes 102 and 103.
 この操作を行うとき、カメラの画像認識によりパレット100を測定する。これにより、操作者は、カメラ画面上のどの位置にパレット100が映っているのか分かる。カメラ画像上のパレット100が映っている領域には、情報(マークGm1,Gm2)が重ねて描画される。 When performing this operation, the palette 100 is measured by image recognition of the camera. As a result, the operator can know at which position on the camera screen the palette 100 is displayed. Information (marks Gm1 and Gm2) is superimposed and drawn on the area where the palette 100 is displayed on the camera image.
 操作に関する支援情報(例えば、荷物と機台の位置関係を表す情報)を画面上でのパレット100とは別の領域にインジケータで表示する場合、インジケータでカメラ画像が隠れるので、視線の移動が必要となる。また、画面上の情報量が多くなり、操作者が混乱する。 When displaying support information related to operation (for example, information indicating the positional relationship between luggage and the machine base) with an indicator in an area different from the pallet 100 on the screen, the camera image is hidden by the indicator, so it is necessary to move the line of sight. It becomes. In addition, the amount of information on the screen increases, which confuses the operator.
 本実施形態では、カメラ画像の荷役対象上に情報(マークGm1,Gm2)を表示する。これにより、操作者は他のインジケータを確認する必要がない。そのため、操作者は視線の移動が不要となり、直感的な操作が可能となる。また、情報の過多による混乱を防ぐことができる。 In this embodiment, information (marks Gm1, Gm2) is displayed on the cargo handling target of the camera image. This eliminates the need for the operator to check other indicators. Therefore, the operator does not need to move the line of sight, and intuitive operation is possible. In addition, it is possible to prevent confusion due to excessive information.
 上記実施形態によれば、以下のような効果を得ることができる。 According to the above embodiment, the following effects can be obtained.
 (1)フォークリフト20の荷役作業支援装置は、フォークリフト20の周辺を撮像するカメラ71と、カメラ71により撮像したカメラ画像を表示するための表示部63と、表示部63においてカメラ画像に、位置を計測した荷役対象(パレット100)の表示画面上の描画領域に荷役作業を支援する情報(マークGm1,Gm2)を重畳して表示させる重畳部であるコントローラ61と、を備える。よって、荷役対象であるパレット100を見ているときに視線の移動を小さくして視認性を向上することができる。詳しくは、荷役対象(荷取り対象)上に支援する情報(マークGm1,Gm2)を重畳して荷役対象(パレット100)を見ているときに視線の移動を小さくして(最小限にして)視認性を向上することができる。 (1) The cargo handling work support device of the forklift 20 has a camera 71 that images the periphery of the forklift 20, a display unit 63 for displaying the camera image captured by the camera 71, and a position on the camera image on the display unit 63. The controller 61 is a superimposing unit that superimposes and displays information (marks Gm1 and Gm2) that support cargo handling work on a drawing area on the display screen of the measured cargo handling object (pallet 100). Therefore, when looking at the pallet 100, which is the cargo handling target, the movement of the line of sight can be reduced and the visibility can be improved. Specifically, the information (marks Gm1, Gm2) to be supported is superimposed on the cargo handling target (picking target), and the movement of the line of sight is reduced (minimized) when the cargo handling target (pallet 100) is being viewed. Visibility can be improved.
 (2)情報はマークであるので、分かりやすい。 (2) Information is a mark, so it is easy to understand.
 (3)マークを表示することにより、フォークリフト20をパレット前面101にまっすぐ向き合わせる際の視認性を向上することができる。 By displaying the (3) mark, it is possible to improve the visibility when the forklift 20 faces the front surface 101 of the pallet straight.
 (4)マークGm1,Gm2はフォークリフト20の移動に連動して表示位置が変化するので、直感的に操作を行うことができる。 (4) Since the display positions of the marks Gm1 and Gm2 change in conjunction with the movement of the forklift 20, they can be operated intuitively.
 (5)第3状態になるとマークGm1,Gm2が重なるので、位置合わせの完了を容易に視認することができる。 (5) Since the marks Gm1 and Gm2 overlap in the third state, the completion of alignment can be easily visually recognized.
 (6)荷役車両の荷役作業支援装置は、荷役車両用遠隔操作システムであるフォークリフト用遠隔操作システム10に用いられる。フォークリフト用遠隔操作システム10は、荷役車両(フォークリフト20)と、遠隔操作装置40とを備える。フォークリフト20は、機台21に荷役装置28を備えるとともに車両通信部(無線ユニット52及び無線機54)を有する。遠隔操作装置40は、無線ユニット52及び無線機54と無線通信を行う操作装置通信部(無線機64,65)を有し、フォークリフト20の走行及び荷役装置28による荷役を遠隔操作するのに用いられる。よって、操作者がカメラの画像のみにしたがってフォークリフト20を遠隔操作する際に、視認性を向上することができる。 (6) The cargo handling work support device for the cargo handling vehicle is used in the forklift remote control system 10, which is a remote control system for the cargo handling vehicle. The remote control system 10 for a forklift includes a cargo handling vehicle (forklift 20) and a remote control device 40. The forklift 20 includes a cargo handling device 28 on the machine base 21 and a vehicle communication unit (radio unit 52 and radio 54). The remote control device 40 has an operation device communication unit (radio 64, 65) that performs wireless communication with the radio unit 52 and the radio 54, and is used for remotely controlling the traveling of the forklift 20 and the cargo handling by the cargo handling device 28. Be done. Therefore, when the operator remotely controls the forklift 20 according to only the image of the camera, the visibility can be improved.
 実施形態は、例えば、次のように変更してもよい。 The embodiment may be changed as follows, for example.
 ○荷役作業支援装置は、報知部を備え、この報知部の報知により、「第1状態になったこと」、「第2状態になったこと」、または「第3状態になったこと」のうち少なくとも一つを示してもよい。報知部は、例えば、音声を発するスピーカ、光を発する電灯、または振動を発するバイブレータであってもよい。報知部は、異なる報知を行う場合に、音、光、または振動の、質またはパターンを変化させるようにしてもよい。報知部は、表示部(モニタ)の一部であってもよい。 ○ The cargo handling work support device is equipped with a notification unit, and the notification of this notification unit indicates that "the first state has been reached", "the second state has been reached", or "the third state has been reached". At least one of them may be shown. The notification unit may be, for example, a speaker that emits sound, a lamp that emits light, or a vibrator that emits vibration. The notification unit may change the quality or pattern of sound, light, or vibration when performing different notifications. The notification unit may be a part of the display unit (monitor).
 〇 荷役作業を支援する情報は、マークGm1,Gm2に限らず、例えば数字でもよい。例えば、横ずれ量ΔL及び角度ずれ量Δθをカメラ画面上において数値で表してもよい。 〇 The information that supports cargo handling work is not limited to marks Gm1 and Gm2, but may be numbers, for example. For example, the lateral displacement amount ΔL and the angular deviation amount Δθ may be expressed numerically on the camera screen.
 ○ 図11A及び図11Bに示す変更例のように、マークは、荷役部であるフォーク爪Nfの高さ合わせのために用いてもよい。 ○ As shown in the modified examples shown in FIGS. 11A and 11B, the mark may be used for adjusting the height of the fork claw Nf, which is a cargo handling portion.
 図11Aに示すように、変更例では、パレット100がラック300の棚板301に載せられている。パレット100の高さに対するフォーク爪Nfの高さの差ΔHをカメラの画像認識により測定する。図11Bに示す表示部63での画面には、差ΔHを表すインジケータ200が重畳される。インジケータ200には、パレット前面101での高さ方向の中央点201と、中央点201に対するフォーク爪Nfの高さを示す指標202が描画される。インジケータ200での中央点201と指標202との差がパレット100の高さとフォーク爪Nfの高さの差ΔHに対応する。 As shown in FIG. 11A, in the modified example, the pallet 100 is placed on the shelf board 301 of the rack 300. The difference ΔH in the height of the fork claw Nf with respect to the height of the pallet 100 is measured by image recognition of the camera. An indicator 200 representing the difference ΔH is superimposed on the screen of the display unit 63 shown in FIG. 11B. On the indicator 200, a center point 201 in the height direction on the front surface 101 of the pallet and an index 202 indicating the height of the fork claw Nf with respect to the center point 201 are drawn. The difference between the center point 201 and the index 202 on the indicator 200 corresponds to the difference ΔH between the height of the pallet 100 and the height of the fork claw Nf.
 〇 荷役対象は、荷そのものでもよい。 〇 The cargo handling target may be the cargo itself.
 ○ 情報(マークGm1,Gm2)は、前面101と重ならない位置に表示してもよい。要は、情報は、荷役対象の表示画面上に表示されればよい。 ○ Information (marks Gm1, Gm2) may be displayed at a position that does not overlap with the front 101. In short, the information may be displayed on the display screen of the cargo handling target.
 ○ パレット前面101の中心Cpfは、マーク104,105を用いることなく、例えば画像認識によりパレットの輪郭から検知してもよい。 ○ The center Cpf of the front surface 101 of the pallet may be detected from the contour of the pallet by, for example, image recognition without using the marks 104 and 105.
 ○ センサで荷役対象の位置は、センサを用いて、例えば三次元で測定してもよい。 ○ The position of the cargo handling target with the sensor may be measured in three dimensions using the sensor, for example.
 ○ 実施形態は荷取り作業を行う場合について説明したが、荷置き作業を行う場合でも同様の操作を行うことができる。荷置き作業の場合、荷役対象はラックにおける荷を置く棚板の区画である。 ○ Although the embodiment has described the case where the unloading work is performed, the same operation can be performed even when the unloading work is performed. In the case of loading work, the cargo handling target is the section of the shelf board on which the load is placed in the rack.
 つまり、荷役対象はラックの棚板の区画であり、ラックの棚板において荷物と荷物の間の狭い空間に荷を置きたいときにラックの棚板にマークを付けておくとよい。 In other words, the cargo handling target is the section of the rack shelf board, and it is advisable to mark the rack shelf board when you want to place the load in the narrow space between the luggage on the rack shelf board.
 荷置き作業を行う場合、車両前方を撮像しにくくなるようであれば、リフトブラケット31の左端または右端にカメラを配置してもよい。 When performing loading work, if it becomes difficult to image the front of the vehicle, the camera may be placed at the left end or the right end of the lift bracket 31.
 ○ カメラの設置場所及び台数は変更することができる。 ○ The location and number of cameras can be changed.
 ○ 荷役車両の荷役作業支援装置は、例えば、有人フォークリフトに用いてもよい。有人フォークリフトは、カメラと表示部を備えてもよい。 ○ The cargo handling work support device of the cargo handling vehicle may be used for, for example, a manned forklift. The manned forklift may include a camera and a display.
 ○ 荷役車両は、カウンタ式フォークリフトでもよい。 ○ The cargo handling vehicle may be a counter-type forklift.
 ○ 荷役車両は、フォークリフト以外の車両であってもよい。 ○ The cargo handling vehicle may be a vehicle other than a forklift.

Claims (12)

  1.  荷役車両の周辺を撮像するように配置されたカメラと、
     前記カメラが撮像したカメラ画像を表示するように構成された表示部と、
     前記表示部において前記カメラ画像に、位置を計測した荷役対象の表示画面上の描画領域に荷役作業を支援する情報を重畳して表示させるように構成された重畳部と、
    を備える、荷役車両の荷役作業支援装置。
    A camera arranged to capture the surroundings of the cargo handling vehicle,
    A display unit configured to display a camera image captured by the camera, and a display unit.
    In the display unit, the camera image is configured to superimpose and display information supporting the cargo handling work on the drawing area on the display screen of the cargo handling target whose position has been measured.
    A cargo handling work support device for cargo handling vehicles.
  2.  前記情報は、前記カメラ画像に重畳して表示される少なくとも一つのマークである、
     請求項1に記載の荷役車両の荷役作業支援装置。
    The information is at least one mark displayed superimposed on the camera image.
    The cargo handling work support device for a cargo handling vehicle according to claim 1.
  3.  前記少なくとも一つのマークは、前記荷役車両を前記荷役対象の前面にまっすぐ向き合わせるためのマークである、
     請求項2に記載の荷役車両の荷役作業支援装置。
    The at least one mark is a mark for facing the cargo handling vehicle straight to the front surface of the cargo handling object.
    The cargo handling work support device for a cargo handling vehicle according to claim 2.
  4.  前記荷役車両は2つの前輪及び前記2つの前輪の車軸を有し、
     前記少なくとも一つのマークは、第1マーク及び第2マークを含み、
     前記第1マークは、前記荷役対象の前面を含む仮想平面と直交線が交差する第1交差点の平面座標を有する位置に表示され、前記直交線は、前記2つの前輪を結ぶ線分の中点を通り、かつ、前記車軸と直交する直線であり、
     前記第2マークは、前記仮想平面と最短距離線が交差する第2交差点の平面座標を有する位置に表示され、前記最短距離線は、前記中点から、前記仮想平面への最短距離を示す直線である、
     請求項3に記載の荷役車両の荷役作業支援装置。
    The cargo handling vehicle has two front wheels and the axles of the two front wheels.
    The at least one mark includes a first mark and a second mark.
    The first mark is displayed at a position having plane coordinates of a first intersection where an orthogonal line intersects with a virtual plane including the front surface of the cargo handling target, and the orthogonal line is a midpoint of a line segment connecting the two front wheels. It is a straight line that passes through and is orthogonal to the axle.
    The second mark is displayed at a position having the plane coordinates of the second intersection where the virtual plane and the shortest distance line intersect, and the shortest distance line is a straight line indicating the shortest distance from the midpoint to the virtual plane. Is,
    The cargo handling work support device for a cargo handling vehicle according to claim 3.
  5.  前記第1マークおよび前記第2マークは、前記前面の中心と同じ高さの位置に表示される、
     請求項4に記載の荷役車両の荷役作業支援装置。
    The first mark and the second mark are displayed at the same height as the center of the front surface.
    The cargo handling work support device for a cargo handling vehicle according to claim 4.
  6.  前記荷役車両の正面が荷役対象の前面に対して斜めに向いた状態において、前記第1マークは、前記第2マークから水平にずれた位置に表示され、
     前記荷役車両の前記正面が前記荷役対象の前面にまっすぐ向き合ったときに、前記第1マークと第2マークが重なる、
     請求項4または5に記載の荷役車両の荷役作業支援装置。
    In a state where the front surface of the cargo handling vehicle faces obliquely with respect to the front surface of the cargo handling object, the first mark is displayed at a position horizontally deviated from the second mark.
    When the front surface of the cargo handling vehicle faces the front surface of the cargo handling object straight, the first mark and the second mark overlap.
    The cargo handling work support device for a cargo handling vehicle according to claim 4 or 5.
  7.  前記マークは、荷役部の高さ合わせのためのマークである、
     請求項2に記載の荷役車両の荷役作業支援装置。
    The mark is a mark for adjusting the height of the cargo handling section.
    The cargo handling work support device for a cargo handling vehicle according to claim 2.
  8.  前記荷役車両はフォークリフトである、
     請求項1~7のいずれか1項に記載の荷役車両の荷役作業支援装置。
    The cargo handling vehicle is a forklift.
    The cargo handling work support device for a cargo handling vehicle according to any one of claims 1 to 7.
  9.  前記荷役対象はパレットである、
     請求項8に記載の荷役車両の荷役作業支援装置。
    The cargo handling target is a pallet.
    The cargo handling work support device for a cargo handling vehicle according to claim 8.
  10.  前記カメラ画像に基づいて前記荷役対象の位置を計測する計測部を備える、
     請求項1~9のいずれか1項に記載の荷役車両の荷役作業支援装置。
    A measuring unit for measuring the position of the cargo handling target based on the camera image is provided.
    The cargo handling work support device for a cargo handling vehicle according to any one of claims 1 to 9.
  11.  前記荷役車両の荷役作業支援装置は、荷役車両用遠隔操作システムに用いられるものであって、
     前記荷役車両用遠隔操作システムは、前記荷役車両と、遠隔操作装置とを備え、
     前記荷役車両は、機台に荷役装置を備えるとともに車両通信部を有し、
     前記遠隔操作装置は、前記車両通信部と無線通信を行うように構成された操作装置通信部を有し、前記荷役車両の走行及び前記荷役装置による荷役を遠隔操作するのに用いられる、
     請求項1~10のいずれか1項に記載の荷役車両の荷役作業支援装置。
    The cargo handling work support device for a cargo handling vehicle is used in a remote control system for a cargo handling vehicle.
    The remote control system for a cargo handling vehicle includes the cargo handling vehicle and a remote control device.
    The cargo handling vehicle is provided with a cargo handling device on the machine base and has a vehicle communication unit.
    The remote control device has an operation device communication unit configured to perform wireless communication with the vehicle communication unit, and is used for remotely controlling the traveling of the cargo handling vehicle and the cargo handling by the cargo handling device.
    The cargo handling work support device for a cargo handling vehicle according to any one of claims 1 to 10.
  12. 前記荷役車両用遠隔操作システムは、荷役対象であるパレットを備え、
     前記パレットの前面を正面から見た場合に、前記前面には、幅方向の中央と右端との間に第1パレット穴が開口しており、前記中央と左端との間に第2パレット穴が開口しており、
     前記前面には、前記右端と前記第1パレット穴との間に右端マークが付されており、かつ、前記左端と前記第2パレット穴との間には左端マークが付されている、
     請求項11に記載の荷役車両の荷役作業支援装置。
    The remote control system for a cargo handling vehicle includes a pallet that is a cargo handling target.
    When the front surface of the pallet is viewed from the front, a first pallet hole is opened between the center and the right end in the width direction, and a second pallet hole is formed between the center and the left end. It is open and
    On the front surface, a right end mark is attached between the right end and the first pallet hole, and a left end mark is attached between the left end and the second pallet hole.
    The cargo handling work support device for a cargo handling vehicle according to claim 11.
PCT/JP2020/039067 2019-10-18 2020-10-16 Cargo handling work assistance device for cargo handling vehicle WO2021075541A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-191008 2019-10-18
JP2019191008A JP7415429B2 (en) 2019-10-18 2019-10-18 Cargo handling support device for cargo handling vehicles

Publications (1)

Publication Number Publication Date
WO2021075541A1 true WO2021075541A1 (en) 2021-04-22

Family

ID=75538265

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/039067 WO2021075541A1 (en) 2019-10-18 2020-10-16 Cargo handling work assistance device for cargo handling vehicle

Country Status (2)

Country Link
JP (1) JP7415429B2 (en)
WO (1) WO2021075541A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116588858A (en) * 2023-07-17 2023-08-15 济南二机床新光机电有限公司 C-shaped guide vehicle device for carrying stacking materials and operation method thereof

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7414772B2 (en) * 2021-06-04 2024-01-16 プライムプラネットエナジー&ソリューションズ株式会社 Method and device for measuring displacement of object

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003028614A (en) * 2001-07-12 2003-01-29 Toyota Industries Corp Method and apparatus for detection of position, industrial vehicle, mark, pallet, shelf and system for materials handling and pasting agent
JP2006096457A (en) * 2004-09-28 2006-04-13 Toyota Industries Corp Forklift work assisting device
JP2008087891A (en) * 2006-09-29 2008-04-17 Toyota Industries Corp Fork lift vehicle and method for turning the fork lift vehicle
US20140159881A1 (en) * 2012-07-31 2014-06-12 Linde Material Handling Gmbh Driver Assist Device For An Industrial Truck And Industrial Truck With Driver Assist Device"
US20160002016A1 (en) * 2013-02-18 2016-01-07 Combilift Load carrying trucks
JP2018072945A (en) * 2016-10-25 2018-05-10 株式会社豊田自動織機 Remote operation system for industrial vehicle, remote controller, remote operation program for industrial vehicle, and industrial vehicle
JP2020070121A (en) * 2018-10-29 2020-05-07 パナソニックIpマネジメント株式会社 Transportation method, transportation system, program, and pallet

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003028614A (en) * 2001-07-12 2003-01-29 Toyota Industries Corp Method and apparatus for detection of position, industrial vehicle, mark, pallet, shelf and system for materials handling and pasting agent
JP2006096457A (en) * 2004-09-28 2006-04-13 Toyota Industries Corp Forklift work assisting device
JP2008087891A (en) * 2006-09-29 2008-04-17 Toyota Industries Corp Fork lift vehicle and method for turning the fork lift vehicle
US20140159881A1 (en) * 2012-07-31 2014-06-12 Linde Material Handling Gmbh Driver Assist Device For An Industrial Truck And Industrial Truck With Driver Assist Device"
US20160002016A1 (en) * 2013-02-18 2016-01-07 Combilift Load carrying trucks
JP2018072945A (en) * 2016-10-25 2018-05-10 株式会社豊田自動織機 Remote operation system for industrial vehicle, remote controller, remote operation program for industrial vehicle, and industrial vehicle
JP2020070121A (en) * 2018-10-29 2020-05-07 パナソニックIpマネジメント株式会社 Transportation method, transportation system, program, and pallet

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116588858A (en) * 2023-07-17 2023-08-15 济南二机床新光机电有限公司 C-shaped guide vehicle device for carrying stacking materials and operation method thereof

Also Published As

Publication number Publication date
JP7415429B2 (en) 2024-01-17
JP2021066539A (en) 2021-04-30

Similar Documents

Publication Publication Date Title
WO2021075541A1 (en) Cargo handling work assistance device for cargo handling vehicle
US9667923B2 (en) Camera attitude detection device and work region line display device
JP2006096457A (en) Forklift work assisting device
JP2020132431A (en) Travel support device for industrial vehicle
JP2014239357A (en) Backward periphery monitoring device of work vehicle
JP2019202877A (en) Remote control system for industrial vehicle
JP2021022802A (en) Industrial vehicle remote operation system
JP7247812B2 (en) Operation support device for cargo handling vehicle
WO2021066138A1 (en) Operation assistance device for cargo handling vehicle
WO2020170747A1 (en) Industrial vehicle travel assistance device
JP7119795B2 (en) Remote control system for forklift
JP7063283B2 (en) Cargo handling work support device for reach type forklift
WO2021075542A1 (en) Method for assisting operation of loading vehicle
JP3900942B2 (en) Automatic position control device for cargo handling equipment in industrial vehicles, industrial vehicle and automatic position control method for cargo handling equipment
JP6988713B2 (en) Remote control system for industrial vehicles
JP7107078B2 (en) Cargo handling support device for reach-type forklifts
JP2020083572A (en) Driving support device for forklift truck
JP2018178878A (en) Industrial vehicle
JP7126204B2 (en) Conveyor
JP2021020793A (en) Operation supporting device for cargo handling vehicle
JP7087737B2 (en) Remote control system for forklifts
JP3858703B2 (en) Cargo work support device for industrial vehicle and industrial vehicle
JP7135629B2 (en) Operation support device for forklift
JP7371544B2 (en) Industrial vehicle work support equipment
JP2003155199A (en) Voice annunciator for industrial vehicle and industrial vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20877409

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20877409

Country of ref document: EP

Kind code of ref document: A1