WO2015145725A1 - Dispositif de présentation d'informations, système de grue et procédé de présentation d'informations - Google Patents

Dispositif de présentation d'informations, système de grue et procédé de présentation d'informations Download PDF

Info

Publication number
WO2015145725A1
WO2015145725A1 PCT/JP2014/059134 JP2014059134W WO2015145725A1 WO 2015145725 A1 WO2015145725 A1 WO 2015145725A1 JP 2014059134 W JP2014059134 W JP 2014059134W WO 2015145725 A1 WO2015145725 A1 WO 2015145725A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
driver
image information
crane
acquisition unit
Prior art date
Application number
PCT/JP2014/059134
Other languages
English (en)
Japanese (ja)
Inventor
豊原　尚
伸郎 吉岡
Original Assignee
三菱重工マシナリーテクノロジー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱重工マシナリーテクノロジー株式会社 filed Critical 三菱重工マシナリーテクノロジー株式会社
Priority to JP2015526428A priority Critical patent/JP6017691B2/ja
Priority to PCT/JP2014/059134 priority patent/WO2015145725A1/fr
Priority to CN201480003357.3A priority patent/CN105189327B/zh
Publication of WO2015145725A1 publication Critical patent/WO2015145725A1/fr
Priority to HK16107114.8A priority patent/HK1219087A1/zh

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66C—CRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00—Other constructional features or details
    • B66C13/18—Control systems or devices
    • B66C13/46—Position indicators for suspended loads or for crane elements

Definitions

  • the present invention relates to an information presentation device, a crane system, and an information presentation method.
  • Patent Document 1 There has been proposed a device that presents information to an operator of a device and assists a blind spot area that can be viewed through a rearview mirror or the like (for example, Patent Document 1).
  • the present invention provides an information presentation device, a crane system, and an information presentation method capable of safely operating a crane even for an inexperienced driver.
  • the information presenting apparatus is installed on the trolley, a boom that is extended and disposed above the object to be suspended, a trolley that is movable along the boom, and the trolley.
  • Suspending means capable of being lifted and lowered by suspending the object, and provided so as to allow the driver located in the driver's seat to be visually recognized by the driver positioned below the object.
  • a display unit capable of displaying predetermined image information in a field of view when the driver looks at the operation window.
  • an operation support information acquisition unit that acquires operation support information for supporting an operation of a suspended work by the driver, and image information including at least the acquired operation support information is generated and output to the display unit
  • An image information generation unit is provided.
  • the operation support information acquisition unit includes a motion information acquisition unit that acquires motion information of the crane
  • the image information generation unit includes: Image information including the operation information is generated as operation support information.
  • the operation support information acquisition unit acquires the object video information via the imaging device that captures a range located below the suspension means.
  • the image information generation unit generates image information including the object video information as the operation support information.
  • the operation support information acquisition unit acquires profile information indicating profile information indicating an outline of the object located below the suspension means.
  • the image information generation unit generates image information including the profile information as the operation support information.
  • an image imitating the object and the surrounding contour (profile) is provided within the range of the driver's field of view. Therefore, the driver can grasp the height and positional relationship between the target object and the surrounding obstacles while directly viewing the target object and the surrounding conditions, so that the driver can be more secure and safe. It becomes possible to operate efficiently.
  • the operation support information acquisition unit includes an attribute information acquisition unit that acquires attribute information for each of the predetermined objects, and the image The information generation unit generates image information including the attribute information as the operation support information.
  • a procedure list indicating the order of objects to be handled and information for identifying the object are displayed in the driver's field of view. Can do. Accordingly, the driver can accurately and quickly determine the object to be carried next, so that the cargo handling operation can be performed more efficiently.
  • the image information generation unit associates each of the attribute information with each of the objects that are directly viewed from the operation window.
  • the image information is generated as follows. According to such a configuration, attribute information is attached in association with each of the objects that are directly viewed from the operation window, so the crane driver looks at the difference between the stacked containers. It becomes possible to grasp, and cargo handling work can be performed more efficiently.
  • the display unit is attached to a wearable device that the driver wears on the head.
  • the wearable device arranges the display unit within the range of the driver's field of view while following the change in the posture even when the driver faces downward for operation. Therefore, the driver can visually recognize the operation support information while directly visualizing the object and the surrounding situation without changing the posture. Moreover, since it is realizable only by a driver
  • the wearable device further includes a posture detection unit that detects driver posture information, and the display unit is based on the posture information.
  • the image information is displayed when the driver is viewing the lower side.
  • a crane system includes the above-described information presentation device, a boom that is extended and disposed above an object to be suspended, and a trolley that is movable along the boom.
  • Suspending means that is installed on the trolley and is capable of moving up and down by suspending the object; and the object that is installed above the object and is suspended below the driver located in the driver's seat.
  • a crane including an operator's cab having an operation window provided so as to be visible.
  • the information presentation method is installed on the trolley, a boom that is extended and arranged above the object to be suspended, a trolley that is movable along the boom, and the trolley.
  • Suspending means capable of being lifted and lowered by suspending the object, and provided so as to allow the driver located in the driver's seat to be visually recognized by the driver positioned below the object.
  • the image information including the operation support information is generated, and when the driver looks at the operation window, the image information is output to a display unit capable of displaying predetermined image information in the field of view.
  • the crane system according to the present embodiment includes a crane (a crane 10 described later) and an information presentation device (an information presentation device 20 described later).
  • a crane is a container crane which performs the loading / unloading operation
  • the information presentation device is mounted on the container crane, and provides information to the driver through vision for supporting the driver's operation of the lifting work.
  • FIG. 1 is a figure showing the whole crane composition concerning a 1st embodiment.
  • the crane 10 includes a leg structure portion 11, a boom 12, a trolley 13, a cab 14, and a spreader 15 (suspending means).
  • the leg structure 11 is installed on the ground of the quay and supports the entire other configuration of the crane 10 while extending upward.
  • the leg structure 11 has a traversing mechanism 11a at the base end, and can traverse the entire crane 10 along the rail provided on the ground.
  • the boom 12 is supported by the leg structure 11, the suspended ship (container A) and the object to be suspended (a plurality of containers loaded on the container ship 50) are located on the side where the container ship 50 is anchored. Stretched.
  • the boom 12 is rotatable in a direction in which the tip is directed upward.
  • the trolley 13 is capable of traveling (moving in the left-right direction on the paper surface) along rails arranged in the extending direction of the boom 12.
  • the cab 14 and the spreader 15 are movable in the extending direction of the boom 12 as the trolley 13 moves.
  • a driver who operates the crane 10 gets on the cab 14.
  • the internal structure of the cab 14 will be described later.
  • the spreader 15 is suspended by a rope extending downward from the trolley 13 and can fix the container A serving as a suspended load. Further, the spreader 15 can be raised and lowered while the container A is fixed and suspended by the rope being wound or lowered in the trolley 13.
  • the crane 10 is installed on the quay of the port and loads and unloads a plurality of containers loaded on the anchored container ship 50.
  • FIG. 2 is a diagram illustrating an internal structure of a cab of the crane according to the first embodiment.
  • the cab 14 includes a driver's seat 141, an operation panel 142, an operation window 143, and a terminal device 21 inside.
  • the driver seat 141 is a seat where the driver X of the crane 10 is located.
  • the operation panel 142 is provided with an input interface (lever, switch, etc.) required for the driver X to operate various operations of the crane 10.
  • the operation window 143 is provided so that the driver X located in the driver's seat 141 can visually recognize the suspended load (container A or the like) suspended below.
  • the terminal device 21 is, for example, a general personal computer. A specific functional configuration of the terminal device 21 will be described later.
  • the driver X located in the driver seat 141 can visually recognize the spreader 15 and the container A suspended from the spreader 15 through the operation window 143 disposed below the driver X.
  • the driver X operates the crane 10 via the operation panel 142 arranged on the side surface of the driver seat 141 while visually checking the state of the container A and its surroundings (presence of obstacles) through the operation window 143. Carry out the lifting work.
  • the driver X wears the wearable device 22 on the head.
  • the wearable device 22 can display predetermined image information in the field of view when at least the driver X faces the operation window 143.
  • FIG. 3 is a diagram illustrating the structure of the wearable device according to the first embodiment.
  • the wearable device 22 is a glasses-type terminal device worn on the head of the driver X, and includes a display unit 222 that can display predetermined image information in the field of view of the driver X. ing. Accordingly, the driver X can visually recognize the image information through the display unit 222 while simultaneously viewing the suspended container A and the like when looking down downward during the operation.
  • the aspect of the wearable device 22 is not limited to the glasses-type type as shown in FIG. 3, and may be, for example, a head-mounted terminal device having a transparent display that can visually recognize the background. That is, the wearable device 22 may be in any form as long as it can display image information in at least one region of the field of view regardless of the posture of the driver X's head.
  • FIG. 4 is a diagram illustrating a functional configuration of the information presentation apparatus according to the first embodiment.
  • the information presentation device 20 according to the present embodiment includes a terminal device 21 installed in the cab 14 and a wearable device 22 worn by the driver X.
  • the terminal device 21 receives input of predetermined information from the crane control device 31 provided in the crane 10.
  • the crane control device 31 is a control mechanism that operates various movable parts of the crane 10 based on the operation of the driver X.
  • the crane control device 31 can acquire operation information representing the operation state of the crane 10, specifically, various information such as the traverse coordinates, the hoisting coordinates, the undulation angle, the traverse speed, the hoisting speed, and the traveling speed of the crane 10.
  • the terminal device 21 includes a CPU (Central Processing Unit) 210, a communication connection unit 213, and a wireless communication module 214.
  • the CPU 210 is a functional unit that controls the overall operation of the terminal device 21.
  • the CPU 210 functions as an operation support information acquisition unit 211 (operation information acquisition unit 211a) and an image information generation unit 212 by reading a predetermined program into an internal storage area. The functions of the operation support information acquisition unit 211 and the image information generation unit 212 will be described below.
  • the communication connection unit 213 is a connection interface for wired connection (or wireless connection) with the crane control device 31, whereby the terminal device 21 can communicate with the crane control device 31.
  • the operation support information acquisition unit 211 (operation information acquisition unit 211a) sequentially receives input of operation information indicating the current operation state of the crane 10 as operation support information from the crane control device 31 via the communication connection unit 213.
  • the image information generation unit 212 generates image information including at least the operation support information (that is, operation information) acquired by the operation information acquisition unit 211a, and outputs the image information to the display unit 222 of the wearable device 22.
  • the image information generation unit 212 outputs the image information to the display unit 222 via the wireless communication modules 214 and 221 provided in the self device and the wearable device 22.
  • the wireless communication module 214 is a communication interface for the terminal device 21 to exchange information with the wearable device 22 wirelessly.
  • the wireless communication module 214 realizes wireless communication according to a predetermined wireless communication protocol with another wireless communication module 221 provided in the wearable device 22.
  • the display unit 222 included in the wearable device 22 is a small liquid crystal display or the like, and includes image information (including operation information) input from the terminal device 21 (image information generation unit 212) via the wireless communication module 221.
  • the image information is displayed based on the above.
  • the driver X wearing the wearable device 22 can grasp the current operation state of the crane by visually recognizing the image information (operation information).
  • the image information displayed on the display unit 222 will be described later. Note that the output of the image information from the terminal device 21 to the wearable device 22 may be performed by wired communication via a predetermined communication cable instead of wireless communication.
  • the wearable device 22 includes an attitude detection unit 223 inside.
  • the posture detection unit 223 has an acceleration sensor inside, for example, detects the posture of the head of the driver X to which the wearable device 22 is worn, and posture information (information indicating whether or not the user is facing downward). ) Can be obtained.
  • FIG. 5 is a diagram illustrating image information displayed on the display unit according to the first embodiment.
  • the image information generation unit 212 based on the motion information acquired by the motion information acquisition unit 211 a, specifically, the traversal coordinates in the leg structure unit 11, Information (numerical values) such as traversing speed, winding coordinates of spreader 15 by trolley 13, hoisting speed, hoisting angle of boom 12, traveling speed of trolley 13, ON / OFF of twist lock, load of suspended load (container A), etc. , Parameter) is generated.
  • the image information P1 generated by the image information generation unit 212 is output to the display unit 222 of the wearable device 22 via the wireless communication modules 214 and 221 (see FIG. 5).
  • FIG. 6A and 6B are first and second flowcharts showing the processing procedure of the information presentation apparatus according to the first embodiment.
  • 6A shows a processing procedure in the terminal device 21, and FIG. 6B shows a processing procedure in the wearable device 22.
  • the operation support information acquisition unit 211 acquires operation information of the crane 10 from the crane control device 31 (step S11).
  • the image information generation unit 212 generates image information P1 (FIG. 5) based on the acquired operation information (step S12).
  • the image information generation unit 212 further outputs the generated image information P1 to the wearable device 22 via the wireless communication modules 214 and 221 (step S13).
  • step S14 determines whether the driving
  • step S14: YES the terminal device 21 ends the process.
  • step S14: NO the process returns to step S11, and the process of acquiring operation information to outputting image information is repeated.
  • the wearable device 22 acquires the image information P1 generated by the image information generation unit 212 via the wireless communication module 221 (step S21).
  • the wearable device 22 acquires posture information via the posture detection unit 223, and determines whether or not the driver X is facing downward (step S22).
  • the posture detection unit 223 determines that the driver X is facing downward when the direction of gravitational acceleration in the built-in acceleration sensor is included within a predetermined determination reference range.
  • the wearable device 22 displays the acquired image information P1 on the display unit 222 (step S23).
  • step S22 when it is determined that the driver X is not facing downward (step S22: NO), new image information P1 is acquired without displaying the image information P1 (without performing step S23).
  • step S24 it is equivalent to the above-mentioned step S14.
  • the wearable device 22 receives an input of a signal indicating the end of operation of the crane 10 via the wireless communication module 221.
  • the wearable device 22 displays the image information P1 when the driver X faces downward to visually recognize the situation such as the suspended load (container A).
  • the driver X provides the operation information only when the operation information (operation support information) of the crane 10 is required (that is, when the operation is performed while facing downward). Is done. Therefore, since unnecessary information is not displayed in a situation where the driver X does not require operation information, the driver X is not distracted, and the troublesomeness of wearing the wearable device 22 can be reduced.
  • the wearable device 22 according to another embodiment is not limited to this aspect. In other words, even when the driver X faces a different direction other than downward, the display of the image information P1 may be continued as it is, or other image information corresponding to the directed direction may be displayed. .
  • the operation support information for supporting the operation within the range of the field of view. (In the present embodiment, operation information of the crane 10) is provided. Therefore, the driver X can visually recognize the operation support information at the same time without changing the posture while directly viewing the container A as a suspended load and the surrounding situation. Even with little experience, it is possible to operate safely and efficiently.
  • the terminal device 21 mentioned above was demonstrated as what is mounted in the cab 14 of the crane 10 (FIG. 2), the function of the said terminal device 21 is another terminal provided in places other than the cab 14. It can also be realized by a device.
  • the crane system according to the present embodiment provides predetermined video information to the driver via a photographing device provided outside the crane.
  • FIG. 7 is a diagram illustrating a functional configuration of the information presentation apparatus according to the second embodiment.
  • the terminal device 21 of the information presentation device 20 according to the present embodiment is configured to accept input of predetermined object video information from the imaging device 32 in addition to the crane control device 31. Yes.
  • the photographing device 32 is, for example, a surveillance camera, and is provided outside the crane 10 so that a predetermined range located below the spreader 15 can be photographed.
  • the imaging device 32 is attached to a position (such as the ground) where the suspended container A and its periphery can be imaged over a wide range from an angle different from the direction of the line of sight of the driver X.
  • the imaging device 32 may be attached so as to face downward from the trolley 13, the spreader 15, etc., for example, so that the range which becomes a blind spot from the driver
  • the imaging device 32 includes a drive mechanism 32a.
  • the drive mechanism 32a can change the housing posture of the photographing device 32 by driving, and thereby can change the photographing range of the photographing device 32 as desired.
  • the drive mechanism 32a can further drive a lens or the like to perform enlargement / reduction of an object to be photographed.
  • the drive mechanism 32a acquires operation information from the crane control device 31, and changes the posture of the imaging device 32 so as to correspond to the coordinates (transverse coordinates, hoisting coordinates, etc.) indicated by the operation information. Thereby, the imaging device 32 can change the imaging range so as to follow the suspended load in accordance with the movement of the suspended load (container A).
  • the operation support information acquisition unit 211 further includes a video information acquisition unit 211b in addition to the operation information acquisition unit 211a according to the first embodiment.
  • the video information acquisition unit 211b receives an object video indicating the video (video showing the suspended load and its surroundings) taken by the imaging device 32 as operation support information from the imaging device 32 via the communication connection unit 213. Accepts information input sequentially.
  • FIG. 8 is a diagram illustrating image information displayed on the display unit according to the second embodiment.
  • the image information generation unit 212 according to the present embodiment performs the operation based on the operation information acquired by the operation information acquisition unit 211a and the object video information acquired by the video information acquisition unit 211b.
  • Image information P2 including information and object video information is generated.
  • the image information P2 includes an image area P21 where the operation information of the crane 10 is displayed, and an image area P22 where the object video information (video captured by the imaging device 32) is displayed.
  • the image area P22 includes an image Pa of the crane 10, an image Pb of the container A as a suspended load, and images Pc of a plurality of containers stacked on the ship of the container ship 50.
  • the image information P2 generated by the image information generation unit 212 is output to the display unit 222 of the wearable device 22 (see FIG. 8).
  • the operation support information acquisition unit 211 (the operation information acquisition unit 211a and the video information acquisition unit 211b) according to the present embodiment receives the operation information from each of the crane control device 31 and the imaging device 32 in step S11 (FIG. 6A). And processing for acquiring both the object video information.
  • the driver X within the range of the view of the driver X, not only the operation information of the crane 10 but also the image of the suspended load and the surrounding situation taken from different angles. Is provided. Accordingly, the driver X can confirm the positional relationship between the container A and the surrounding obstacles from another angle while directly viewing the suspended container A and the surrounding situation. Person X can operate more safely and efficiently.
  • the crane system according to the present embodiment provides predetermined profile information to the driver via a predetermined profile sensor provided in the crane.
  • FIG. 9 is a diagram illustrating a functional configuration of the information presentation apparatus according to the third embodiment.
  • the terminal device 21 of the information presentation device 20 according to the present embodiment is configured to accept input of predetermined profile information from the profile sensor 33 in addition to the crane control device 31.
  • the profile sensor 33 is a device that irradiates an object to be measured with a laser and can measure the distance between the device itself and the laser reflecting surface according to the incident time of the reflected light.
  • the profile sensor 33 according to the present embodiment can detect a two-dimensional profile (contour) of a plurality of containers and the like loaded on the container ship 50 by scanning the laser in one axial direction.
  • the profile sensor 33 is provided in the trolley 13, the spreader 15, and the like, and scans the laser along the traveling direction of the trolley 13 (the extending direction of the boom 12) in a predetermined range below the profile sensor 33. Thereby, the profile sensor 33 can detect the profiles (contours) in the height direction of a plurality of containers loaded on the container ship 50.
  • the operation support information acquisition unit 211 further includes a profile information acquisition unit 211c in addition to the operation information acquisition unit 211a according to the first embodiment.
  • the profile information acquisition unit 211c inputs profile information indicating profile information (suspended load and surrounding contour information) acquired by the profile sensor 33 as operation support information from the profile sensor 33 via the communication connection unit 213. Are accepted sequentially.
  • FIG. 10 is a diagram illustrating image information displayed on the display unit according to the third embodiment.
  • the image information generation unit 212 according to the present embodiment is based on the operation information acquired by the operation information acquisition unit 211a and the profile information acquired by the profile information acquisition unit 211c. And the image information P3 containing profile information is produced
  • the image information P3 includes an image region P31 in which operation information of the crane 10 is displayed, and an image region P32 in which a contour image formed based on the profile information acquired by the profile sensor 33 is displayed. , Is included.
  • an image Pm showing the outline of the container A as a suspended load and an image Pn showing the outlines of a plurality of containers stacked on the container ship 50 are displayed.
  • the image information P3 generated by the image information generation unit 212 is output to the display unit 222 of the wearable device 22 (see FIG. 10).
  • the profile sensor 33 attached to the crane 10 is not limited to one, and may be attached to a plurality of different locations.
  • the image information generation unit 212 stores in advance the relative positional relationship between the plurality of profile sensors 33 and synthesizes profile information acquired from different profile sensors 33 based on the positional relationship.
  • one profile information is generated.
  • the contour that cannot be detected by one profile sensor 33 as a blind spot can be supplemented by the other profile sensor 33, so that more detailed profile information can be provided to the driver X. .
  • the operation support information acquisition unit 211 (the operation information acquisition unit 211a and the profile information acquisition unit 211c) according to the present embodiment operates from each of the crane control device 31 and the profile sensor 33 in step S11 (FIG. 6A). Processing to acquire both information and profile information is performed.
  • the information presentation apparatus not only the operation information of the crane 10 but also the image imitating the suspended load and the surrounding contour (profile) is provided within the range of the view of the driver X. Is done. Therefore, the driver X can grasp the height and the positional relationship between the container A and the surrounding obstacles while directly viewing the suspended container A and its surroundings. Can be operated more safely and efficiently. Further, since the information presentation apparatus according to the present embodiment is profile information acquired by the profile sensor 33, the amount of information is less than that of video information, and information can be updated at high speed. The configuration can be simplified.
  • the profile information acquired by the profile sensor 33 has been described as two-dimensional profile information (see FIG. 10), but is not limited to this aspect in other embodiments.
  • the profile sensor 33 may be able to scan in the biaxial direction and acquire three-dimensional profile information.
  • the information presentation apparatus 20 (operation support information acquisition unit 211) according to another embodiment includes a video information acquisition unit 211b according to the second embodiment, a profile information acquisition unit 211c according to the third embodiment, The aspect provided with both of these may be sufficient.
  • the image information generation unit 212 according to the other embodiment includes image information including both the object video information acquired by the video information acquisition unit 211b and the profile information acquired by the profile information acquisition unit 211c. It may be generated. Specifically, the image information generation unit 212 displays an image region P22 (FIG. 8) in which object video information (video captured by the imaging device 32) is displayed, and a contour image formed based on the profile information. Image information having both of the displayed image areas P32 (FIG. 10) is generated.
  • the display unit is attached to a wearable device worn by the driver X on the head.
  • the driver X can be realized only by wearing the wearable device, so that the burden of laying the information presentation device 20 can be reduced.
  • the transparent display device is applied to the operation window disposed below the driver X located in the driver's seat.
  • FIG. 11 is a diagram illustrating a functional configuration of the information presentation apparatus according to the fourth embodiment.
  • the information presentation device 20 according to the present embodiment includes a terminal device 21 and a transparent display device 25. Since the functional configuration of the terminal device 21 is the same as that of the first embodiment, detailed description thereof is omitted.
  • the transparent display device 25 includes a wireless communication module 251 and a transparent display unit 252.
  • the transparent display device 25 is a display device having a feature that allows the background behind the display screen to be seen through while displaying image information on the display screen.
  • the transparent display device 25 includes a transparent display unit 252.
  • the transparent display unit 252 is an aspect of the display unit, and is installed so as to cover part or all of the operation window 143 (see FIG. 2) provided below the cab 14.
  • the transparent display unit 252 can display predetermined image information to the driver X and can be seen through the background.
  • the driver X can directly visually recognize the spreader 15, the suspended load (container A), and the like that are positioned beyond the transparent display unit 252 (and the operation window 143).
  • the wireless communication module 251 is equivalent to the wireless communication module 221 described above, and is a communication interface for exchanging information with the wireless communication module 214 of the terminal device 21 wirelessly.
  • the transparent display device 25 acquires the image information generated by the image information generation unit 212 via the wireless communication module 214.
  • the exchange of information between the terminal device 21 and the transparent display device 25 is not limited to wireless communication, and may be performed by wired communication.
  • FIG. 12 is a diagram illustrating an example of a scene visually recognized by the driver through the transparent display unit according to the fourth embodiment.
  • FIG. 12 shows an example of a scene that the driver X according to the present embodiment can visually recognize from the driver's seat 141 through the operation window 143 below the driver's seat 141.
  • the transparent display unit 252 according to the present embodiment is installed on the entire surface of the operation window 143.
  • the transparent display unit 252 displays image information P4 including operation support information (in this embodiment, operation information of the crane 10) acquired via the wireless communication module 251. As shown in FIG. 12, the image information P ⁇ b> 4 is displayed at the corner of the transparent display unit 252.
  • the driver X is positioned below the transparent display portion 252 and the operation window 143 in an area other than the area where the image information P4 is displayed.
  • the spreader 15 to be suspended, the suspended container A, and the containers stacked in the vicinity thereof can be directly seen (see FIG. 12).
  • the display unit transparent display unit 252 disposed at the position where the driver enters the field of view.
  • Operation support information operation information
  • the transparent display part 252 can see the background transparently, the driver
  • the image information is displayed on the wearable device 22 worn by the driver X on the head.
  • the image information is displayed on the operation window 143. It is assumed that it is displayed on the installed transparent display unit 252. Thereby, since it is not necessary to wear equipment, such as wearable device 22, work burden of driver X can be reduced.
  • the transparent display unit 252 has been described as one that displays operation information acquired from the crane control device 31 as operation support information in the corner of the operation window 143 (FIG. 12).
  • the transparent display unit 252 includes object video information, profile information, and the like acquired through the imaging device 32 and the profile sensor 33 as operation support information, as in the second and third embodiments. Image information may be displayed.
  • the transparent display device is applied to the operation window disposed below the driver X located in the driver's seat, and the attributes defined in advance for each container to be suspended. Information is displayed on a transparent display device to assist the driver in operating.
  • FIG. 13 is a diagram illustrating a functional configuration of the information presentation apparatus according to the fifth embodiment.
  • the information presentation device 20 according to the present embodiment includes a terminal device 21 and a transparent display device 25.
  • the terminal device 21 receives input of attribute information for each container from the ground terminal device 34 in addition to the crane control device 31.
  • the ground terminal device 34 is a terminal device installed in a work room of a container yard.
  • the ground terminal device 34 is associated with a container ID for identifying a plurality of containers loaded on the container ship 50, coordinate information indicating where each container is loaded on the container ship 50, and the like.
  • a container attribute table (attribute information) is stored.
  • the operation support information acquisition unit 211 further includes an attribute information acquisition unit 211d in addition to the operation information acquisition unit 211a according to the first embodiment.
  • the attribute information acquisition unit 211d receives input of attribute information stored in the ground terminal device 34 as operation support information from the ground terminal device 34 via the communication connection unit 213. Further, the attribute information acquisition unit 211d according to the present embodiment further acquires three-dimensional model data imitating the structure of the container ship 50 to be anchored and the loaded container.
  • FIG. 14 is a diagram illustrating an example of a container attribute table stored in the ground terminal device according to the fifth embodiment.
  • the container attribute table is an aspect of the attribute information, and identifies a container ID for identifying a container, a container ship ID for identifying a loaded container ship, and where the container ship is expected.
  • 4 is a table for associating each of loading position coordinates (X, Y, Z), a work procedure indicating the order of containers to be loaded and unloaded, and position coordinates (X, Y, Z) arranged in the container yard.
  • the container attribute table is created in advance by a distribution manager or the like and stored in the ground terminal device 34 installed in the container yard. Note that the container attribute table shown in FIG. 14 is an example, and is not limited to this, and may include other information.
  • FIG. 15 is a diagram illustrating an example of a scene visually recognized by the driver through the transparent display unit according to the fifth embodiment.
  • FIG. 15 shows an example of a scene that the driver X according to the present embodiment can visually recognize from the driver's seat 141 through the operation window 143 below the driver's seat 141.
  • the transparent display unit 252 according to this embodiment is installed on the entire surface of the operation window 143. Further, since the transparent display portion 252 can be seen through the background, the driver X can use the transparent display portion 252 and the operation window 143 to spread the spreader 15 located below, the suspended container A, and the surrounding area. The containers stacked in the stack can be directly visually recognized (see FIG. 15).
  • the transparent display unit 252 displays image information P51 to P53 including operation support information (in this embodiment, operation information and attribute information of the crane 10) acquired via the wireless communication module 251.
  • the image information P51 is operation information of the crane 10.
  • the image information generation unit 212 generates procedure list image information P52 indicating the work procedure of the driver X based on the attribute information (container attribute table) acquired by the attribute information acquisition unit 211d. Specifically, the image information generation unit 212 lists the container ID and the yard position coordinates associated with the container ID in the order shown in the work procedure of the container attribute table (see FIG. 15). By displaying this image information P52 on the transparent display unit 252, the driver X can grasp the transport procedure of the containers stacked on the container ship 50 and the arrangement position in the container yard.
  • the image information generation unit 212 includes the loading position coordinates of the attribute information (container attribute table) acquired by the attribute information acquisition unit 211d, the container ID, and the 3D model data that conforms to the container ship ID. , Each piece of attribute information (container ID) generates image information P53 associated with each of the containers that are directly viewed from the operation window 143.
  • the image information generation unit 212 determines from the driver seat 141 where the driver X is located based on the relationship between the operation information of the crane 10 (transverse coordinates, hoisting coordinates, etc.) and the anchoring position of the container ship 50. A process of matching the scene of the container ship 50 viewed through the operation window 143 with the three-dimensional model data of the container ship 50 created in advance is performed.
  • the image information generation unit 212 refers to the three-dimensional model data of the container ship 50, the container ID and the loading position coordinates (X, Y, Z) of each container loaded on the container ship 50, and actually The image information P53 is generated so that the container ID of each container is attached to the position corresponding to each container in the three-dimensional model data matched with the scene.
  • the image information P53 indicating the container ID is displayed so as to correspond to each of the containers directly visible from the driver X, so that the driver can accurately display a plurality of containers stacked on the container ship 50. Can be identified.
  • a procedure list indicating the order of containers in which the driver X performs cargo handling is displayed on the transparent display unit 252.
  • the container ID is assigned so that the driver X corresponds to each container that is actually visually recognized through the transparent display unit 252 (operation window 143). Accordingly, the driver X can grasp the container to be carried next at a glance, and can accurately and quickly determine the container, so that the cargo handling operation can be performed more efficiently.
  • the image information generation unit 212 for example, through the transparent display unit 252 so that the height of the suspended container A and its surroundings can be grasped at a glance.
  • a color distribution color gradation such as red, blue, yellow, etc.
  • corresponding to the height may be attached to a directly visible container or the like.
  • the crane which concerns on each above-mentioned embodiment demonstrated as what is a container crane installed in a quay, in other embodiment, it is not limited to this aspect.
  • the crane on which the information presentation device is mounted is a mode in which the driver works while directly viewing the suspended load (container A) and the object (a plurality of containers loaded on the container ship 50) positioned below the crane. Any other crane may be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Control And Safety Of Cranes (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

Le dispositif de présentation d'informations (20) selon l'invention est destiné à une grue qui est pourvue des éléments suivants : une flèche qui s'étend au-dessus d'un objet qui est destiné à être une charge suspendue ; un chariot qui est mobile le long de la flèche ; un moyen de suspension qui est installé sur le chariot et mobile verticalement tout en suspendant l'objet ; et une cabine de conducteur qui est installée au-dessus de l'objet et a une fenêtre de fonctionnement prévue de manière à permettre à un conducteur assis sur un siège de conducteur de voir l'objet suspendu au-dessous de celle-ci. Le dispositif de présentation d'informations (20) est pourvu des éléments suivants : une unité d'affichage (222) qui peut afficher des informations d'image prédéterminées dans le champ de vision lorsque le conducteur regarde à travers la fenêtre de fonctionnement ; une unité d'acquisition (211) d'informations d'assistance de fonctionnement qui reçoit des informations d'assistance de fonctionnement pour aider au fonctionnement du travail de suspension du conducteur ; et une unité de génération d'informations d'image (212) qui génère des informations d'image comprenant au moins les informations d'assistance de fonctionnement reçues et délivre en sortie les informations d'image générées à l'unité d'affichage (222).
PCT/JP2014/059134 2014-03-28 2014-03-28 Dispositif de présentation d'informations, système de grue et procédé de présentation d'informations WO2015145725A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2015526428A JP6017691B2 (ja) 2014-03-28 2014-03-28 情報提示装置、クレーンシステム及び情報提示方法
PCT/JP2014/059134 WO2015145725A1 (fr) 2014-03-28 2014-03-28 Dispositif de présentation d'informations, système de grue et procédé de présentation d'informations
CN201480003357.3A CN105189327B (zh) 2014-03-28 2014-03-28 信息提示装置、起重机系统及信息提示方法
HK16107114.8A HK1219087A1 (zh) 2014-03-28 2016-06-21 信息提示裝置、起重機系統及信息提示方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2014/059134 WO2015145725A1 (fr) 2014-03-28 2014-03-28 Dispositif de présentation d'informations, système de grue et procédé de présentation d'informations

Publications (1)

Publication Number Publication Date
WO2015145725A1 true WO2015145725A1 (fr) 2015-10-01

Family

ID=54194314

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/059134 WO2015145725A1 (fr) 2014-03-28 2014-03-28 Dispositif de présentation d'informations, système de grue et procédé de présentation d'informations

Country Status (4)

Country Link
JP (1) JP6017691B2 (fr)
CN (1) CN105189327B (fr)
HK (1) HK1219087A1 (fr)
WO (1) WO2015145725A1 (fr)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017063014A1 (fr) * 2015-10-16 2017-04-20 Palfinger Ag Ensemble constitué d'un dispositif de commande et d'un module de commande mobile
JP2017103767A (ja) * 2015-11-25 2017-06-08 株式会社リコー 視認システム
EP3321226A1 (fr) * 2016-11-11 2018-05-16 ABB Schweiz AG Système de commande de grue à conteneur équipé de plusieurs caméras
WO2018190345A1 (fr) * 2017-04-11 2018-10-18 川崎重工業株式会社 Système de robot et procédé d'actionnement d'un tel système de robot
WO2019017458A1 (fr) * 2017-07-21 2019-01-24 株式会社タダノ Dispositif d'affichage d'informations de guidage, grue équipée de ce dispositif, et procédé d'affichage d'informations de guidage
WO2019017455A1 (fr) * 2017-07-21 2019-01-24 株式会社タダノ Dispositif d'affichage d'informations de guidage et grue
JP2019172410A (ja) * 2018-03-27 2019-10-10 株式会社タダノ クレーン
EP3656722A4 (fr) * 2017-07-21 2021-04-28 Tadano Ltd. Dispositif d'affichage d'information de guidage, grue le comportant, et procédé d'affichage d'information de guidage
JP2021104901A (ja) * 2017-02-28 2021-07-26 ジェイ． レイ マクダーモット， エス．エー． 目標追跡支援を用いた、沖合での船から船への吊り上げ
JP2021183536A (ja) * 2020-05-22 2021-12-02 一般社団法人港湾荷役機械システム協会 コンテナクレーンの運転支援装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110555913B (zh) * 2019-08-27 2023-04-14 正知（上海）智能技术有限公司 一种基于工业人机界面的虚拟成像方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01299191A (ja) * 1988-05-25 1989-12-01 Hitachi Ltd クレーンの運転室
JPH07137982A (ja) * 1993-11-15 1995-05-30 Ohbayashi Corp クレーンのテレビモニター装置
JPH09200650A (ja) * 1996-01-17 1997-07-31 Nippon Steel Corp 映像表示方法及びその装置
JP2003146579A (ja) * 2001-11-16 2003-05-21 Mitsubishi Heavy Ind Ltd クレーン制御装置及び制御方法
JP2005029284A (ja) * 2003-07-07 2005-02-03 Mitsubishi Electric Corp 無線通信装置
JP2010089934A (ja) * 2008-10-09 2010-04-22 Mitsui Eng & Shipbuild Co Ltd コンテナクレーン
JP2013061848A (ja) * 2011-09-14 2013-04-04 Panasonic Corp 非接触入力装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3398999B2 (ja) * 1993-02-10 2003-04-21 株式会社デンソー 多重映像表示装置
JPH0781887A (ja) * 1993-09-10 1995-03-28 Komatsu Mec Corp クレーンの安全表示装置
JP3052286B2 (ja) * 1997-08-28 2000-06-12 防衛庁技術研究本部長 飛行システムおよび航空機用擬似視界形成装置
JP2008265934A (ja) * 2007-04-18 2008-11-06 Tadano Ltd 作業機稼動情報表示システム
CN101046926A (zh) * 2007-04-28 2007-10-03 武汉科技大学 一种起重机虚拟操纵系统
JP5876679B2 (ja) * 2011-07-08 2016-03-02 株式会社タダノ 性能線表示装置
CN102923578A (zh) * 2012-11-13 2013-02-13 扬州华泰特种设备有限公司 集装箱起重机高效装卸作业自动控制系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01299191A (ja) * 1988-05-25 1989-12-01 Hitachi Ltd クレーンの運転室
JPH07137982A (ja) * 1993-11-15 1995-05-30 Ohbayashi Corp クレーンのテレビモニター装置
JPH09200650A (ja) * 1996-01-17 1997-07-31 Nippon Steel Corp 映像表示方法及びその装置
JP2003146579A (ja) * 2001-11-16 2003-05-21 Mitsubishi Heavy Ind Ltd クレーン制御装置及び制御方法
JP2005029284A (ja) * 2003-07-07 2005-02-03 Mitsubishi Electric Corp 無線通信装置
JP2010089934A (ja) * 2008-10-09 2010-04-22 Mitsui Eng & Shipbuild Co Ltd コンテナクレーン
JP2013061848A (ja) * 2011-09-14 2013-04-04 Panasonic Corp 非接触入力装置

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3362399B1 (fr) 2015-10-16 2019-08-21 Palfinger AG Arrangement d'un dispositif de commande et un module de commande mobile
DE202016008565U1 (de) 2015-10-16 2018-06-26 Palfinger Ag Anordnung aus einer Steuerung und einem mobilen Steuerungsmodul
WO2017063014A1 (fr) * 2015-10-16 2017-04-20 Palfinger Ag Ensemble constitué d'un dispositif de commande et d'un module de commande mobile
US10961087B2 (en) 2015-10-16 2021-03-30 Palfinger Ag Arrangement of a controller and a mobile control module
JP2017103767A (ja) * 2015-11-25 2017-06-08 株式会社リコー 視認システム
EP3321226A1 (fr) * 2016-11-11 2018-05-16 ABB Schweiz AG Système de commande de grue à conteneur équipé de plusieurs caméras
WO2018086929A1 (fr) * 2016-11-11 2018-05-17 Abb Schweiz Ag Système de commande de portique à conteneurs comprenant de multiples caméras
JP7498130B2 (ja) 2017-02-28 2024-06-11 ジェイ． レイ マクダーモット， エス．エー． 目標追跡支援を用いた、沖合での船から船への吊り上げ
JP2021104901A (ja) * 2017-02-28 2021-07-26 ジェイ． レイ マクダーモット， エス．エー． 目標追跡支援を用いた、沖合での船から船への吊り上げ
WO2018190345A1 (fr) * 2017-04-11 2018-10-18 川崎重工業株式会社 Système de robot et procédé d'actionnement d'un tel système de robot
JP2018176342A (ja) * 2017-04-11 2018-11-15 川崎重工業株式会社 ロボットシステム及びその運転方法
JP2019024150A (ja) * 2017-07-21 2019-02-14 株式会社タダノ ガイド情報表示装置およびクレーン
JP2019024151A (ja) * 2017-07-21 2019-02-14 株式会社タダノ ガイド情報表示装置およびこれを備えたクレーンおよびガイド情報表示方法
WO2019017455A1 (fr) * 2017-07-21 2019-01-24 株式会社タダノ Dispositif d'affichage d'informations de guidage et grue
EP3656722A4 (fr) * 2017-07-21 2021-04-28 Tadano Ltd. Dispositif d'affichage d'information de guidage, grue le comportant, et procédé d'affichage d'information de guidage
WO2019017458A1 (fr) * 2017-07-21 2019-01-24 株式会社タダノ Dispositif d'affichage d'informations de guidage, grue équipée de ce dispositif, et procédé d'affichage d'informations de guidage
JP2019172410A (ja) * 2018-03-27 2019-10-10 株式会社タダノ クレーン
JP7006442B2 (ja) 2018-03-27 2022-01-24 株式会社タダノ クレーン
JP2021183536A (ja) * 2020-05-22 2021-12-02 一般社団法人港湾荷役機械システム協会 コンテナクレーンの運転支援装置
JP7212004B2 (ja) 2020-05-22 2023-01-24 一般社団法人港湾荷役システム協会 コンテナクレーンの運転支援装置

Also Published As

Publication number Publication date
HK1219087A1 (zh) 2017-03-24
CN105189327B (zh) 2017-03-15
JPWO2015145725A1 (ja) 2017-04-13
JP6017691B2 (ja) 2016-11-02
CN105189327A (zh) 2015-12-23

Similar Documents

Publication Publication Date Title
JP6017691B2 (ja) 情報提示装置、クレーンシステム及び情報提示方法
US11679961B2 (en) Method and apparatus for controlling a crane, an excavator, a crawler-type vehicle or a similar construction machine
EP3235773B1 (fr) Dispositif d'obtention d'informations environnementales pour un véhicule de travail
JP6801421B2 (ja) クレーン
JP5488882B2 (ja) 固定映像表示システム
CN107428515A (zh) 用于定位夹持部件的方法、负载操纵装置、计算机程序和计算机程序产品
JP6481178B2 (ja) クレーンの遠隔運転方法及びクレーンの遠隔運転装置
JP2018095375A (ja) クレーン
KR20190078984A (ko) 인양물의 크레인 충돌방지를 위한 감시 시스템
JP2014151979A (ja) 作業車用の地図作成装置
JP2011063358A (ja) 吊荷下方の監視システム及び監視方法
JP5575571B2 (ja) 画像生成システム
JP6257947B2 (ja) 作業車の周囲情報取得装置
JP5595822B2 (ja) 画像生成システム
JP6805780B2 (ja) クレーン
KR101258851B1 (ko) 크레인 제어 장치 및 방법
JP6309481B2 (ja) クレーンの運転支援方法及びクレーンの運転支援装置
KR102536448B1 (ko) 지게차의 전방 충돌 위험 감지 모니터링 장치
JP2019218198A (ja) 操作支援システム
JP7345335B2 (ja) クレーンの運転支援システム及びクレーンの運転支援方法
JP5575572B2 (ja) 画像生成システム
JP2021151920A (ja) クレーンの作業管理システム、及び管理装置
JP7212004B2 (ja) コンテナクレーンの運転支援装置
JP2023121468A (ja) クレーンの操縦支援システム及び操縦支援システムを有するクレーン
JP2021183527A (ja) ブームカメラシステムおよびブームカメラシステムを備える移動式クレーン

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480003357.3

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2015526428

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14887320

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14887320

Country of ref document: EP

Kind code of ref document: A1