WO2022224827A1 - 情報処理装置、情報処理装置の制御プログラム - Google Patents

情報処理装置、情報処理装置の制御プログラム Download PDF

Info

Publication number
WO2022224827A1
WO2022224827A1 PCT/JP2022/017186 JP2022017186W WO2022224827A1 WO 2022224827 A1 WO2022224827 A1 WO 2022224827A1 JP 2022017186 W JP2022017186 W JP 2022017186W WO 2022224827 A1 WO2022224827 A1 WO 2022224827A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
state
recording
image
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/017186
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
平 松岡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sumitomo Heavy Industries Ltd
Original Assignee
Sumitomo Heavy Industries Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sumitomo Heavy Industries Ltd filed Critical Sumitomo Heavy Industries Ltd
Priority to JP2023516433A priority Critical patent/JPWO2022224827A1/ja
Priority to DE112022002406.2T priority patent/DE112022002406T5/de
Priority to CN202280030196.1A priority patent/CN117203957A/zh
Publication of WO2022224827A1 publication Critical patent/WO2022224827A1/ja
Priority to US18/490,853 priority patent/US20240044113A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E02F9/267—Diagnosing or detecting failure of vehicles
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/20—Drives; Control devices
    • E02F9/22—Hydraulic or pneumatic drives
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/24—Safety devices, e.g. for preventing overload
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E02F9/261—Surveying the work-site to be treated
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E02F9/264—Sensors and their calibration for indicating the position of the work tool
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an information processing device and its control program.
  • the vehicle is a work machine
  • the work machine itself may vibrate due to work (for example, excavation work, etc.), so the acceleration sensor cannot detect the behavior.
  • the present invention has been made in view of the above circumstances, and an object of the present invention is to suitably perform event recording of work machines.
  • the present invention is an information processing device, an image acquisition means for acquiring an image around the working machine; a recording means for recording the image acquired by the image acquisition means; an operation information obtaining means for obtaining operation information relating to the operation of the work machine; a state detection means for detecting a state of the work machine and acquiring state information about the state; determination means for determining whether or not there is a predetermined difference between the operation information acquired from the operation information acquisition means and the state information acquired from the state detection means; recording control means for causing the recording means to record, when the determination means determines that there is a difference between the operation information and the state information, the image including at least the image at the time when it is determined that there is a difference; It was configured to include
  • the present invention is a control program for an information processing apparatus comprising: image acquiring means for acquiring an image around a work machine; and recording means for recording the image acquired by the image acquiring means, the computer, operation information acquisition means for acquiring operation information relating to operation of the work machine; state detection means for detecting a state of the work machine and acquiring state information about the state; determination means for determining whether there is a predetermined difference between the operation information acquired from the operation information acquisition means and the state information acquired from the state detection means; recording control means for causing the recording means to record the image including at least the image at the time when the determination means determines that there is a difference between the operation information and the state information; It was assumed to function as
  • event recording of work machines can be preferably performed.
  • FIG. 1 is a side view of a shovel according to this embodiment
  • FIG. 2 is a block diagram showing the system configuration of the excavator of FIG. 1
  • FIG. 3 is a diagram showing a horizontal imaging range (angle of view) of the imaging device according to the embodiment
  • FIG. 4 is a flowchart showing the flow of recording control processing according to the embodiment
  • the excavator 100 is configured so that event recording of the excavator 100 can be preferably performed by including the information processing device according to the present invention.
  • FIG. 1 is a side view of a shovel 100 according to this embodiment.
  • the excavator 100 includes a lower traveling body 1, an upper revolving body 3 mounted on the lower traveling body 1 so as to be able to turn via a revolving mechanism 2, a boom 4 as an attachment 11, an arm 5 and a A bucket 6 and a cabin 10 in which an operator boards are provided.
  • the attachment 11 is not limited to this as long as a work element (for example, bucket, crusher, crane device, etc.) is provided.
  • the lower traveling body 1 includes, for example, a pair of left and right crawlers, and each crawler is hydraulically driven by a traveling hydraulic motor (not shown) to cause the excavator 100 to travel.
  • the upper revolving structure 3 is driven by a revolving hydraulic motor or an electric motor (both not shown) or the like to revolve in a horizontal plane with respect to the lower traveling structure 1 .
  • the boom 4 is pivotally attached to the center of the front portion of the upper rotating body 3 so as to be able to be raised.
  • An arm 5 is pivotally attached to the tip of the boom 4 so as to be vertically rotatable. rotatably pivoted;
  • Boom 4, arm 5 and bucket 6 are hydraulically driven by boom cylinder 7, arm cylinder 8 and bucket cylinder 9, respectively.
  • the cabin 10 is a cockpit in which an operator boards, and is mounted on the front left side of the upper swing body 3, for example.
  • the excavator 100 operates actuators to drive driven elements such as the lower traveling body 1, the upper revolving body 3, the boom 4, the arm 5 and the bucket 6 according to the operation of the operator in the cabin 10.
  • FIG. 2 is a block diagram showing the system configuration of the excavator 100.
  • the excavator 100 includes a controller 30, an imaging device 40, an operation/posture state sensor 42, a position sensor 43, an orientation sensor 44, an operation device 45, and a display device in addition to the above configuration. 50 , an audio output device 60 and a communication device 80 .
  • An information processing apparatus according to the present invention includes at least a controller 30 .
  • the imaging device 40 photographs the surroundings of the excavator 100 and outputs the image to the controller 30 .
  • the imaging device 40 includes a rear camera 40B, a left camera 40L, and a right camera 40R.
  • the “surroundings” of the excavator 100 may include at least a predetermined range within a predetermined distance from the excavator 100 .
  • the rear camera 40 ⁇ /b>B is attached to the rear portion of the upper revolving body 3 and photographs the rear of the upper revolving body 3 .
  • the left camera 40L is attached to the left side of the upper revolving body 3 and photographs the left side of the upper revolving body 3 .
  • the right camera 40R is attached to the right side of the upper revolving body 3 and photographs the right side of the upper revolving body 3 .
  • Each of these rear camera 40B, left camera 40L, and right camera 40R is attached to the upper revolving body 3 so that the optical axis is directed obliquely downward, and covers the area from the ground in the vicinity of excavator 100 to the distance from excavator 100. It has a directional imaging range (angle of view).
  • the horizontal imaging ranges (angles of view) of the rear camera 40B, the left camera 40L, and the right camera 40R cover three directions around the excavator 100, excluding the front.
  • the imaging device 40 an imaging device for imaging the front of the excavator 100 or an imaging device for imaging the inside of the cabin 10 may be further provided.
  • the motion/posture state sensor 42 is a sensor that detects the motion state and posture state of the excavator 100 and outputs the detection result to the controller 30 .
  • the motion/posture state sensor 42 includes a boom angle sensor, an arm angle sensor, a bucket angle sensor, a three-axis inertial sensor (IMU: Inertial Measurement Unit), a turning angle sensor, and an acceleration sensor. These sensors may be composed of stroke sensors of cylinders such as booms, sensors that acquire rotation information such as rotary encoders, etc., or may be replaced by acceleration (which may also include speed and position) acquired by the IMU. good.
  • the arm angle sensor detects the rotation angle of the arm 5 with respect to the boom 4 (hereinafter referred to as "arm angle").
  • the bucket angle sensor detects the rotation angle of the bucket 6 with respect to the arm 5 (hereinafter referred to as "bucket angle").
  • the IMU is attached to each of the boom 4 and arm 5 and detects the acceleration of the boom 4 and arm 5 along three predetermined axes and the angular acceleration of the boom 4 and arm 5 about three predetermined axes.
  • the turning angle sensor detects a turning angle of the upper turning body 3 with respect to a predetermined angular direction.
  • the turning angle is not limited to this, and the turning angle may be detected based on the GPS or IMU sensor provided on the upper turning body 3 .
  • the acceleration sensor is attached at a position away from the pivot axis of the upper swing body 3 and detects the acceleration at that position of the upper swing body 3 . As a result, it can be determined whether the upper rotating body 3 is rotating or whether the lower traveling body 1 is running based on the detection result of the acceleration sensor.
  • the position sensor 43 is a sensor that acquires information on the position (current position) of the excavator 100, and is a GPS (Global Positioning System) receiver in this embodiment.
  • the position sensor 43 receives GPS signals including information on the position of the excavator 100 from GPS satellites, and outputs the acquired position information of the excavator 100 to the controller 30 .
  • the position sensor 43 may not be a GPS receiver as long as it can acquire information on the position of the excavator 100, and may use a satellite positioning system other than GPS, for example.
  • the position sensor 43 may be provided on the lower traveling body 1 or may be provided on the upper revolving body 3 .
  • the azimuth sensor 44 is a sensor that acquires information on the azimuth (direction) in which the excavator 100 is facing, and is, for example, a geomagnetic sensor.
  • the orientation sensor 44 acquires orientation information of the excavator 100 and outputs the information to the controller 30 . Note that the orientation sensor 44 only needs to acquire information on the orientation of the excavator 100, and the sensor type and the like are not particularly limited. For example, two GPS receivers may be provided and azimuth information may be acquired from the difference in position information.
  • the operation device 45 is provided near the driver's seat of the cabin 10, and is an operation means for an operator to operate each operation element (lower running body 1, upper revolving body 3, attachment 11, etc.) of the vehicle body.
  • the operating device 45 is operating means for operating each hydraulic actuator that drives each operating element.
  • the operating device 45 includes, for example, levers, pedals, various buttons, and the like, and outputs operation signals to the controller 30 according to the content of these operations.
  • the operation device 45 is also an operation means for operating the imaging device 40, the motion/posture state sensor 42, the position sensor 43, the display device 50, the audio output device 60, the communication device 80, etc., and issues operation commands to these units. Output to the controller 30 .
  • the display device 50 is provided around the cockpit in the cabin 10 and displays various image information to be notified to the operator under the control of the controller 30 .
  • the display device 50 is, for example, a liquid crystal display or an organic EL (Electroluminescence) display, and may be of a touch panel type that also serves as at least part of the operation device 45 .
  • the audio output device 60 is provided around the cockpit in the cabin 10, and outputs various audio information to be notified to the operator under the control of the controller 30.
  • the audio output device 60 is, for example, a speaker, buzzer, or the like.
  • the communication device 80 communicates various information with remote external devices, other shovels 100, etc., through a predetermined communication network (for example, a mobile phone network with a base station as an end, an Internet network, etc.) NW.
  • a predetermined communication network for example, a mobile phone network with a base station as an end, an Internet network, etc.
  • the controller 30 is a control device that controls the operation of each part of the excavator 100 and controls the drive of the excavator 100 .
  • the controller 30 is mounted inside the cabin 10 .
  • the functions of the controller 30 may be realized by arbitrary hardware, software, or a combination thereof, and for example, it is mainly composed of a microcomputer including CPU, RAM, ROM, I/O, and the like.
  • the controller 30 may be configured to include, for example, FPGA, ASIC, and the like.
  • the controller 30 also includes a state detection unit 31, a comparison determination unit 32, and a recording control unit 33 as functional units that execute various functions. Further, the controller 30 includes a storage section 35 as a storage area defined in an internal memory such as EEPROM (Electrically Erasable Programmable Read-Only Memory). Note that the storage unit 35 may be an external memory of the controller 30 .
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • the state detection unit 31 acquires state information regarding the state of the excavator 100 and outputs the state information to the controller 30 .
  • the comparison determination unit 32 compares the operation information regarding the operation of the excavator 100 and the state information of the excavator 100, and determines whether or not there is a predetermined difference between them.
  • the recording control unit 33 controls storage (recording) of image data acquired by the imaging device 40 in the storage unit 35 . Specific processing contents of these functional units will be described later.
  • the storage unit 35 stores various programs for operating each unit of the excavator 100 and various data such as image data acquired by the imaging device 40 , and also functions as a work area for the controller 30 .
  • the storage unit 35 of this embodiment has a loop recording area 351 and a plurality of protection areas 352 as recording areas for storing image data acquired by the imaging device 40 .
  • the loop recording area 351 is a recording area where, when image data is recorded until it occupies most of its recording capacity, recording is continued by automatically overwriting the oldest data.
  • the protected area 352 is a recording area in which overwrite recording is prohibited, and is a recording area for protecting recorded image data. At least one protection area 352 is sufficient.
  • the excavator 100 can communicate with the management device 200 through a predetermined communication network NW.
  • the communication network NW may include, for example, a mobile communication network terminating at a base station.
  • the communication network NW may include a satellite communication network using a communication satellite in the sky.
  • the communication network NW may include the Internet network or the like.
  • the communication network NW may include a short-range communication network conforming to protocols such as WiFi and Bluetooth (registered trademark).
  • the excavator 100 can transmit (upload) various information to the management device 200 .
  • the excavator 100 may be configured to be able to communicate with the support device 300 through the communication network NW.
  • a management device 200 (an example of an external device or an information processing device) is arranged at a location geographically separated from a user or the like possessing the excavator 100 and the support device 300 .
  • the management device 200 is, for example, a server device installed in a management center or the like provided outside the work site where the excavator 100 works, and configured mainly by one or a plurality of server computers or the like.
  • the server device may be an in-house server operated by a business operator that operates the system or a related business operator related to the business operator, or may be a rental server. Also, this server device may be a so-called cloud server.
  • the management device 200 may be a server device (so-called edge server) arranged in a management office or the like in the work site of the excavator 100, or may be a stationary or portable general-purpose computer terminal. good. As described above, the management device 200 can mutually communicate with each of the excavator 100 and the support device 300 through the communication network NW. As a result, the management device 200 can receive and store (accumulate) various information uploaded from the excavator 100 . In addition, the management device 200 can transmit various types of information to the support device 300 in response to requests from the support device 300 .
  • a support device 300 (an example of a user terminal or terminal device) is a user terminal used by a user. Users may include, for example, worksite supervisors, managers, excavator 100 operators, excavator 100 managers, excavator 100 service personnel, excavator 100 developers, and the like.
  • the support device 300 is, for example, a general-purpose portable terminal such as a laptop computer terminal, a tablet terminal, or a smart phone possessed by the user. Further, the support device 300 may be a stationary general-purpose terminal such as a desktop computer. Further, the support device 300 may be a dedicated terminal (portable terminal or stationary terminal) for receiving provision of information.
  • the support device 300 can communicate with the management device 200 through the communication network NW. Accordingly, the support device 300 can receive information transmitted from the management device 200 and provide the information to the user through the display device mounted therein. Further, the support device 300 may be configured to communicate with the excavator 100 through the communication network NW.
  • FIG. 4 is a flow chart showing the flow of this recording control process.
  • the recording control process is executed by the controller 30 executing a predetermined program stored in the internal storage device on the CPU. This process may be executed/finished based on an operator's operation, or may be continuously executed while the excavator 100 is in operation.
  • step S1 when the operator starts operating the excavator 100 (step S1), the controller 30 acquires image (video) data around the excavator 100 using the imaging device 40. Then, the acquired image data is recorded in the storage unit 35 as needed (step S2). Here, the controller 30 causes the image data acquired in the normal state to be recorded in the loop recording area 351 of the storage section 35 .
  • images or image data refer to those acquired by the imaging device 40 unless otherwise specified.
  • the controller 30 acquires operation information regarding the operation of the excavator 100 from the operation device 45 (step S3).
  • the "operation information" regarding the operation of the excavator 100 is an operation command (operation content) for the operation device 45 by the operator, and includes at least the vehicle body of the excavator 100 (including the lower traveling body 1 and the upper revolving body 3). Refers to information that includes operation commands related to movement and posture. Note that the “body” of the shovel 100 to be detected may include the attachment 11 .
  • the controller 30 acquires state information about the state of the excavator 100 by the state detection unit 31 (step S4).
  • the “state information” regarding the state of the excavator 100 means at least information regarding the operating state and attitude state of the vehicle body of the excavator 100 (including the lower traveling body 1 and the upper rotating body 3).
  • the “body” of the shovel 100 to be detected may include the attachment 11 .
  • the imaging device 40 includes a front camera that captures an image of the front of the excavator 100 so that the image of the attachment 11 can be obtained by the front camera.
  • the state detection unit 31 acquires state information of the excavator 100 based on image data acquired by the imaging device 40 . Specifically, an image feature amount is extracted from the image data to detect the motion and posture of the excavator 100 . Any image feature amount may be used as long as the operation/state of the excavator 100 can be detected by optical flow, for example.
  • the state detection unit 31 detects various sensors mounted on the excavator 100 (for example, the motion/posture state sensor 42, the position sensor 43, the direction sensor 44, etc.), various actuators (for example, an electromagnetic valve for controlling hydraulic pressure), State information of the excavator 100 may be acquired from various control devices. For example, the state detection unit 31 can acquire the position and orientation of the excavator 100 using the position sensor 43 and the orientation sensor 44, and can detect the excavation operation of the attachment 11 by detecting the operation and load of the bucket 6.
  • the controller 30 determines whether or not there is a predetermined difference (difference) between the operation information acquired in step S3 and the state information acquired in step S4 (step S5).
  • the “predetermined difference” between the operation information and the state information means that the operator's operation content (operation information), which is an input, and the operation/posture state (state information) of the excavator 100, which is an output, are substantially different. means that it is not physically consistent. Therefore, for example, detection errors of operation information and status information are not included in the "predetermined difference”.
  • this predetermined difference (difference) can be adjusted as appropriate, and for example, a condition may be set as the difference that the moving direction vectors of the shovel 100 differ greatly by a predetermined angle or more.
  • step S5 when it is determined that there is no predetermined difference between the operation information and the state information (they substantially match) (step S5; No), the controller 30 shifts the processing to step S3 described above. do.
  • step S5 determines whether there is a predetermined difference between the operation information and the state information (they are substantially inconsistent) (step S5; Yes).
  • the controller 30 causes the recording control section 33 to perform loop recording.
  • the recording of the image data in the area 351 is stopped (step S6).
  • the recording control unit 33 moves the image data (the image itself or its copy) in the time range that is a predetermined amount of time before the time when the difference is detected to the protection area 352 .
  • the image data to be moved should include at least the image data at the time when it is determined that there is a difference. Thereby, the image data at the time when the difference between the operation information and the state information is detected can be saved so as not to be overwritten.
  • images after the detection time may also be recorded in the protected area 352 .
  • images after the detection time may also be recorded in the protected area 352 . Note that in this step, it is sufficient that at least the image data is recorded in the storage unit 35, and even if the image data is not moved to the protection area 352 or the recording of the image data in the loop recording area 351 is not stopped. good.
  • a situation in which the operation content of the operator and the operation/posture state of the excavator 100 do not substantially match means that an accident has already occurred. Even if it has occurred, there is a risk of machine failure, etc. Therefore, by saving the video including (preferably including before and after) the time when the inconsistency was detected as an event record (a record of a situation or phenomenon that is different from the normal state), it is possible to investigate the cause of the phenomenon that occurred. can help. Also, there may be a bug that causes the phenomenon during a specific operation, and in this case, the recorded video can be used as verification material.
  • the operation information includes an instruction to stop the excavator 100 and the state information includes movement of the excavator 100 .
  • the state information includes rotation in a direction different from the turning direction of the upper turning body 3 .
  • the car body is rotating vertically (rotating in a substantially vertical plane).
  • Actual situation Falling over.
  • the controller 30 notifies the operator that there is a predetermined difference between the operation information and the state information, that is, that the details of the operator's operation and the operation/attitude state of the excavator 100 do not substantially match (step S7).
  • This notification mode is not particularly limited as long as it can be notified to the operator.
  • the display device 50 or the audio output device 60 may output predetermined notification display or notification sound.
  • step S8 determines whether or not to end the recording control process. If it is determined not to end the recording control process (step S8; No), the process proceeds to the above-described step S2, and the work is performed. to continue. When it is determined that the recording control process should be terminated due to, for example, the end of the work (step S8; Yes), the controller 30 terminates the recording control process.
  • the image data including the data at the time when it is determined that there is a difference is prohibited from being overwritten. is transferred to protected area 352 .
  • event recording can be performed even more preferably when there is a possibility that a situation or phenomenon different from the normal state has occurred.
  • recording of image data in the loop recording area 351 is stopped when it is determined that there is a predetermined difference between the operation information and the state information. As a result, overwrite recording of image data in the loop recording area 351 can be prevented.
  • the state information of the excavator 100 is acquired based on the image data acquired by the imaging device 40 .
  • the state information can be obtained using the image data to be recorded, so that the state information can be obtained with a simple configuration without requiring a dedicated device for obtaining the state information.
  • recording of image data in the storage unit 35 is controlled when it is determined that there is a predetermined difference between the operation information and the state information.
  • log information indicating that a predetermined difference has been detected may be recorded in the storage unit 35 in association with the image data.
  • the log information includes, for example, at least one of date and time, location (worksite), operator identification information, excavator identification information, surrounding environment (for example, weather), work content, operation information, status information, and the like.
  • this log information may be transmitted to the management device 200 or the support device 300 to be recorded.
  • the imaging device 40 is mounted on the excavator 100, but the imaging device 40 does not have to be mounted on the excavator 100.
  • the imaging device 40 may be installed at a high place or mounted on an unmanned aerial vehicle such as a drone. may have been Then, the acquired data may be transmitted to the excavator 100 , or the data may be transmitted to the management device 200 or the support device 300 to execute detection processing, and the result thereof may be transmitted to the excavator 100 .
  • the information processing device according to the present invention may not be mounted on a vehicle such as an excavator, or may be configured as a system including the vehicle and an external processing device.
  • the working machine according to the present invention may be a working machine other than a shovel, such as a wheel loader, an asphalt finisher, a forklift, or a crane.
  • a working machine other than a shovel such as a wheel loader, an asphalt finisher, a forklift, or a crane.
  • Other details shown in the embodiments can be changed as appropriate without departing from the scope of the invention.
  • the present invention is useful for suitably recording events on work machines.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mining & Mineral Resources (AREA)
  • Civil Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Component Parts Of Construction Machinery (AREA)
PCT/JP2022/017186 2021-04-23 2022-04-06 情報処理装置、情報処理装置の制御プログラム Ceased WO2022224827A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2023516433A JPWO2022224827A1 (https=) 2021-04-23 2022-04-06
DE112022002406.2T DE112022002406T5 (de) 2021-04-23 2022-04-06 Informationsverarbeitungsvorrichtung und steuerprogramm von informationsverarbeitungsvorrichtung
CN202280030196.1A CN117203957A (zh) 2021-04-23 2022-04-06 信息处理装置、信息处理装置的控制程序
US18/490,853 US20240044113A1 (en) 2021-04-23 2023-10-20 Information processing device and non-transitory computer readable medium storing control program of information processing device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021-073151 2021-04-23
JP2021073151 2021-04-23

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/490,853 Continuation US20240044113A1 (en) 2021-04-23 2023-10-20 Information processing device and non-transitory computer readable medium storing control program of information processing device

Publications (1)

Publication Number Publication Date
WO2022224827A1 true WO2022224827A1 (ja) 2022-10-27

Family

ID=83722308

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/017186 Ceased WO2022224827A1 (ja) 2021-04-23 2022-04-06 情報処理装置、情報処理装置の制御プログラム

Country Status (5)

Country Link
US (1) US20240044113A1 (https=)
JP (1) JPWO2022224827A1 (https=)
CN (1) CN117203957A (https=)
DE (1) DE112022002406T5 (https=)
WO (1) WO2022224827A1 (https=)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020095945A1 (ja) * 2018-11-08 2020-05-14 住友建機株式会社 ショベル、情報処理装置、情報処理方法、情報処理プログラム、端末装置、表示方法、表示プログラム
WO2021025123A1 (ja) * 2019-08-08 2021-02-11 住友建機株式会社 ショベル、情報処理装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105152012B (zh) * 2014-10-24 2017-05-03 徐州重型机械有限公司 起重机工况自动识别方法和系统
JP2020057034A (ja) 2018-09-28 2020-04-09 株式会社Ｊｖｃケンウッド 車両用記録制御装置、車両用記録装置、車両用記録制御方法およびプログラム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020095945A1 (ja) * 2018-11-08 2020-05-14 住友建機株式会社 ショベル、情報処理装置、情報処理方法、情報処理プログラム、端末装置、表示方法、表示プログラム
WO2021025123A1 (ja) * 2019-08-08 2021-02-11 住友建機株式会社 ショベル、情報処理装置

Also Published As

Publication number Publication date
CN117203957A (zh) 2023-12-08
US20240044113A1 (en) 2024-02-08
JPWO2022224827A1 (https=) 2022-10-27
DE112022002406T5 (de) 2024-03-28

Similar Documents

Publication Publication Date Title
CN112955610A (zh) 挖土机、信息处理装置、信息处理方法、信息处理程序、终端装置、显示方法、显示程序
JP7387718B2 (ja) 建設機械、支援システム
WO2020080538A1 (ja) ショベル
JP2020145526A (ja) 作業機械用情報処理装置、情報管理システム、作業機械用情報処理プログラム
JP7349947B2 (ja) 情報処理装置、作業機械、情報処理方法、情報処理プログラム
JP2019179431A (ja) 建設機械、建設機械の支援システム
WO2021166566A1 (ja) 作業機械及び作業機械の遠隔操作システム
WO2022224827A1 (ja) 情報処理装置、情報処理装置の制御プログラム
JP7580184B2 (ja) 作業機械、情報管理システム、プログラム
US11987960B2 (en) Work machine, information management system, information terminal, and program
JP7443978B2 (ja) 作業支援装置
JP7349956B2 (ja) 施工方法及び施工システム
US12565756B2 (en) Work machine and information processing device
JP7843633B2 (ja) 情報処理装置、情報処理システム及び情報処理プログラム
JP7080686B2 (ja) 建設機械の支援装置、支援方法、支援プログラム
US20240242370A1 (en) Work machine management system and work machine
JP7720727B2 (ja) 情報処理装置、情報処理装置の制御プログラム
EP4400659B1 (en) Work machine and remote operation support device
JP7704597B2 (ja) 情報処理装置、情報処理装置の制御プログラム
JP2024116653A (ja) 周辺監視装置、周辺監視装置の制御方法及び周辺監視装置の制御プログラム
JP2024117204A (ja) 作業機械、情報処理装置、作業機械の制御方法及び作業機械の制御プログラム
WO2025047812A1 (ja) 積込機械の制御システム、積込機械の制御方法および積込機械の遠隔操作システム
WO2025204233A1 (ja) 施工システム
WO2025047789A1 (ja) 積込機械の制御システム、積込機械の制御方法および積込機械の遠隔操作システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22791601

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023516433

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 202280030196.1

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 112022002406

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22791601

Country of ref document: EP

Kind code of ref document: A1