KR102771806B1 - 표시장치, 쇼벨, 정보처리장치 - Google Patents

표시장치, 쇼벨, 정보처리장치 Download PDF

Info

Publication number
KR102771806B1
KR102771806B1 KR1020217035719A KR20217035719A KR102771806B1 KR 102771806 B1 KR102771806 B1 KR 102771806B1 KR 1020217035719 A KR1020217035719 A KR 1020217035719A KR 20217035719 A KR20217035719 A KR 20217035719A KR 102771806 B1 KR102771806 B1 KR 102771806B1
Authority
KR
South Korea
Prior art keywords
shovel
image
surveillance
detection unit
detected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020217035719A
Other languages
English (en)
Korean (ko)
Other versions
KR20220002343A (ko
Inventor
타케야 이즈미카와
타카아키 모리모토
아츠시 나카야마
케이이치 츠지
유스케 사토
타카시 우메다
Original Assignee
스미토모 겐키 가부시키가이샤
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 스미토모 겐키 가부시키가이샤 filed Critical 스미토모 겐키 가부시키가이샤
Publication of KR20220002343A publication Critical patent/KR20220002343A/ko
Application granted granted Critical
Publication of KR102771806B1 publication Critical patent/KR102771806B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F3/00—Dredgers; Soil-shifting machines
    • E02F3/04—Dredgers; Soil-shifting machines mechanically-driven
    • E02F3/28—Dredgers; Soil-shifting machines mechanically-driven with digging tools mounted on a dipper- or bucket-arm, i.e. there is either one arm or a pair of arms, e.g. dippers, buckets
    • E02F3/36—Component parts
    • E02F3/42—Drives for dippers, buckets, dipper-arms or bucket-arms
    • E02F3/43—Control of dipper or bucket position; Control of sequence of drive operations
    • E02F3/435—Control of dipper or bucket position; Control of sequence of drive operations for dipper-arms, backhoes or the like
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/20—Drives; Control devices
    • E02F9/2025—Particular purposes of control systems not otherwise provided for
    • E02F9/205—Remotely operated machines, e.g. unmanned vehicles
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/24—Safety devices, e.g. for preventing overload
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E02F9/261—Surveying the work-site to be treated
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/60—Creating or editing images; Combining images with text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8033—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for pedestrian protection
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Mining & Mineral Resources (AREA)
  • Civil Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Component Parts Of Construction Machinery (AREA)
  • Operation Control Of Excavators (AREA)
  • Closed-Circuit Television Systems (AREA)
KR1020217035719A 2019-04-26 2020-04-23 표시장치, 쇼벨, 정보처리장치 Active KR102771806B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JPJP-P-2019-086881 2019-04-26
JP2019086881 2019-04-26
PCT/JP2020/017574 WO2020218454A1 (ja) 2019-04-26 2020-04-23 表示装置、ショベル、情報処理装置

Publications (2)

Publication Number Publication Date
KR20220002343A KR20220002343A (ko) 2022-01-06
KR102771806B1 true KR102771806B1 (ko) 2025-02-20

Family

ID=72942176

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020217035719A Active KR102771806B1 (ko) 2019-04-26 2020-04-23 표시장치, 쇼벨, 정보처리장치

Country Status (6)

Country Link
US (1) US12325980B2 (https=)
EP (1) EP3960543A4 (https=)
JP (1) JP7511547B2 (https=)
KR (1) KR102771806B1 (https=)
CN (1) CN113727883B (https=)
WO (1) WO2020218454A1 (https=)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200038937A (ko) * 2017-08-08 2020-04-14 스미도모쥬기가이고교 가부시키가이샤 쇼벨, 쇼벨의 지원장치, 및 쇼벨의 관리장치
JP7349880B2 (ja) * 2019-10-18 2023-09-25 株式会社小松製作所 作業機械の周辺監視システム、作業機械、及び作業機械の周辺監視方法
JP7291645B2 (ja) * 2020-01-31 2023-06-15 株式会社小松製作所 作業機械の誤操作を防止するためのシステム、制御方法、およびショベル
WO2021192655A1 (ja) * 2020-03-27 2021-09-30 日立建機株式会社 作業機械
KR102931360B1 (ko) * 2021-01-25 2026-02-27 주식회사 와이즈오토모티브 중장비용 전방 영상 생성 장치
US11993209B2 (en) * 2021-03-24 2024-05-28 Deere & Company Work vehicle vision system with contextual task icons
CN118284863A (zh) * 2021-11-18 2024-07-02 株式会社久保田 作业机的远程控制系统
JP2023093109A (ja) * 2021-12-22 2023-07-04 住友建機株式会社 建設機械、及び情報処理装置
EP4456527A4 (en) * 2021-12-22 2025-04-30 Sumitomo Construction Machinery Co., Ltd. INFORMATION PROCESSING SYSTEM, PROGRAM, AND INFORMATION PROCESSING METHOD
US20230266754A1 (en) * 2022-02-21 2023-08-24 Caterpillar Paving Products Inc. Work area overlay on operator display
US12601154B2 (en) * 2022-04-05 2026-04-14 Caterpillar Sarl Trench measurement system
JP2024066602A (ja) * 2022-11-02 2024-05-16 ヤンマーホールディングス株式会社 作業機械の制御方法、作業機械用制御プログラム、作業機械用制御システム及び作業機械
JP7734705B2 (ja) * 2023-03-08 2025-09-05 本田技研工業株式会社 車載機器設定装置、車載機器設定方法、およびプログラム
JP2025034169A (ja) * 2023-08-30 2025-03-13 キヤノン株式会社 撮像システムおよび移動体
KR20250125794A (ko) * 2024-02-15 2025-08-22 에이치디현대인프라코어 주식회사 센서 융합 기반 객체 감지 시스템 및 방법과 그 시스템을 포함하는 건설장비

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015210649A (ja) * 2014-04-25 2015-11-24 日立建機株式会社 車体近傍障害物報知システム
WO2016140016A1 (ja) * 2015-03-03 2016-09-09 日立建機株式会社 車両の周囲監視装置
US20170305018A1 (en) * 2015-04-28 2017-10-26 Komatsu Ltd. Surrounding monitoring device of work machine and method of monitoring surroundings of work machine
JP2018172857A (ja) * 2017-03-31 2018-11-08 日立建機株式会社 作業機械の周囲監視装置

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19947766A1 (de) * 1999-10-02 2001-05-10 Bosch Gmbh Robert Einrichtung zur Überwachung der Umgebung eines einparkenden Fahrzeugs
JP2008179940A (ja) 2005-03-31 2008-08-07 Hitachi Constr Mach Co Ltd 作業機械の周囲監視装置
JP2010112100A (ja) 2008-11-07 2010-05-20 Hitachi Constr Mach Co Ltd 作業機械の監視装置
US9332229B2 (en) 2010-06-18 2016-05-03 Hitachi Construction Machinery Co., Ltd. Surrounding area monitoring device for monitoring area around work machine
JP5269026B2 (ja) * 2010-09-29 2013-08-21 日立建機株式会社 作業機械の周囲監視装置
EP2631374B1 (en) * 2010-10-22 2020-09-30 Hitachi Construction Machinery Co., Ltd. Work machine peripheral monitoring device
CN103609101A (zh) 2011-06-16 2014-02-26 爱信精机株式会社 车辆周边监视装置
JP5495071B2 (ja) * 2011-06-16 2014-05-21 アイシン精機株式会社 車両周辺監視装置
JP5750344B2 (ja) * 2011-09-16 2015-07-22 日立建機株式会社 作業機の周囲監視装置
JP6456584B2 (ja) 2013-03-19 2019-01-23 住友重機械工業株式会社 作業機械用周辺監視装置
JP6352797B2 (ja) 2014-12-19 2018-07-04 日立建機株式会社 作業機械の周囲監視装置
JP6456173B2 (ja) * 2015-02-04 2019-01-23 日立建機株式会社 車体外部移動物体検知装置
JP2017046277A (ja) * 2015-08-28 2017-03-02 日立建機株式会社 作業機械の周囲監視装置
KR102256384B1 (ko) * 2016-11-01 2021-05-25 스미토모 겐키 가부시키가이샤 작업기계용 주변감시시스템
EP3584120B1 (en) 2017-02-17 2021-04-14 Sumitomo Heavy Industries, Ltd. Work machine surroundings monitoring system
JP6917167B2 (ja) * 2017-03-21 2021-08-11 株式会社フジタ 建設機械用俯瞰画像表示装置
JP7098909B2 (ja) 2017-11-02 2022-07-12 株式会社デンソー ペダル装置
US10829911B2 (en) * 2018-09-05 2020-11-10 Deere & Company Visual assistance and control system for a work machine
JP6823036B2 (ja) 2018-11-05 2021-01-27 株式会社小松製作所 建設機械の表示システムおよびその制御方法
US11092456B2 (en) * 2019-03-08 2021-08-17 Aptiv Technologies Limited Object location indicator system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015210649A (ja) * 2014-04-25 2015-11-24 日立建機株式会社 車体近傍障害物報知システム
WO2016140016A1 (ja) * 2015-03-03 2016-09-09 日立建機株式会社 車両の周囲監視装置
US20170305018A1 (en) * 2015-04-28 2017-10-26 Komatsu Ltd. Surrounding monitoring device of work machine and method of monitoring surroundings of work machine
JP2018172857A (ja) * 2017-03-31 2018-11-08 日立建機株式会社 作業機械の周囲監視装置

Also Published As

Publication number Publication date
CN113727883A (zh) 2021-11-30
US20220074171A1 (en) 2022-03-10
EP3960543A4 (en) 2022-07-06
WO2020218454A1 (ja) 2020-10-29
CN113727883B (zh) 2024-12-27
JPWO2020218454A1 (https=) 2020-10-29
JP7511547B2 (ja) 2024-07-05
KR20220002343A (ko) 2022-01-06
US12325980B2 (en) 2025-06-10
EP3960543A1 (en) 2022-03-02

Similar Documents

Publication Publication Date Title
KR102723550B1 (ko) 쇼벨
KR102771806B1 (ko) 표시장치, 쇼벨, 정보처리장치
KR102867162B1 (ko) 쇼벨
KR102753182B1 (ko) 쇼벨
JP7358070B2 (ja) ショベル
JP7632964B2 (ja) ショベル
US12428809B2 (en) Shovel, controller for shovel, and method of managing worksite
JP7743710B2 (ja) ショベル
JP2021120515A (ja) 作業機械、情報処理装置
WO2021149775A1 (ja) 作業機械、情報処理装置
JP7703815B2 (ja) ショベル
WO2023132321A1 (ja) 周辺監視システム、作業機械
JP7488753B2 (ja) 周辺監視装置
JP2023093109A (ja) 建設機械、及び情報処理装置

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20211102

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20240722

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20241121

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20250218

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20250218

End annual number: 3

Start annual number: 1

PG1601 Publication of registration