CN113767427A - 基于强化学习的信号控制装置及信号控制方法 - Google Patents

基于强化学习的信号控制装置及信号控制方法 Download PDF

Info

Publication number
CN113767427A
CN113767427A CN202180001819.8A CN202180001819A CN113767427A CN 113767427 A CN113767427 A CN 113767427A CN 202180001819 A CN202180001819 A CN 202180001819A CN 113767427 A CN113767427 A CN 113767427A
Authority
CN
China
Prior art keywords
crossroad
signal
reinforcement learning
learning model
traffic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180001819.8A
Other languages
English (en)
Chinese (zh)
Inventor
李锡中
崔兑旭
金大承
李喜斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lelu Co.,Ltd.
Original Assignee
LAONPEOPLE Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LAONPEOPLE Inc filed Critical LAONPEOPLE Inc
Priority claimed from PCT/KR2021/003938 external-priority patent/WO2021201569A1/ko
Publication of CN113767427A publication Critical patent/CN113767427A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/07—Controlling traffic signals
    • G08G1/08—Controlling traffic signals according to detected number or speed of vehicles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/056—Detecting movement of traffic to be counted or controlled with provision for distinguishing direction of travel
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/07—Controlling traffic signals
    • G08G1/081—Plural intersections under common control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Medical Informatics (AREA)
  • Traffic Control Systems (AREA)
CN202180001819.8A 2020-03-30 2021-03-30 基于强化学习的信号控制装置及信号控制方法 Pending CN113767427A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR20200038586 2020-03-30
KR10-2020-0038586 2020-03-30
PCT/KR2021/003938 WO2021201569A1 (ko) 2020-03-30 2021-03-30 강화학습 기반 신호 제어 장치 및 신호 제어 방법

Publications (1)

Publication Number Publication Date
CN113767427A true CN113767427A (zh) 2021-12-07

Family

ID=78610004

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180001819.8A Pending CN113767427A (zh) 2020-03-30 2021-03-30 基于强化学习的信号控制装置及信号控制方法

Country Status (2)

Country Link
KR (1) KR102493930B1 (ko)
CN (1) CN113767427A (ko)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20230120560A (ko) 2022-02-09 2023-08-17 주식회사 케이티 교통 흐름을 개선하기 위해 교차로의 신호를 제어하는 서버, 방법 및 컴퓨터 프로그램
KR102573526B1 (ko) * 2022-07-08 2023-09-06 주식회사 노타 강화학습 모델을 이용하여 연동 그룹 내 신호기의 교통신호를 제어하는 장치 및 방법
KR102526583B1 (ko) 2022-11-22 2023-04-27 주식회사 에이엔비 딥러닝 기반 교차로 객체검지 및 자동 알람 시스템
KR102590525B1 (ko) * 2023-04-06 2023-10-19 주식회사 노타 교차로의 현시와 관련된 제어신호를 생성하는 방법 및 장치
KR102645077B1 (ko) 2023-08-24 2024-03-08 (주)소프트윙스 딥러닝 기반 교차로 객체검지 및 자동 알람 방법

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100876094B1 (ko) * 2008-06-03 2008-12-26 김영길 교통 정체 해소를 위한 교통신호 제어 시스템의 제어 방법
KR101821494B1 (ko) * 2016-08-10 2018-01-24 중앙대학교 산학협력단 감응식 교통 신호 제어 방법 및 그 장치
KR102021992B1 (ko) * 2018-08-21 2019-09-18 한국과학기술정보연구원 교통신호 제어 장치, 교통신호 제어 방법 및 교통신호 제어 프로그램을 저장하는 저장매체
CN110428615A (zh) * 2019-07-12 2019-11-08 中国科学院自动化研究所 基于深度强化学习单路口交通信号控制方法、系统、装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101837256B1 (ko) * 2015-12-21 2018-03-12 동국대학교 산학협력단 능동형 교통 신호 제어 방법 및 그 시스템
JP2019079199A (ja) 2017-10-23 2019-05-23 株式会社豊田中央研究所 信号機切替制御装置、信号機切替制御方法及び信号機切替制御プログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100876094B1 (ko) * 2008-06-03 2008-12-26 김영길 교통 정체 해소를 위한 교통신호 제어 시스템의 제어 방법
KR101821494B1 (ko) * 2016-08-10 2018-01-24 중앙대학교 산학협력단 감응식 교통 신호 제어 방법 및 그 장치
KR102021992B1 (ko) * 2018-08-21 2019-09-18 한국과학기술정보연구원 교통신호 제어 장치, 교통신호 제어 방법 및 교통신호 제어 프로그램을 저장하는 저장매체
CN110428615A (zh) * 2019-07-12 2019-11-08 中国科学院自动化研究所 基于深度强化学习单路口交通信号控制方法、系统、装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
魏华等: "Colight:Learning Network-level Cooperation for Traffic Signal Control", 《第28届信息提取，知识管理和数据库年会》 *

Also Published As

Publication number Publication date
KR20210122181A (ko) 2021-10-08
KR102493930B1 (ko) 2023-01-31

Similar Documents

Publication Publication Date Title
CN113287156B (zh) 基于强化学习的信号控制装置及信号控制方法
CN113767427A (zh) 基于强化学习的信号控制装置及信号控制方法
CN110914641B (zh) 自主导航的导航信息的融合构架和分批对齐
US11093801B2 (en) Object detection device and object detection method
CN110001658B (zh) 用于车辆的路径预测
CN110136222B (zh) 虚拟车道线生成方法、装置及系统
WO2019174397A1 (zh) 自动驾驶安全评估方法、装置和系统
WO2021008605A1 (zh) 一种确定车速的方法和装置
Kim et al. Advisable learning for self-driving vehicles by internalizing observation-to-action rules
KR20190016717A (ko) 차선 검출 방법 및 장치
JP7278484B2 (ja) 車両交通のアテンションベースの制御
JP6820668B2 (ja) 運転支援装置、運転支援システムおよび運転支援プログラム
US20210295058A1 (en) Apparatus, method, and computer program for identifying state of object, and controller
JP2018189457A (ja) 情報処理装置
CN110733507A (zh) 车道变换及道路隔离方法、装置、设备及存储介质
JP7119839B2 (ja) 物体検出装置、物体検出方法及び車両制御装置
CN103605960A (zh) 一种基于不同焦距视频图像融合的交通状态识别方法
CN111077893B (zh) 一种基于多灭点的导航方法、电子设备和存储介质
US20220004685A1 (en) Systems and methods for creating infrastructure models
Glassner et al. Closing the gap towards end-to-end autonomous vehicle system
KR102371995B1 (ko) 다수의 회전형 카메라를 이용한 차로별 통행 정보 제공 시스템 및 방법
Kim Explainable and Advisable Learning for Self-driving Vehicles
US20240217550A1 (en) Become an av test operator as a passenger
US11693421B2 (en) Enhanced remote control of autonomous vehicles
KR102629051B1 (ko) 선형계획법에 기반한 오프셋 제어 방법 및 장치

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220509

Address after: Gyeonggi Do, South Korea

Applicant after: Lelu Co.,Ltd.

Address before: Gyeonggi Do, South Korea

Applicant before: LAONPEOPLE Inc.

WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20211207