Methods > Reinforcement Learning > Video Game Models

CARLA: An Open Urban Driving Simulator

Introduced by Dosovitskiy et al. in CARLA: An Open Urban Driving Simulator

CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban driving systems. In addition to open-source code and protocols, CARLA provides open digital assets (urban layouts, buildings, vehicles) that were created for this purpose and can be used freely.

Source: Dosovitskiy et al.

Image source: Dosovitskiy et al.

Source: CARLA: An Open Urban Driving Simulator

Latest Papers

PAPER DATE
Building Mental Models through Preview of Autopilot Behaviors
Yuan ShenNiviru WijayaratneKatherine Driggs-Campbell
2021-04-12
Risk-Aware Lane Selection on Highway with Dynamic Obstacles
Sangjae BaeDavid IseleKikuo FujimuraScott J. Moura
2021-04-08
A Bayesian Approach to Reinforcement Learning of Vision-Based Vehicular Control
Zahra GharaeeKarl HolmquistLinbo HeMichael Felsberg
2021-04-08
Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Driving
Briti GangopadhyayHarshit SooraPallab Dasgupta
2021-03-25
Flexible MPC-based Conflict Resolution Using Online Adaptive ADMM
Jerry AnGiulia GiordanoChangliu Liu
2021-03-25
Convex Online Video Frame Subset Selection using Multiple Criteria for Data Efficient Autonomous Driving
Soumi DasHarikrishna PatibandlaSuparna BhattacharyaKshounis BeraNiloy GangulySourangshu Bhattacharya
2021-03-24
Self-Supervised Steering Angle Prediction for Vehicle Control Using Visual Odometry
Qadeer KhanPatrick WenzelDaniel Cremers
2021-03-20
AutoPreview: A Framework for Autopilot Behavior Understanding
Yuan ShenNiviru WijayaratnePeter DuShanduojiao JiangKatherine Driggs Campbell
2021-02-25
Spatio-Temporal Look-Ahead Trajectory Prediction using Memory Neural Network
Nishanth RaoSuresh Sundaram
2021-02-24
Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction
Daniel GehrigMichelle RüeggMathias GehrigJavier Hidalgo CarrioDavide Scaramuzza
2021-02-18
Domain Adaptation In Reinforcement Learning Via Latent Unified State Representation
Jinwei XingTakashi NagataKexin ChenXinyun ZouEmre NeftciJeffrey L. Krichmar
2021-02-10
Affordance-based Reinforcement Learning for Urban Driving
Tanmay AgarwalHitesh AroraJeff Schneider
2021-01-15
Instance-Aware Predictive Navigation in Multi-Agent Environments
| Jinkun CaoXin WangTrevor DarrellFisher Yu
2021-01-14
SBEVNet: End-to-End Deep Stereo Layout Estimation
Anonymous
2021-01-01
Inverse reinforcement learning for autonomous navigation via differentiable semantic mapping and planning
Tianyu WangVikas DhimanNikolay Atanasov
2021-01-01
Reconfigurable Intelligent Surface Assisted Mobile Edge Computing with Heterogeneous Learning Tasks
Shanfeng HuangShuai WangRui WangMiaowen WenKaibin Huang
2020-12-25
Multi-Modal Depth Estimation Using Convolutional Neural Networks
Sadique Adnan SiddiquiAxel VierlingKarsten Berns
2020-12-17
CARLA Real Traffic Scenarios -- novel training ground and benchmark for autonomous driving
Błażej OsińskiPiotr MiłośAdam JakubowskiPaweł ZięcinaMichał MartyniakChristopher GaliasAntonia BreuerSilviu HomoceanuHenryk Michalewski
2020-12-16
An End-to-end Deep Reinforcement Learning Approach for the Long-term Short-term Planning on the Frenet Space
| Majid MoghadamAli AlizadehEngin TekinGabriel Hugh Elkaim
2020-11-26
Manual-Label Free 3D Detection via An Open-Source Simulator
Zhen YangChi ZhangHuiming GuoZhaoxiang Zhang
2020-11-16
Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning
| Kaleb Ben NaveedZhiqian QiaoJohn M. Dolan
2020-11-09
Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections
| Junha RohChristoforos MavrogiannisRishabh MadanDieter FoxSiddhartha S. Srinivasa
2020-11-08
PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Driving
Henry PulverFrancisco EirasLudovico CarozzaMajd HawaslyStefano AlbrechtSubramanian Ramamoorthy
2020-11-01
A Software Architecture for Autonomous Vehicles: Team LRM-B Entry in the First CARLA Autonomous Driving Challenge
Luis Alberto RoseroIago Pacheco GomesJúnior Anderson Rodrigues da SilvaTiago Cesar dos SantosAngelica Tiemi Mizuno NakamuraJean AmaroDenis Fernando WolfFernando Santos Osório
2020-10-23
Finding Physical Adversarial Examples for Autonomous Driving with Fast and Differentiable Image Compositing
| Jinghan YangAdith BoloorAyan ChakrabartiXuan ZhangYevgeniy Vorobeychik
2020-10-17
Learning Monocular Dense Depth from Events
| Javier Hidalgo-CarrióDaniel GehrigDavide Scaramuzza
2020-10-16
Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video with Applications for Virtual Reality
| Alisha SharmaRyan NettJonathan Ventura
2020-10-14
LM-Reloc: Levenberg-Marquardt Based Direct Visual Relocalization
Lukas von StumbergPatrick WenzelNan YangDaniel Cremers
2020-10-13
Driving Through Ghosts: Behavioral Cloning with False Positives
Andreas BühlerAdrien GaidonAndrei CramariucRares AmbrusGuy RosmanWolfram Burgard
2020-08-29
Domain Adaptation Through Task Distillation
| Brady ZhouNimit KalraPhilipp Krähenbühl
2020-08-27
Reinforced Wasserstein Training for Severity-Aware Semantic Segmentation in Autonomous Driving
Xiaofeng LiuYimeng ZhangXiongchang LiuSong BaiSite LiJane You
2020-08-11
Physical Adversarial Attack on Vehicle Detector in the Carla Simulator
Tong WuXuefei NingWenshuo LiRanran HuangHuazhong YangYu Wang
2020-07-31
Directional Primitives for Uncertainty-Aware Motion Estimation in Urban Environments
Ransalu SenanayakeManeekwan ToyungyernsubMingyu WangMykel J. KochenderferMac Schwager
2020-07-01
Generalization of Agent Behavior through Explicit Representation of Context
Cem C. TutumSuhaib AbdulquddosRisto Miikkulainen
2020-06-18
ShieldNN: A Provably Safe NN Filter for Unsafe NN Controllers
James FerlezMahmoud ElnaggarYasser ShoukryCody Fleming
2020-06-16
Learning Navigation Costs from Demonstration with Semantic Observations
Tianyu WangVikas DhimanNikolay Atanasov
2020-06-09
Fast Synthetic LiDAR Rendering via Spherical UV Unwrapping of Equirectangular Z-Buffer Images
Mohammed HossnyKhaled SalehMohammed AttiaAhmed AbobakrJulie Iskander
2020-06-08
Explaining Autonomous Driving by Learning End-to-End Visual Attention
Luca CultreraLorenzo SeidenariFederico BecattiniPietro PalaAlberto del Bimbo
2020-06-05
Learning Situational Driving
Eshed Ohn-Bar Aditya Prakash Aseem Behl Kashyap Chitta Andreas Geiger
2020-06-01
Exploring Data Aggregation in Policy Learning for Vision-Based Urban Autonomous Driving
| Aditya Prakash Aseem Behl Eshed Ohn-Bar Kashyap Chitta Andreas Geiger
2020-06-01
Severity-Aware Semantic Segmentation With Reinforced Wasserstein Training
Xiaofeng Liu Wenxuan Ji Jane You Georges El Fakhri Jonghye Woo
2020-06-01
Fast Risk Assessment for Autonomous Vehicles Using Learned Models of Agent Futures
| Allen WangXin HuangAshkan JasourBrian Williams
2020-05-27
Learning hierarchical behavior and motion planning for autonomous driving
Jingke WangYue WangDongkun ZhangYezhou YangRong Xiong
2020-05-08
ParkPredict: Motion and Intent Prediction of Vehicles in Parking Lots
Xu ShenIvo BatkovicVijay GovindarajanPaolo FalconeTrevor DarrellFrancesco Borrelli
2020-04-21
Towards Safer Self-Driving Through Great PAIN (Physically Adversarial Intelligent Networks)
Piyush GuptaDemetris ColemanJoshua E. Siegel
2020-03-24
A machine learning environment for evaluating autonomous driving software
Jussi HanhirovaAnton DebnerMatias HyyppäVesa Hirvisalo
2020-03-07
Integrating Deep Reinforcement Learning with Model-based Path Planners for Automated Driving
| Ekim YurtseverLinda CapitoKeith RedmillUmit Ozguner
2020-02-02
Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning
| Jianyu ChenShengbo Eben LiMasayoshi Tomizuka
2020-01-23
Learning by Cheating
| Dian ChenBrady ZhouVladlen KoltunPhilipp Krähenbühl
2019-12-27
SAM: Squeeze-and-Mimic Networks for Conditional Visual Driving Policy Learning
| Albert ZhaoTong HeYitao LiangHaibin HuangGuy Van Den BroeckStefano Soatto
2019-12-06
End-to-End Model-Free Reinforcement Learning for Urban Driving using Implicit Affordances
| Marin ToromanoffEmilie WirbelFabien Moutarde
2019-11-25
Unsupervised Neural Sensor Models for Synthetic LiDAR Data Augmentation
Ahmad El SallabIbrahim SobhMohamed ZahranMohamed Shawky
2019-11-24
Multi Modal Semantic Segmentation using Synthetic Data
Kartik SrivastavaAkash Kumar SinghGuruprasad M. Hegde
2019-10-30
Conditional Driving from Natural Language Instructions
Junha RohChris PaxtonAndrzej PronobisAli FarhadiDieter Fox
2019-10-16
Geometry-Aware Video Object Detection for Static Cameras
Dan XuWeidi XieAndrew Zisserman
2019-09-06
Conditional Vehicle Trajectories Prediction in CARLA Urban Environment
Thibault BuhetEmilie WirbelXavier Perrotton
2019-09-02
Robust Guarantees for Perception-Based Control
Sarah DeanNikolai MatniBenjamin RechtVickie Ye
2019-07-08
Multimodal End-to-End Autonomous Driving
Yi XiaoFelipe CodevillaAkhil GurramOnay UrfaliogluAntonio M. López
2019-06-07
Multimodal 3D Object Detection from Simulated Pretraining
| Åsmund BrekkeFredrik VatsendvikFrank Lindseth
2019-05-19
Talk Proposal: Towards the Realistic Evaluation of Evasion Attacks using CARLA
| Cory CorneliusShang-Tse ChenJason MartinDuen Horng Chau
2019-04-18
Visual-based Autonomous Driving Deployment from a Stochastic and Uncertainty-aware Perspective
| Lei TaiPeng YunYuying ChenCongcong LiuHaoyang YeMing Liu
2019-03-03
Exploring applications of deep reinforcement learning for real-world autonomous driving systems
Victor TalpaertIbrahim SobhB Ravi KiranPatrick MannionSenthil YogamaniAhmad El-SallabPatrick Perez
2019-01-06
SADA: Semantic Adversarial Diagnostic Attacks for Autonomous Applications
| Abdullah HamdiMatthias MüllerBernard Ghanem
2018-12-05
TrolleyMod v1.0: An Open-Source Simulation and Data-Collection Platform for Ethical Decision Making in Autonomous Vehicles
| Vahid BehzadanJames MintonArslan Munir
2018-11-14
Real-time Dynamic Object Detection for Autonomous Driving using Prior 3D-Maps
B Ravi KiranLuis RoldãoBenat IrastorzaRenzo VerasteguiSebastian SussSenthil YogamaniVictor TalpaertAlexandre LepoutreGuillaume Trehard
2018-09-28
Learning End-to-end Autonomous Driving using Guided Auxiliary Supervision
| Ashish MehtaAdithya SubramanianAnbumani Subramanian
2018-08-30
Conditional Affordance Learning for Driving in Urban Environments
| Axel SauerNikolay SavinovAndreas Geiger
2018-06-18
Semantic Road Layout Understanding by Generative Adversarial Inpainting
Lorenzo BerlincioniFederico BecattiniLeonardo GalteriLorenzo SeidenariAlberto del Bimbo
2018-05-29
CARLA: An Open Urban Driving Simulator
| Alexey DosovitskiyGerman RosFelipe CodevillaAntonio LopezVladlen Koltun
2017-11-10

Tasks

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories