User preference-based intelligent road route recommendation using SARSA and dynamic programming

作     者：Roopa Ravish Shanta Rangaswamy Arpitha V Vasuprada U 

作者机构：PES UniversityBengaluruIndia Rashtreeya Vidyalaya College of EngineeringBengaluruIndia 

出 版 物：《Journal of Control and Decision》 (控制与决策学报（英文）)

年 卷 期：2023年第10卷第3期

页      面：443-453页

核心收录：

学科分类：0809[工学-电子科学与技术（可授工学、理学学位）] 08[工学] 

主　　题：Intelligent transport system machine learning techniques in ITS SARSA algorithm dynamic programming route guidance system travel time prediction traveller information system 

摘      要：Traffic congestion is one of the main challenges in transportation engineering. It directly impactsthe economy by increasing travel time and affecting the environment by excessive fuel consumptionand emission. Road route recommendation to overcome the congestion by alternativeroute suggestions has gained high importance. The existing route recommendation systems areproposed using the reinforcement learning algorithm (Q-learning). The techniques suggestedin this paper are state-action-reward-state-action (SARSA) algorithm and dynamic programming(DP) to guide the commuters to reach the destination with an optimal solution. The algorithmconsiders travel time, cost, flexibility, and traffic intensity as the user preference attributes torecommend an optimal route. The recommended system is implemented by building a roadnetwork graph. We assign values to each user preference attribute along the edges, which cantake high(1) or low(0) values. By considering these values, the system recommends the *** proposed system performance is evaluated based on computation time, cumulative reward,and accuracy. The results show that DP outperforms the SARSA algorithm.