This video is a project presentation for Advanced Computer Architecture ECEN 676 at Texas A&M University. A comparative analysis of traditional cache replacement policies and Reinforcement Learning policy was done and evaluated using the diverse workloads (SPEC 2017) and the metric used for the comparison is IPC and MPKI.