In this work, we introduced and analyzed online and approximate PI methods, generalized to the κ-greedy policy, an instance of a multiple-step greedy policy. Doing so, we discovered two intriguing properties compared to the well-studied 1-step greed…