The theoretical Evaluation demonstrates that EDIS reveals reduced suboptimality as compared to exclusively employing on-line facts or straight reusing offline data. EDIS is usually a plug-in solution and will be coupled with existing techniques in offline-to-online RL environment. By implementing EDIS to off-the-shelf strategies Cal-QL and IQL, we