You can replace any video, without interrupting your paying customers, on the video's edit page.
Navigate to Content > Videos, then select the video you want to replace to open the video's edit page.
Scroll down to the bottom and select Replace Video. You can then select the replacement video from your file explorer.
NOTE: Replacing videos will use your purchased upload video hours since it needs to be transcoded.