According to https://docs.python.org/3/library/os.html#os.rename, `os.rename` has os-specific behavior, and will fail in case you attempt to rename to an existing file on windows. So using `os.replace` instead, which should be os-agnostic. NOTE: Fact that temp test directory is not cleared after tests are sucessfully ran does not sound great...