As part of PR 4612, it was discussed here that New-TemporaryFile should throw a terminating error (instead of a non-terminating one). Everyone was clear on the expected behaviour but the issue is that this change would be a breaking change in behaviour.