Comment on: The inference speed is very slow

You can add the `--optimize` flag in current PyTorch version to boost inference speed. Our test results on H800 (voice clone mode, `generate_stream` interface, default inference setting): RTF is roughly 0.6 for Base/Soar and 0.4 for MF. For further speedup, you may cache the reference audio.