Faster-Whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, a fast inference engine for Transformer models. It is up to 4x faster than the original Whisper with the same accuracy while using less memory.

Supports NVIDIA GPU (CUDA 12 + cuDNN 9), CPU with INT8 quantization

Requirements

• Python 3.9 or higher
• Windows 10/11 (64-bit)
• NVIDIA GPU (optional, for CUDA acceleration)

🪟 Step-by-Step Installation on Windows

1️⃣ Install Python

Download the installer from the official site and check "Add Python to PATH" during installation:

https://www.python.org/downloads/

Verify:

python --version
pip --version

2️⃣ (Optional) Create a Virtual Environment

python -m venv whisper-env
whisper-env\Scripts\activate

3️⃣ Install Faster-Whisper

pip install faster-whisper

4️⃣ (Optional) GPU Acceleration — NVIDIA CUDA

If you have an NVIDIA GPU:

pip install nvidia-cublas-cu12 nvidia-cudnn-cu12==9.*

Configure the PATH:

set LD_LIBRARY_PATH=C:\Path\To\cublas;C:\Path\To\cudnn

Alternative: Download the libraries from Purfview/whisper-standalone-win repository (link on GitHub) and extract them to a folder included in your system PATH.

5️⃣ Test the Installation

Create a file named test_whisper.py:

from faster_whisper import WhisperModel

model = WhisperModel("tiny", device="cpu", compute_type="int8")
segments, info = model.transcribe("audio.mp3", beam_size=5)

print("Detected language:", info.language, "(probability:", info.language_probability, ")")
for segment in segments:
    print(f"[{segment.start:.2f}s -> {segment.end:.2f}s] {segment.text}")

Run it:

python test_whisper.py

🧠 Available Models

Windows Tips

• No GPU? Use device="cpu" with compute_type="int8" — works great for small models and below
• With NVIDIA GPU? Use device="cuda" with compute_type="float16" — up to 4x faster
• DLL error? Install the latest Microsoft Visual C++ Redistributable
• Long audio? Enable VAD filter: vad_filter=True (automatically removes silence)
• Batch transcription: Use BatchedInferencePipeline for faster processing of long audio files

References

• Official repo: https://github.com/SYSTRAN/faster-whisper
• CTranslate2 docs: https://github.com/OpenNMT/CTranslate2/
• Whisper models: https://github.com/openai/whisper

Posted by SupportDev — Questions? Ask right here!