Hugging Face Model Deployer

Deploys models from Hugging Face Hub to Inference Endpoints using the huggingface_hub client and REST API. Monitors endpoint health and autoscaling status and streams logs to the terminal. Supports private repos with HF_TOKEN and custom Docker containers.

Installation

Use the upstream install or setup path that matches your environment:

• uv venv .my-env
• pip install "transformers[torch]"
• uv pip install "transformers[torch]"
• git clone https://github.com/huggingface/transformers.git

Requirements and caveats from upstream:

• Transformers works with Python 3.10+, and PyTorch 2.4+.
• Create and activate a virtual environment with venv or uv, a fast Rust-based Python package and project manager.
• python -m venv .my-env

Basic usage or getting-started notes:

• We pledge to help support new state-of-the-art models and democratize their usage by having their model definition be

• py

• venv

• Source: https://github.com/huggingface/transformers

• Extracted from upstream docs: https://raw.githubusercontent.com/huggingface/transformers/HEAD/README.md

Source

• Agent Skill Exchange