Close Menu
techwavedispatch.com

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming

    November 20, 2026

    [2611.25300] Federated Learning of Car Aerodynamics Surrogates with Spectral Optimizers

    November 20, 2026

    Deterministic Temporal Embedding for Calcium Imaging Trace Extraction

    November 20, 2026
    Facebook X (Twitter) Instagram
    Trending
    • Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming
    • [2611.25300] Federated Learning of Car Aerodynamics Surrogates with Spectral Optimizers
    • Deterministic Temporal Embedding for Calcium Imaging Trace Extraction
    • Valve says it might have to raise the price of supply-limited Steam Machines
    • Cross-Question Reliable Reinforcement Learning
    • Don’t Bring Jensen Back | WIRED
    • Bloomberg analysis of 10 million job postings shows AI-exposed roles in China fell 10 percentage points faster than others
    • [2611.26410] Statistical Inference with Ill-Conditioned Random Weight Neural Network Sieves
    Facebook X (Twitter) Instagram
    techwavedispatch.com
    Subscribe
    Friday, November 20
    • Home
    • AI Tools & Software
    • Machine Learning
    • Generative AI
    • Robotics & Automation
    • Future Tech & Hardware
    • AI in Business
    • Ethics & Regulations
    • More
      • Gadgets & Smart Devices
      • Cybersecurity & AI
      • Tech Breakthroughs
    techwavedispatch.com
    Home»AI Tools & Software»Baseten on Hugging Face Inference Providers πŸ”₯
    AI Tools & Software

    Baseten on Hugging Face Inference Providers πŸ”₯

    adminBy adminNovember 7, 2026No Comments4 Mins Read
    Facebook Twitter Pinterest LinkedIn Tumblr Email
    Baseten on Hugging Face Inference Providers πŸ”₯
    Share
    Facebook Twitter LinkedIn Pinterest Email

    banner image

    We’re thrilled to share that Baseten is now a supported Inference Provider on the Hugging Face Hub!

    Baseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub’s model pages. Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers.

    Baseten is an AI infrastructure platform that covers serverless AI, training and more. With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup.

    Baseten supports a broad spectrum of model types – from LLMs to text-to-speech and more. As part of this initial integration, Baseten is launching support for conversational and text-generation tasks on Hugging Face, enabling access to popular open-weight LLMs such as Kimi K3, latest DeepSeek V4 Flash, GLM-5.2, and many more. Support for additional tasks will roll out soon!

    See the full list of models supported by Baseten here.

    Follow Baseten on Hugging Face: https://huggingface.co/baseten.



    How it works



    In the website UI

    1. In your user account settings, you are able to:
    • Set your own API keys for the providers you’ve signed up with. If no custom key is set, your requests will be routed through HF.
    • Order providers by preference. This applies to the widget and code snippets in the model pages.

    Inference Providers

    1. As mentioned, there are two modes when calling Inference Providers:
    • Custom key (calls go directly to the inference provider, using your own API key of the corresponding inference provider)
    • Routed by HF (in that case, you don’t need a token from the provider, and the charges are applied directly to your HF account rather than the provider’s account)

    Inference Providers

    1. Model pages showcase third-party inference providers (the ones that are compatible with the current model, sorted by user preference)

    Inference Providers



    From the client SDKs

    Baseten is available through the Hugging Face SDKs – huggingface_hub (>= 1.26.1) for Python and @huggingface/inference for JavaScript.

    The following examples show how to use the latest DeepSeek V4 Flash through Baseten. Use a Hugging Face token to authenticate – the request will be routed to Baseten automatically.



    From your favorite Agent Harness

    Hugging Face Inference Providers are integrated in most Agent Harnesses – including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug baseten-hosted models straight into your favorite tools without any extra glue code. Browse the full list of integrations here.



    from Python

    import os
    from openai import OpenAI
    
    client = OpenAI(
        base_url="https://router.huggingface.co/v1",
        api_key=os.environ["HF_TOKEN"],
    )
    
    completion = client.chat.completions.create(
        model="deepseek-ai/DeepSeek-V4-Flash-0731:baseten",
        messages=[
            {
                "role": "user",
                "content": "Write a Python function that returns the nth Fibonacci number using memoization."
            }
        ],
    )
    
    print(completion.choices[0].message)
    



    from JS

    import { OpenAI } from "openai";
    
    const client = new OpenAI({
        baseURL: "https://router.huggingface.co/v1",
        apiKey: process.env.HF_TOKEN,
    });
    
    const chatCompletion = await client.chat.completions.create({
        model: "deepseek-ai/DeepSeek-V4-Flash-0731:baseten",
        messages: [
            {
                role: "user",
                content: "Write a Python function that returns the nth Fibonacci number using memoization.",
            },
        ],
    });
    
    console.log(chatCompletion.choices[0].message);
    



    Billing

    For direct requests, i.e. when you use the key from an inference provider, you are billed by the corresponding provider. For instance, if you use a baseten API key you’re billed on your baseten account.

    For routed requests, i.e. when you authenticate via the Hugging Face Hub, you’ll only pay the standard provider API rates. There’s no additional markup from us; we just pass through the provider costs directly. (In the future, we may establish revenue-sharing agreements with our provider partners.)

    Important Note ‼️ PRO users get $2 worth of Inference credits every month. You can use them across providers. πŸ”₯

    Subscribe to the Hugging Face PRO plan to get access to Inference credits, ZeroGPU, Spaces Dev Mode, 20x higher limits, and more.

    We also provide free inference with a small quota for our signed-in free users, but please upgrade to PRO if you can!



    Feedback and next steps

    We would love to get your feedback! Share your thoughts and/or comments here: https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49

    Baseten Face Hugging Inference Providers
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    admin
    • Website

    Related Posts

    Bloomberg analysis of 10 million job postings shows AI-exposed roles in China fell 10 percentage points faster than others

    November 20, 2026

    [2611.26410] Statistical Inference with Ill-Conditioned Random Weight Neural Network Sieves

    November 20, 2026

    Apple joins the race for AI agents that control your device while raising new barriers for competitors

    November 20, 2026
    Leave A Reply Cancel Reply

    Top Posts

    NVIDIA Is Investigating Reports That CEO Jensen Huang Was The Target Of Chinese Spy Efforts

    November 8, 202619 Views

    ADIndex: Layer-Adaptive Sparse Attention Indexing via Group-Level Distillation

    November 11, 20265 Views

    Anthropic releases new Mythos and Fable models amid RSI concerns

    November 9, 20265 Views

    If AGI is so close, why is everyone leaving? The neolabs and their bets

    November 6, 20265 Views
    Don't Miss
    Machine Learning

    Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming

    By adminNovember 20, 20260

    arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly…

    [2611.25300] Federated Learning of Car Aerodynamics Surrogates with Spectral Optimizers

    November 20, 2026

    Deterministic Temporal Embedding for Calcium Imaging Trace Extraction

    November 20, 2026

    Valve says it might have to raise the price of supply-limited Steam Machines

    November 20, 2026
    About Us

    Welcome to TechWave Dispatch

    At TechWave Dispatch, we bring you the latest news, insights, and developments from the ever-evolving world of technology. Our mission is to keep readers informed about the innovations shaping our digital future.

    From artificial intelligence and machine learning to cybersecurity, robotics, smart devices, and groundbreaking technologies, we cover the topics that matter in today's fast-moving tech landscape.

    Our Picks

    Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming

    November 20, 2026

    [2611.25300] Federated Learning of Car Aerodynamics Surrogates with Spectral Optimizers

    November 20, 2026

    Deterministic Temporal Embedding for Calcium Imaging Trace Extraction

    November 20, 2026
    Most Popular

    After blocking Muse, Amazon now lets users text Alexa to help them shop

    November 6, 20260 Views

    A controlled world for robot learning and evaluation

    November 6, 20260 Views

    Perplexity now has its own always-on AI agent

    November 6, 20260 Views
    Facebook X (Twitter) Instagram Pinterest
    • Terms and Conditions
    • Privacy Policy
    • Contact Us
    • About Us
    Β© 2026 TechWave Dispatch. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.