Get started free
All integrations

Groq integration

Ultra-fast AI inference platform optimized for speed and efficiency. Access leading open-source models with exceptional response times through custom LPU hardware. Features include function calling, structured outputs, streaming, text-to-speech, speech-to-text, and batch processing for building responsive AI applications requiring minimal latency.

15 toolsTokenAPI docs

Common Groq use cases

  • file management
  • batch management
  • batch monitoring
  • batch preparation
  • capability check
  • file cleanup
  • batch results
  • error recovery
  • real-time chat
  • bulk processing

What you can do with Groq

Each of these is one operation on one endpoint, available both as a workflow step and as a tool an AI agent can call on its own. Nothing bundles several operations into one action, so what a run did stays readable afterwards.

Most endpoints run on the free plan. A few, mainly the ones that publish on your behalf, need a paid plan.

File, 5 operations

  • DELETEdelete_file

    Deletes a file. Remove an uploaded file from your Groq organization.

  • GETdownload_file

    Downloads file content. Retrieve the actual content of an uploaded or batch output file.

  • GETget_file

    Gets file details. Retrieve metadata and information about a specific uploaded file.

  • GETlist_files

    Lists all uploaded files. View files available for batch processing and other operations.

  • POSTupload_file

    Uploads a file to Groq. Upload JSONL files for use with batch processing.

Batch, 4 operations

  • POSTcancel_batch

    Cancels a batch job. Stop a running batch processing job before completion.

  • POSTcreate_batch

    Creates a batch job. Process multiple API requests asynchronously from an uploaded JSONL file.

  • GETget_batch

    Gets batch job details. Check the status, progress, and results of a batch processing job.

  • GETlist_batches

    Lists all batch jobs. View all batch processing jobs and their statuses.

Audio, 3 operations

  • POSTaudio_speech

    Generates speech audio from text with Groq. Convert text to natural-sounding speech using Orpheus TTS models.

  • POSTaudio_transcriptions

    Transcribes audio to text with Groq. Convert speech to text using Whisper with ultra-fast processing speed.

  • POSTaudio_translations

    Translates audio to English text. Transcribe and translate non-English audio to English in one step.

Model, 2 operations

  • GETget_model

    Gets model details. Retrieve specific model information including capabilities and metadata.

  • GETlist_models

    Lists available Groq models. View all accessible models including Llama, GPT-OSS, Qwen, Whisper, and Orpheus.

Chat, 1 operation

  • POSTchat_completions

    Creates ultra-fast chat completions with Groq. Get AI responses with sub-second latency using LPU inference technology.

Use Groq from Claude Code, Cursor or Codex

Connect Groq in LiveContext, create an API key in Settings, then add the LiveContext MCP server to your client. Its Groq operations become tools the client can call, next to every other integration you connected.

Claude Code
claude mcp add --transport http livecontext https://livecontext.ai/mcp --header "X-API-Key: YOUR_API_KEY"
Codex (~/.codex/config.toml)
[mcp_servers.livecontext]
url = "https://livecontext.ai/mcp"

[mcp_servers.livecontext.http_headers]
"X-API-Key" = "YOUR_API_KEY"
Cursor, Claude Desktop and other JSON configs
{
  "mcpServers": {
    "livecontext": {
      "type": "http",
      "url": "https://livecontext.ai/mcp",
      "headers": {
        "X-API-Key": "YOUR_API_KEY"
      }
    }
  }
}

Set up the MCP server step by step

How to connect Groq

  1. Create your workspace

    Sign up free. Nothing to install.

  2. Connect Groq once

    Add your Groq connection in Settings. Every tool from this integration reuses it, and secrets are encrypted at rest and visible only to you.

  3. Describe the job in chat

    The workflow builds itself in front of you and picks the endpoints it needs. Drag the steps yourself on the canvas whenever you would rather be explicit.

Groq integration FAQ

What can you do with the Groq integration?
LiveContext exposes 15 operations on Groq, covering file, batch, audio and model. Common uses include file management, batch management and batch monitoring.

Popular integrations

Browse the whole catalog