WikiofAuto
100% FREE METHODRuntime: Cloudflare Durable Object WebSocket Relay + llama-serverQuant: Q4_K_M / Q6_K (Remote GPU)

Free Cloud-to-Local Reverse Tunnel Relay — Turn Free Colab/Kaggle GPUs into a Local OpenAI Endpoint

Don't have a 24GB GPU locally? Use a reverse WebSocket tunnel from free Google Colab or Kaggle GPUs to a Cloudflare Worker so your local n8n and agents call a permanent https://*/v1 endpoint for $0/month.

HARDWARE TARGET
0GB Local VRAM Required (Offloads to Free Colab T4 / Kaggle 2×T4)
MIN VRAM
0 GB
THROUGHPUT
~40–75 tok/s
CATEGORY
free-tunnel

The Zero-Hardware Local AI Architecture

Not every builder has a 24GB RTX 4090 on their desk. By combining a local orchestrator (n8n, Agent Zero, or LangGraph running on a laptop or cheap VPS) with free cloud GPU runtimes (Google Colab T4 or Kaggle Dual-T4), you get 15GB–30GB of VRAM for $0.00.

Why Outbound WebSocket Relays Beat Standard Tunnels

Standard trycloudflare.com quick tunnels frequently trigger Cloudflare 1016 / 1033 edge blocks when called from another Cloudflare Worker or automated webhook.

  • Method 1 (Direct Quick Tunnel): Run cloudflared tunnel --url http://127.0.0.1:8080 inside Colab/Kaggle and paste the generated https://*.trycloudflare.com/v1 URL directly into your local n8n instance.
  • Method 2 (Durable Object Reverse WebSocket Relay): The Colab/Kaggle runtime dials outbound via standard HTTPS WebSocket to /connect on your Cloudflare Worker (ollama-relay). Your agents always call the exact same permanent Worker URL (/v1/chat/completions), even when the underlying Colab session restarts!

Need a Fine-Tuned Model or Colab GPU Notebook?

Pair this local inference stack with our domain-specific GGUF fine-tunes or free T4/L4 notebook servers.