Doodle Cast Creator

AI scoreboard — three models, six categories

Three leading AI models were given full architectural context — codebase stats, feature set, pipeline details, and market positioning — and asked to score Doodle Cast Creator across six categories from 1 to 10 with a short comment per score. Select a model below to see its scoreboard.

AI video tools generate clips. We produce episodes.

Tools like Veo, Kling, Higgsfield, and Firefly are remarkable at generating individual video clips. But producing a complete YouTube episode — with narrative structure, multi-character dialogue, consistent visuals, sound design, and music — still takes dozens of hours of manual stitching, editing, and rendering. Doodle Cast Creator eliminates that gap entirely.

From idea to YouTube in 10 steps

Every step of the episode production pipeline — from brainstorming to final publish — is handled by a unified interface with AI assistance at every stage. A parallel Shorts pipeline adds 7 more steps for vertical content.

Step 01

Creative Director

Three AI personas independently brainstorm episode concepts, then debate their merits. A judge AI (Grok 4) evaluates each pitch with live web search for topical relevance and selects a winner — or you bring your own idea and let the panel validate it. v1.2 adds a Research & Debate mode where Grok 4 conducts deep web research to build fact-heavy, current scripts.

Llama 3.1 Gemma 12B Qwen 8B Grok 4 Web Search Multi-AI Debate

Step 02

Script Writer

Choose your LLM — Llama, Gemma, Qwen, Gemini, or Claude — and generate a full episode script with structured clips, character dialogue, scene descriptions, and image prompts. The writer is trained on the show bible: a living knowledge base that evolves with every episode, ensuring character consistency and avoiding repeated plotlines.

5 LLM Options Show Bible Clip Templates 30+ Clips Per Episode

Step 03

Voice Readout

Every character speaks in a distinct synthesized voice. The narrator delivers a documentary cadence; Rusty speaks with deep, measured authority; Oreo is excitable and fast. Play through the full episode readout to check pacing, dialogue flow, and story structure before committing to visual production.

ElevenLabs Per-Character Voices Full Episode Playback

Step 04

Location Mapping

AI extracts every location from the script and maps them to clips. Build a reusable location library with reference images, visual descriptions, and default prompts. Locations carry their visual identity across episodes — the studio always looks like the studio.

Auto-Extraction Reference Images Persistent Library

Step 05

Scene Generation

Generate photorealistic images for each clip, informed by character reference sheets, location images, scene references, and scene descriptions. Every generation considers the visual context — character appearance, location lighting, camera angle — to maintain consistency across 30+ scenes. Start and end images for each clip enable smooth I2V video generation. Full image history with undo, AI-assisted editing, and Google Flow mode for iPad/PC-sourced photos.

Z-Turbo Gemini ComfyUI Start/End Images Google Flow Scene References Image History

Step 06

Video Generation

Transform scene images into motion using cloud models like Google Veo or local open-source models (WAN 2.2, LTX 2.3) on an RTX 5090. The DaVinci Resolve-style timeline shows every clip with start/end frames, status badges, and a composite episode preview player that sequences all completed clips in real time.

WAN 2.2 I2V LTX 2.3 Gemini Veo RTX 5090 Episode Preview

Step 07

Trim Editor

Fine-tune every clip with frame-accurate trim points. Set in/out markers, adjust clip durations, and preview the result instantly. The trimmed timeline carries forward to the audio mix and final render.

Frame-Accurate In/Out Markers Real-Time Preview

Step 08

Audio Mix

A full multi-track audio editor with four lanes: background video audio, voice dialogue, sound effects, and music. Each track has independent volume control with keyframe automation. Generate SFX and music from text descriptions, position them on the timeline, and fine-tune the mix — all inside the browser.

4-Track Mix Keyframe Automation AI Sound Effects AI Music ElevenLabs

Step 09

Render Engine

One button, full episode render. The engine trims each clip, applies the complete audio mix with ffmpeg filter graphs, concatenates everything (including the outro), and encodes the final MP4. When the RTX 5090 is online, encoding runs on NVENC for speed; otherwise, VPS CPU fallback handles it. Output goes straight to Google Drive.

ffmpeg Compositing NVENC / H.264 Google Drive Upload HLS Streaming

Step 10

Publish to YouTube

Generate multiple AI thumbnails for A/B testing, write metadata with Claude, set tags and categories, then publish directly to YouTube — with real-time upload progress. The show bible automatically evolves after each published episode, learning what works for future content.

YouTube API AI Thumbnails A/B Testing Claude Metadata Show Bible Evolution

Everything a studio needs, built in

Beyond the 10-step pipeline, the Creator includes a full suite of persistent production tools that carry knowledge across episodes.

Characters

Character Manager

Define characters with role, personality, visual description, and speech style. Upload reference images for consistent AI generation. Assign ElevenLabs voice profiles with preview playback. Characters persist across all episodes and inform every AI generation.

Episodes

Episode Library

A complete production dashboard showing every episode across all stages of development — from draft ideas to published videos. Filter by status, search by title, and jump directly into any production step.

Gallery

Media Library

Centralized asset management for every image and video across all episodes. Browse by model, date, or episode. Drag-and-drop upload, crop, rotate, and adjust — all with full undo support.

YouTube Shorts Production Pipeline

A complete parallel pipeline for producing batches of vertical short-form content. Generate 8 shorts at once from a single theme, each with unique characters, dialogue, AI-generated images and video, voice synthesis, and music — then publish across five platforms with scheduled auto-publishing.

Shorts — Step 1

Idea Lab

Generate up to 8 short ideas at once from the show’s character pool. Choose the AI model (Gemini Flash, Llama, Gemma, Qwen, or Claude), assign characters per clip or let the AI decide, and feed in a YouTube research report for topical relevance. Each idea gets a title, hook, concept, and character assignment — all in one batch generation.

Configurable LLM Batch Generation Research Report Character Pool

Shorts — Step 2

Script Writer

Generate scripts for all clips in batch. Each script includes a scene description (for the still image), character description, video action prompt (for I2V animation), and 8–12 word dialogue. Rules enforce no new objects mid-scene and no scene changes — keeping each short visually coherent for image-to-video generation.

Scene + Video Prompts 8–12 Word Dialogue Voice Rules Batch Processing

Shorts — Step 3

Start Images

Generate the starting frame for each short using AI image models. Choose between Gemini, Z-Turbo, SDXL, or Qwen — each producing photorealistic 9:16 vertical images informed by character reference sheets and scene descriptions. Full image history with undo and per-clip regeneration.

Gemini Image Z-Turbo 9:16 Vertical Image History

Shorts — Step 4

Video Generation

Transform each starting image into an 8-second animated clip using image-to-video models. Google Veo for production quality, or WAN 2.2 / LTX on the local RTX 5090 for free iterations. The video action prompt from the script drives the animation — subtle movements, camera pans, character expressions.

Google Veo WAN 2.2 I2V LTX 2.3 RTX 5090

Shorts — Step 5

Voice Studio

Replace audio with character voices using ElevenLabs. Each short gets a multi-track audio view: original video audio, per-character voice tracks, and AI-generated background music. Batch-replace all voices with one click, or fine-tune individual clips. Music generation creates custom background tracks that match each short’s mood.

ElevenLabs Per-Character Voices AI Music Multi-Track Audio

Shorts — Step 6

Render Engine

Mix video, voice, and music into final MP4s using ffmpeg. Each clip gets independent volume control for original audio, voice, and music tracks. Render all 8 shorts in one click or selectively re-render individual clips. Output uploads to Google Drive automatically and is available for immediate download.

ffmpeg Compositing 3-Track Audio Mix Google Drive Upload Batch Render

Shorts — Step 7

Publish & Schedule

Publish shorts to YouTube, Facebook, Instagram Reels, TikTok, and X (Twitter) from a single dashboard. Each platform has its own tab with OAuth authentication, AI-generated metadata, and publish controls. Schedule posts with a visual calendar, get AI-recommended posting times based on channel analytics, and let the auto-publisher fire at the right moment. Missed schedules trigger email alerts.

YouTube Facebook Instagram Reels TikTok X / Twitter Auto-Publisher AI Scheduling

Podcast Creator

A complete 7-step audio-only production pipeline. Generate conversational podcast episodes where the show’s characters discuss real topics — with multi-voice dialogue, AI-generated cover art, and direct publishing. Perfect for building a complementary audio feed alongside the video channel.

Idea & Script

Podcast Idea Lab

Three modes: AI-recommended pitches with Grok scoring, bring your own idea, or Research & Debate with live web research. Scripts include multi-character dialogue with ElevenLabs voice directions and configurable target length (2–120 minutes).

Dialogue

Multi-Character Script

Full conversation scripts with character dialogue, word count tracking, and duration estimates. Choose your LLM (Grok 4, Gemini, Claude, or local models) and generate scripts grounded in the show bible for character consistency.

Preview

Script Preview & Publish

Full episode preview with character avatars, color-coded dialogue, and a sidebar listing all podcast episodes. Review the complete conversation flow before committing to voice generation and audio production.

Fire Hydrant Gazette — Late-Night News Comedy, Reimagined

A complete news-desk segment system inspired by classic late-night news comedy. Extensible segment templates define format rules, comedy mechanics, joke formulas, and visual style — all baked into the AI script generation.

iPad & PC Image Watcher

A dual-source image pipeline that monitors Google Drive (for iPad drawings) and a local PC folder simultaneously. New images are automatically detected and queued for approval — no manual upload needed. Combined with start/end image slots, this enables a smooth hand-drawn-to-AI-video workflow.

Grok 4 deep-research scripts

A new script generation mode that leverages Grok 4’s live web search to produce fact-heavy, current-events scripts. Instead of relying solely on the show bible, Research & Debate mode conducts real-time web research on the episode topic, then generates scripts grounded in verified facts and recent developments.

Configurable LLM models per step

v1.1 introduces per-step model selection. Choose which LLM powers each creative stage — Episode Ideas, Episode Scripts, Shorts Ideas, and Shorts Scripts can each use a different model. Switch between local Ollama models (zero API cost) and cloud models (Gemini, Claude) depending on your quality and speed requirements.

Where it sits in the market

The AI video market is fragmented into tools that each solve one piece of the puzzle. Generation engines produce stunning clips but can’t build a story. Automated pipelines assemble videos fast but rely on stock footage. Avatar platforms nail corporate presentations but can’t do cinematic scenes. And only one other tool even attempts full episodes — but it’s animation-only. DC Creator spans all of these categories.

How it all connects

A hybrid architecture where cloud APIs deliver the highest-quality generation (Veo, Gemini, ElevenLabs) while a local GPU provides open-source alternatives and hardware encoding. The VPS orchestrates everything, and each AI agent is purpose-built for its stage of the pipeline.

Technology deep dive

Every component was built from scratch — no video editing frameworks, no SaaS dependencies, no drag-and-drop website builders. Pure Node.js, vanilla JavaScript, and ffmpeg.

Ten AI models, one pipeline

No single model can do everything. The Creator orchestrates specialized models for each phase of production — local where possible, cloud where necessary. Per-step model selection lets each creative stage use a different LLM. v1.2 adds Grok 4 with live web search.

The manual effort this replaces

Doodle Cast Creator is not an API wrapper. It is a production-grade studio that replaces every specialist role in a traditional video content operation with end-to-end AI generation — from initial idea to multi-platform publish. The scale numbers below describe what the system does, and the section that follows describes what it would take to produce the same output by hand.

Deep technical breakdown

Every design decision in Doodle Cast Creator had a real constraint behind it. This section walks through the shape of the implementation at a high level: module topology, data model, rate-limit strategy, the dynamic render engine, the hermetic test pipeline, the hybrid cloud + local GPU routing, and the non-destructive cache policy. The goal is to show why the system looks the way it does, not to hand out a runbook.

1. Modular Composition Root

The main entry point is a thin bootstrap: environment validation, middleware stack, layered rate limiters, session setup, and router registration. It holds essentially no business logic. All production behavior lives in 22 domain routers and 11 shared services underneath. Each router owns its validation, data access, and error responses; services are pure functional units callable from any router.

2. Layered Rate Limiting

Rate limiting is layered by cost class. A default limiter covers general API traffic. A much tighter limiter applies to cost-sensitive endpoints (LLM calls, image generation, and render dispatch) matched by both literal path and regex patterns. The tightest cap applies to authentication and OAuth callback flows to resist brute-force and credential-stuffing attempts. Static-asset bulk-fetch paths are excluded from API rate limiting. The expensive limiter runs before the global limiter so the global counter still sees every request.

Specific thresholds and endpoint lists are intentionally not published — tuning parameters that affect throttling behavior are treated as internal configuration.

3. Normalized Data Model

The persistence layer is a normalized relational schema grouped into five concerns. The database engine supports concurrent reads during long-running writes (render jobs, image generation), and foreign-key relationships keep referential integrity explicit. Every table is exercised by the integration test suite against a fresh ephemeral database per run.

4. Dynamic Render Engine

Render is not a wrapper around a preset. Every episode, short, and podcast clip is composited by building a filter graph at runtime from the clip's tracks, volume automation, and timing metadata. Four audio streams are mixed per clip with explicit per-stream weights and fade/duck automation, then paired with the video stream and handed to a hardware-accelerated encoder.

Each volume envelope, fade, duck, and weight is generated per clip from the clip's metadata in the database, not hand-authored. The same engine handles episodes, shorts, and podcast clips via a shared filter builder, which is why a 5-second short and a 12-minute episode both render through the same code path.

5. Hermetic Integration Test Pipeline

The test suite is fully hermetic: it boots the real server binary against an ephemeral database, stubs every external AI and platform API, and exercises each router end-to-end over real HTTP. 113 integration cases run on every CI build. Because the runner uses the production code paths, regressions in rate limiting, middleware, and business logic all surface before merge.

6. Hybrid Cloud + Local GPU Topology

The orchestrator delegates GPU-bound work (video generation, image synthesis, encoding, transcription, adaptive streaming prep) to a local GPU host over a private tunnel, while cost-sensitive and highest-quality work flows to cloud AI APIs. A health poller keeps cloud fallbacks warm, so any local outage degrades gracefully rather than blocking the pipeline.

Routing is per-job, not per-user. The same episode can fan out cloud video + local draft image + cloud voice + local encoding based on cost, quality, and availability.

7. Non-Destructive Cache Policy

Cache eviction normally deletes whatever is coldest. That is unacceptable here — a render that has not yet been archived cannot be recreated without re-running the whole GPU pipeline. Eviction therefore follows a strict backup-first order: archive to permanent storage, verify the copy, then reclaim local space. A crash mid-cycle never loses data.

If the remote archive is unreachable during a cleanup cycle, the cache simply grows a little past its cap until the next cycle — which is far cheaper than losing a not-yet-backed-up render.