Benson Nguyen

roblox-logo Case Study • PM · UX · Prototype

Roblox AI Editor Assistant

Self-initiated product case study (not affiliated with Roblox)

Mode-based, project-aware assistant that helps creators learn, fix, and build faster—safely.

Roblox AI Editor — UX Modes
Three focused experiences move users from learning → fixing → generating with the right guardrails.

Context

  • Role: PM + UX + prototype dev
  • Timeline: 4 weeks (research → prototype → tests)
  • Stack: Roblox Studio (Luau), Next.js, Figma

Problem

One-size AI either over-explains for experts or under-explains for beginners, causing context-switching and unsafe code.

Audience

  • Beginners: syntax + “where does this go?”
  • Intermediates: patterns & debugging
  • Pros: scaffolds, refactors, speed
  • Educators: policy + explainability

Mode Strategy

Explicit, switchable modes reduce prompt-wrestling and align tone + safeguards to intent.

Teach (Beginner)

  • Line-by-line explanations with Roblox APIs
  • Stepper: Plan → Insert → Explain → Test
  • Guardrails on by default

Debug (Intermediate)

  • Summarize error logs + stack traces
  • Minimal, safe patches with diffs
  • One-click rollback + add assertions

Generate (Pro)

  • Scaffold modules & patterns, fast
  • Permission prompts for risky ops
  • Attach tests and run in sandbox

Fix Mode — Error → Patch Diff → Add Test → Apply

Debug Mode ingests stack traces and proposes surgical patches with a diff preview, an explanation, and optional test stubs. Apply with one click and rollback anytime.

  • • Read error log + current file context
  • • Generate minimal patch + guardrails
  • • Attach test and run in sandbox
Fix Mode: Error log and proposed patch diff
Example: pathfinding failure → parameterized repath + guard checks.
Project-aware pipeline diagram
Flow: inputs → context → safety policy → task routing → validators → suggestion (diff + risk badge).

Project-Aware Pipeline

Inputs
Current file • Open tabs • Explorer snapshot • Error logs
Outputs
Diff preview • Explanation • Risk badge • Apply | Add test | Run

The assistant uses filenames + open script (no raw code upload by default) and blocks risky APIs. Static checks and sandbox tests raise quality without slowing pros.

Prototype Goals

Beginners’ time-to-first-feature ↓ 36% (26 → 17 min). Compile-without-error on first insert ↑ 85%. Pros rated preset usefulness 4.4/5.