Episode 007: Folder Mania — When AI Comes to You

Every AI tool claims it can read your folders. We actually tested that claim — across ChatGPT, Claude, Gemini, and Microsoft Copilot — using a real-world 48-document Chapter 13 case file. The results were all over the place.

Ron introduces the "File Cabinet Test": a threshold check that tells you whether an AI tool is actually seeing what you're giving it, before you trust it with anything that matters. Because if the AI is faking it — cherry-picking by relevance, wandering outside your folder, or missing documents entirely — that's not an AI intelligence problem. That's a visibility problem. And for lawyers, visibility is everything.

This episode is a deep dive into folder access, document security, workflow design, and what it really means to close the trust gap in your practice.

What You'll Learn

What the File Cabinet Test is and why it's the first question you should ask of any AI tool

How ChatGPT, Claude, Gemini, and Copilot each performed on real legal documents — and where each one surprised us

Why "the AI comes to you" is a game-changer for law firm document security

The hidden risk when AI output looks complete but isn't

How a bankruptcy trustee's preference complaint workflow points to the next frontier of AI-assisted legal practice

What Claude's new MCP integration with NetDocuments means for Jetsons-level lawyers — right now

Chapter Markers

0:00 — Introduction: Testing AI folder access across four platforms

1:05 — The test case: A complex Chapter 13 with 48 documents

2:00 — Introducing the File Cabinet Test (and why AI wants to fake it)

3:47 — Heather's ChatGPT zip file test: A home run — and a teaching moment

5:54 — Visibility vs. intelligence: The real question we're asking

7:30 — The million-document file: A tease for the roadmap

8:58 — ChatGPT connected to Google Drive: Same tool, different result

10:42 — Claude: Security, redaction, and a perfect file cabinet test

13:34 — Claude's limitations: Budget gaps and the timeout problem

15:00 — Analysis vs. ecosystem tools: How to frame the choice

15:59 — Gemini inside Google Drive: Close, but not quite

18:27 — The trust gap: Why small firm lawyers can't do what we just did

19:41 — Copilot: Why Ron wanted it to work, and what happened instead

22:19 — The Copilot saga escalates: Zip files, crashes, and a 20-file ceiling

25:57 — Where Copilot actually belongs in your workflow

27:30 — Workflow-first, tools-second: How to find your bottleneck

28:49 — AI malpractice on the horizon: The human oversight imperative

31:50 — Practice Signal: Preference complaints and the AI merge-print breakthrough

36:13 — FSJ Level-Up: Flintstones, Simpsons, and Jetsons recommendations

38:49 — Jetsons surprise: Claude + NetDocuments MCP integration, live today

40:34 — Ron's take: Why he resisted Claude — and why he changed his mind

41:35 — Closing thoughts: Making lawyers less afraid

Resources & Links

lawyeraitoolkit.com

ChatGPT Enterprise — openai.com

Claude — claude.ai

Google Gemini — gemini.google.com

Microsoft Copilot — copilot.microsoft.com

NetDocuments — netdocuments.com