01Independent concept study6 week sprint

Signal Studio

Turning thousands of scattered fan reactions into one clear, evidence backed experiment.

Role

Product strategy, research planning, UX, interaction design, prototyping

Focus

Creator growth, community intelligence, explainable AI

Outcome

An interactive product prototype and a testable validation plan

SSignal StudioJB

MONDAY BRIEF · SEP 14

Your community is asking to see how the work gets made.

Requests for practical process content rose 38% this week. The signal appears across paid members and free followers.

EVIDENCE186related comments
Review the cluster
NEXT TESTPublish a 6 minute process breakdownOffer the full version to paid members

The opportunity

Creators have data everywhere and confidence nowhere.

Community feedback lives across comments, chats, polls, purchases, and membership activity. Each platform reports what happened inside its own walls, but rarely explains what the audience is asking for across the whole relationship.

The design question was specific: How might we help a creator move from noisy feedback to a small, defensible experiment without hiding the reasoning inside an AI answer?

Framing the work honestly

Concept study · illustrative data
01

Assumptions

Small creator teams lose time assembling signals and struggle to separate loud reactions from repeated needs.

02

Research plan

Interview 6 creators and 3 community managers, map their weekly decisions, then test evidence comprehension with a clickable prototype.

03

Validation target

A creator can explain why a recommendation exists, change it, and create a measurable experiment in under five minutes.

No interviews are presented as completed research. The prototype uses synthetic comments and metrics so the riskiest product assumptions can be tested next.

Decision journey

The workflow follows a question, not a dashboard.

01

Notice

Surface one meaningful change, with the date range and sample size.

02

Inspect

Read representative evidence and challenge the grouping.

03

Decide

Edit the recommendation, audience, risk, and expected effect.

04

Test

Define the goal and guardrail before anything launches.

05

Learn

Compare the result to baseline and record what changed.

Interactive prototype

Follow the evidence into an experiment.

Select a signal, inspect its evidence, and adjust the recommendation. The interface keeps the model’s reasoning visible at every step.

Signal Studio / Weekly briefIllustrative workspace

EMERGING REQUEST

Show more of the process behind finished work

High confidence

Mentions rose across Patreon, Discord, and YouTube. Paid members are 1.8 times more likely to ask for a complete walkthrough.

Related messages186
Sources3
Date range7 days
“I would love to see the rough versions before the final piece.” Paid member · Patreon
“Could you break down how you made the lighting choice?” Follower · YouTube

Three decisions that shape trust

System behavior over decoration
01

Evidence comes before advice

The product opens on the signal, sample size, source mix, and representative comments. The suggested action stays visually secondary until the user has enough context to judge it.

02

Confidence is explained in words

A label like “high confidence” is paired with timeframe, volume, and source diversity. Users can inspect the cluster and remove examples that do not belong.

03

An experiment needs a guardrail

Every launch requires a primary goal and a counter metric, such as conversion without an increase in cancellations. The system is designed to learn, not maximize clicks.

What I would test next

Can creators understand the system well enough to disagree with it?

  1. ComprehensionAsk users to explain the signal in their own words before seeing the recommendation.
  2. CorrectionObserve whether users can find and use merge, remove, and reinterpret controls.
  3. Decision qualityCompare an AI suggestion alone with an evidence first workflow.
  4. Business valueTrack time to experiment and reported confidence, not the number of outputs.

Build brief

Take the product further.

This is the complete implementation prompt, including flows, AI rules, accessibility, data entities, edge cases, and success measures.

Build a responsive web application called Signal Studio for independent creators who manage paid memberships and community channels. The product should unify comments, community chat, polls, purchases, membership activity, and content performance into one evidence based workspace.

Primary user: a creator with 5,000 to 100,000 followers and a small team. Secondary user: a community or growth manager.

Core flows: connect sources with granular permissions; surface repeated requests, rising themes, retention drivers, and conversion opportunities; inspect representative evidence and model confidence; edit an AI recommendation; turn it into an experiment with a goal, audience, duration, guardrail, and success metric; compare results; correct model groupings; revoke data access.

Design an editorial analytical interface using warm white, charcoal, muted coral, and one teal status color. Avoid gradients, glass effects, decorative blobs, and arbitrary card grids. Make evidence more prominent than advice.

Every recommendation must link to evidence, sample size, date range, and confidence. Never claim certainty. Let the creator override the model. Include empty, loading, partial data, disconnected source, conflicting signal, and low confidence states.

Meet WCAG AA with keyboard navigation, visible focus, semantic landmarks, chart alternatives, reduced motion, 44 pixel targets, and no color only status.

Use typed entities for Creator, Workspace, DataSource, AudienceSegment, ContentItem, CommunityMessage, SignalCluster, EvidenceItem, Recommendation, Experiment, Metric, ExperimentResult, ModelCorrection, and ConsentRecord. Build with seeded realistic data and a mocked AI service with transparent schemas. Test scoring, permissions, experiment creation, and correction flows.

Measure time from question to testable experiment, evidence review, completion rate, corrections, weekly use, and creator reported decision confidence.
Download both prompts

Improve this signal

What did the model miss?