Instant Human Review product preview with interpreter review workflow

TranslationEnterprise SaaS2025-2026

Instant Human Review

A market-first Propio initiative that combines machine translation with certified human review, reducing turnaround from days to minutes for high-stakes translation needs across healthcare, legal, education, and other regulated industries. The product is now in beta with real Propio clients.

Role
Lead product designer
Focus
Product strategy, AI workflows, UX research, and UI design
Platform
Enterprise SaaS web + iPad · Cross-product workflow
Company
Propio

Design Challenge

01

Compliance required human review

Clients in regulated industries needed translation workflows that could satisfy compliance requirements, but traditional human translation often took hours or days.

02

ACA 1557 required human validation

For healthcare clients, ACA Section 1557 made qualified human validation necessary when machine translation supported critical or technical content.

03

Human review needed to scale

Propio had a large interpreter network, but the product needed a way for certified reviewers to validate AI-generated segments quickly and consistently.

Key Product Decisions

Human-in-the-loop model

Human-in-the-loop model showing Propio ONE, AI backend, interpreter validation, and reviewed translation return flow

Decision 01

Design around human expertise, not AI replacement

The product positioned interpreters as expert validators. AI handled segmentation and translation generation, while humans made the final quality decision before content reached the client.

Test A translation review interface showing multiple translation choices for interpreter selection
Test B translation review interface showing one recommended translation with approve and reject actions

Decision 02

Use experimentation to choose the production workflow

The biggest product question was how interpreters should review AI-generated content. I designed and built an internal testing platform so the team could compare two review models with real behavioral data.

Propio ONE translation interface showing machine translation with Instant Human Review completed
Interpreter Portal incoming translation modal for a legal translation review job

Decision 03

Coordinate independent products into one service

Propio ONE and the Interpreter Portal already existed as separate applications, owned by different product and engineering teams. My work was to define how those systems should communicate so a client request, AI-generated translation, interpreter review, status updates, and final delivery could move through one reliable service. The challenge was not just the interface; it was aligning many moving parts into a clear, end-to-end product experience.

Propio Instant Human Review admin dashboard with overview metrics and A/B test performance

Testing platform

Captured live sessions, completion rate, A/B performance, usability feedback, and exportable summaries.

Instant Human Review analytics dashboard showing translation accuracy, test comparison, and option selection frequency

Decision analytics

Measured how reviewers selected translation options across segments so workflow decisions were based on behavior.

Test B translation review interface showing one recommended translation with approve and reject actions

Selected review model

The approve-or-reject model reduced decision effort while keeping interpreters responsible for final validation.

Databricks dashboard monitoring Instant Human Review jobs, completion rates, language demand, and interpreter response time

Production monitoring

After beta launch, operational dashboards tracked real client usage, job volume, completion rate, language demand, and interpreter response time.

Experimentation & Validation

The Interpreter Portal concept began as a fully interactive Figma Make prototype for a company-wide innovation hackathon, where it won first place and secured support for further investment. Instead of moving directly into engineering, I proposed validating the review model first.

I designed and built an internal A/B testing platform that captured completion time, segment-level behavior, translation accuracy, usability scores, qualitative feedback, and PDF summaries. This let the team choose the production workflow based on user behavior rather than stakeholder preference.

Metric Test A Test B
Overall score 60 65
Average completion time 6:47 5:47
Median completion time 6:01 5:36
Translation accuracy 35% 57%

Production Rollout

After validation, I designed the production experience using the Propio design system: pixel-ready UI, reusable component patterns, interaction specs, edge cases, responsive behaviors, developer annotations, and end-to-end user flows.

The product shipped into beta with Propio clients across healthcare, education, and public service contexts, including Wichita Public, Montefiore Health, UCHealth System, Pediatric Specialists, and Kintegra Health. Review workflows supported Spanish, Vietnamese, Mandarin, Haitian Creole, Bengali, and Russian.

63+

Human review jobs completed during early beta.

8.2 sec

Average interpreter connection time.

3.3 min

Average human review turnaround in production dashboards.

Reflection

The strongest lesson was not how to design an AI product; it was how to design the relationship between AI and people. By letting AI generate translations and positioning interpreters as expert validators, the workflow delivered automation speed with the trust high-stakes communication requires.

The best AI experiences do not remove humans from the workflow. They amplify human expertise where it matters most.

Interested in this project?

I’m happy to walk through the full design process and decisions behind the product.

Contact me