Skip to content
Atlas and Lemon Slice / BenchmarkLonger speech · Separate review

Same faces.
Thirty seconds of speech.

Forty portraits, each with its own longer script. 40 of 40 paired recordings are available.

Appearance through longer speech.

Twenty full frames and twenty face crops per recording sample the longer speaking interval. The same four scoring categories apply to both systems.

Long-form LLM appearance

Score / 80
Atlas77.68
Lemon Slice72.08
Same scoring rubric and portrait set for both systems. Whiskers, where shown, are 95% portrait-bootstrap intervals.

Across 40 scored pairs, Atlas scored higher in 37, tied in 3, and scored lower in 0. The average Atlas-minus-Lemon Slice difference was 5.60 points; the 95% portrait-bootstrap interval was 4.70 to 6.55.

Identity & composition

Score / 25
Atlas25.00
Lemon Slice24.00
Same scoring rubric and portrait set for both systems. Whiskers, where shown, are 95% portrait-bootstrap intervals.

Scene fidelity

Score / 20
Atlas20.00
Lemon Slice20.00
Same scoring rubric and portrait set for both systems. Whiskers, where shown, are 95% portrait-bootstrap intervals.

Visual consistency

Score / 20
Atlas20.00
Lemon Slice16.30
Same scoring rubric and portrait set for both systems. Whiskers, where shown, are 95% portrait-bootstrap intervals.

Mouth appearance

Score / 15
Atlas12.68
Lemon Slice11.78
Same scoring rubric and portrait set for both systems. Whiskers, where shown, are 95% portrait-bootstrap intervals.

These are sampled appearance scores. They do not measure full-speed motion, exact lip synchronization, or every frame of the recording.

All long-form scores and observations

Longer recordings: delivery and usage.

40 of 40 Lemon Slice captures completed on their first attempt, with verified playback files. Source speech recordings ranged from 28.35 to 31.44 seconds.

Lemon Slice delivery

MeasurementMedian · 40 captures
API session request6.86 s
Audio submission → first received video1.22 s
Full-span received SDK cadence24.01 frames/s
First received video can be idle. Session request and audio submission are separate timing boundaries; these medians are not summed or compared with Atlas renderer latency. Audio was submitted in unpaced 100 ms chunks.

Credits and service-price example

ScopeUsage or advertised price
Lemon Slice long session16.49 credits, median
All 40 long captures670.11 credits
Short + long runs, all attempts928.91 of 1,000 included credits
Atlas advertised service price$7/hour · $0.0583 per 30 seconds
Credits include startup and idle session time. The combined total includes short-run retries and is not a current account balance. Atlas’s 30-second figure is a service-price example; neither figure is a measured cash invoice per clip.

Received SDK cadence uses the frame count minus one divided by the first-to-last native timestamp span, including idle tails and internal gaps. It measures delivery cadence, not provider compute speed.

Download long-form delivery and usage data

Video and audio review.

All 280 evaluation responses are preserved. A content audit found transcript evidence that does not match the supplied speech, so motion and audio scores are withheld while that discrepancy is investigated.

The recorded comparisons remain available below. The separate sampled-appearance results above do not establish lip synchronization or full-speed motion quality.

Watch the complete recordings.

Each pair uses the same portrait and source audio. These are separate long generations, not repeated short clips. Native starts and quiet endings are retained; simultaneous playback does not align individual words.

Lemon Slice playback uses approximate receiver-arrival audio/video alignment, so it cannot establish exact lip synchronization.

Method.

The same 40 portraits each use a longer script, with about thirty seconds of source speech. Two fresh-context LLM reviewers each assess a disjoint set of twenty portraits, with Atlas and Lemon Slice randomly labeled A or B for each pair. Each clip receives one review. The rubric is fixed before review and both rating sets are finalized before model labels are revealed.

Twenty full frames and twenty expanded face crops are sampled across each recording’s audio-active interval. The rubric assigns 25 points to identity and composition, 20 to scene fidelity, 20 to sampled visual consistency, and 15 to mouth appearance. Greater movement or greater stillness alone does not earn a higher score. Intervals use 2,000 paired portrait bootstrap resamples.

Native recording gaps remain visible. In portrait 009, Atlas has a 3.2-second video pause during speech; two sampling targets therefore select the same subsequent frame. This capture remains in the gallery and review. The sampled scores do not replace full-recording playback or quantify exact audio/video synchronization.