Section 6: Lip Sync and Performance · Lesson 3 of 5 (28 of 45) · 60 minutes · Evidence: Artifact diagnosis and repair plan
A doctor does not say “you look unwell” and hand you a prescription. The doctor looks for symptoms, names a likely cause, and chooses a treatment that fits it. A lip sync defect works the same way. “It looks off” is a symptom. Today you learn to name the problem and trace it to the place where it began.
Production journal: write your answer below.
What must a filmmaker understand before they can identify drift distortion frozen expression and timing errors and select a correction?
Diagnosis means naming what is wrong and why. In lip sync, almost every defect has one of four sources: the source image, the audio, the generation itself, or the edit where the clip meets the rest of the film. If you know the source, you know where to fix it. Fixing the wrong place wastes the period.
In a take of Mara delivering a line, her copper glasses seem to sink toward her cheek in the last second. That is drift. The clip is eleven seconds. The student diagnoses a length problem, not an image problem, and chooses to split the line into two shorter clips. Later in the same take her smile shows teeth that blur. The source image shows a broad smile, so the cause sits in the image, and the repair is a new, calmer portrait.
Experienced editors and animation artists review a flawed take like a detective reviewing a scene. They do not guess; they follow clues. Study how they work and decide at each step what the tool can do and what only you can decide.
The reviewer replays the same two seconds several times, slows the video, and often views frames one by one. They write each defect with a time stamp and a plain description. Then they sort the list: some problems belong to the picture, some to the sound, some to how the tool generated, and some can be solved in the edit without generating again. They repair the most damaging defect first and generate again, because a fix that creates a new problem needs to be seen before another is added.
Notice that the tool never tells you the cause. A tool may mark a face or show a progress bar; the judgment of why the mouth looks wrong is human.
As you study, record each decision point in your production journal.
| Decision point | What the filmmaker does | What the tool automates | What still needs human review |
|---|---|---|---|
| Find and time-stamp defects | Replays slowly or frame by frame and logs each defect | Nothing; playback only | That no defect is missed, especially in the last seconds |
| Sort by source | Assigns each defect to image, audio, generation, or edit | Nothing; this is reasoning | Whether the assigned source really explains the defect |
| Choose a repair | Picks the cheapest fix that targets the cause | Can regenerate a new version | Whether the repair solves the defect without causing a new one |
| Rank by impact | Chooses the most damaging defect to fix first | Nothing | Whether the audience would notice the defect at normal speed |
Studio task: Sort observed defects by source image audio generation and edit solution.
Your teacher supplies two or three sample clips with known defects. Work in pairs and diagnose them using the checklist.
Coaching tips. If you cannot decide between image and generation, ask whether the same defect would appear in a still image. If the face is already odd in the still, the image is the source. If you cannot decide between audio and generation, play the audio alone and listen for the problem. Last, write down one defect you chose to leave alone because the audience would not notice it; knowing what not to fix is part of good judgment, and it keeps your revisions focused.
Clip: ______
Time | Artifact name | Source (image / audio / generation / edit) | Evidence
| | |
| | |
| | |
Defect an audience notices first: ______
Cheapest repair that targets its cause: ______
What I will leave unchanged for now and why: ______Studio task: Diagnose the baseline take and choose the highest-value correction.
Diagnose your own baseline take from the last lesson.
Checklist before you submit:
Match one defect to its likely cause.
Deliverable: Artifact diagnosis and repair plan.
Submit the artifact diagnosis and repair plan. The file must use the course naming convention and include enough process evidence to show the student's decisions and revisions.
File name (course naming convention): AIF_S06-L03_artifact-diagnosis-and-repair-plan_v01_YOURINITIALS
| Criterion | Advanced | Proficient | Developing | Beginning |
|---|---|---|---|---|
| The work addresses the stated story or production purpose. | Defects are tied to what the audience would feel in the scene, and the repair priority reflects the story’s needs. | Defects and repair priority relate to the scene’s purpose. | Some defects relate to the scene. | No link between defects and the scene. |
| The student applies the required method accurately and produces usable capstone evidence. | Every defect is timed, correctly named, sorted by source, and supported by evidence; the plan is testable. | Defects are named and sorted accurately; the plan is clear. | Some defects are named or sorted incorrectly. | Few defects found, or no sorting. |
| The student identifies at least one quality issue and records a meaningful revision decision. | Chooses the highest-value repair with reasoning and states how the result will be checked. | Identifies a quality issue and records a meaningful revision decision. | Chooses a repair without a clear reason. | No repair decision recorded. |
| The work complies with consent rights attribution privacy disclosure and school policy. | Repair plan stays within authorization, replaces any output resembling a real person, and logs the tool record. | Plan stays within authorization and school policy. | Policy considerations are mentioned but incomplete. | Plan keeps an unauthorized or deceptive likeness. |
Requirement: Stop and replace any output that creates a deceptive real-person likeness.
Sometimes a repair attempt makes a synthetic face drift toward a real person’s look, or a generated voice starts to sound like someone you recognize. If that happens, stop, do not use that output, and replace it with an authorized one. A performance that could be mistaken for a real person saying real words is deceptive even when it was made by accident. Tell your teacher and note the replacement in your records.