Hello, everyone!
I've been practicing compositing anime-style characters with live-action footage lately, so I'd like to share how I go about it! I'll be using Shoost for this explanation, but since these are general video editing techniques, they should be applicable in other software as well.
Color Matching is Everything in Live-Action Compositing
One thing you'll quickly realize when trying live-action compositing is that matching colors is surprisingly tricky.
You adjust the character's brightness and contrast to match the background, but it's harder than it sounds. So I tried applying some techniques from live-action video editing, and it made the whole process much easier. Let me walk you through it!
Applying the Log Profile Concept
In live-action video editing, a lot of people color grade footage that was shot in a Log format.
Log profile footage looks low in contrast and slightly desaturated overall. The idea is to start from this flat state and then build the look of the footage through color correction and color grading.
So I tried applying this idea to compositing anime characters with live-action backgrounds.
Here's How I Do It
Here's the scene we'll be working with.
1. Bring the Background to a Log-Like State
First, adjust the live-action background so it resembles a Log profile. Start by setting the white balance, then bring down the contrast and saturation.
The key point here is to make sure there are no pure whites or pure blacks in the image. Try lowering the Input Gamma and nudging both the Output Black and Output White slightly inward. (Note: this isn't the same as actual Log footage with its expanded color information. We're just mimicking that flat look to make the adjustment process easier.)
2. Convert to Black and White and Match the Character's Brightness
Next, we'll adjust the character to match the background. Start by converting the entire screen to black and white so you can focus on brightness.
Apply a Levels adjustment to the whole screen and use Input Black and Input White to check and adjust brightness. If you raise the Input Black, lower the character's Output White to bring down the brightness ceiling. If you lower the Input White, raise the Output Black to adjust the darker end. Also, lowering the Gamma to reduce contrast will help the character blend into the background more naturally.
3. Match the Saturation
Once brightness is sorted, move on to saturation. Temporarily boost the saturation of the entire screen, then lower the character's saturation until it matches the background.
The image may look a bit washed out at this point, but the overall color balance should be roughly aligned. If you want to go further, checking and fine-tuning each RGB channel individually will get you even better results. Definitely worth trying if you want that extra polish!
4. Restore the Original Colors
Once all the adjustments are done, apply color correction to the whole screen to bring the contrast and saturation back to their original levels.
By this point, the character should look quite naturally integrated into the scene.
Adding Finishing Effects
With the color matching done, it's time to add some screen effects to bring the atmosphere together. Think of it like the compositing work done in anime production.
For this one, I set up the effects assuming light is streaming in through a window.
First, I added gradients to the character to match the direction of the light source, brighter on the side facing the light and slightly darker on the opposite side. I used a combination of blend modes like Overlay, Add, and Multiply to get the right balance.
Next, I added a subtle flare effect across the entire screen to give the light some flow.
Since the light in the back was quite strong, I also darkened the right side of the frame slightly.
With all of that in place, you can really start to feel like the light from the window is actually hitting the character.
For the final finishing touch, I used color grading to pull the overall mood together.
I went for a slightly nostalgic atmosphere this time. What do you think? I'm pretty happy with how the scene turned out!
Conclusion
The key takeaway from this one is that instead of using the background as-is, bringing it to a Log-like state, lowering the contrast and saturation first, makes color matching a lot easier. If live-action compositing hasn't been clicking for you, give this approach a try!
Feel free to give it a try. Hope it helps!