FaceFusion: The Definitive Deep Dive & Walkthrough - Everything You Always Wanted to Know About...

Shady Endeavor
27 Dec 202328:01

Summary

TLDRThis tutorial video guides users through updating and using Face Fusion 2.1.1 for face swapping in images and videos. It covers installation, selecting execution providers, and adjusting settings for optimal performance. The script explains how to choose face swapper models, enhancers, and use face debugger tools for precise masking, ensuring a natural look in the final output. Viewers are encouraged to experiment with different settings for the best results.

Takeaways

  • 📝 Ensure you have the latest version of Face Fusion (2.1.1 at the time of the video) for the best experience and features.
  • 🔄 If you have version 2.0.0, follow the upgrade instructions in the video to update to the latest version.
  • 💻 Use the terminal to navigate to the Face Fusion directory and execute commands to pull the latest version from GitHub.
  • 🛠️ Create a virtual environment for Mac/Linux or use specific commands for Windows to prepare for the installation.
  • 🖥️ Select the appropriate execution provider based on your system (Core ML for Mac, CUDA for Nvidia, etc.).
  • 🔄 Be prepared for additional downloads and installations when you first run the updated Face Fusion.
  • 🔧 Adjust the execution thread count based on your GPU's VRAM for optimal performance.
  • 📁 Set a custom output path for your creations, but be aware of potential issues with spaces in the path and the path not being saved.
  • 🎥 Use the face swapper tool to replace faces in images or videos by selecting a source and target.
  • 🔍 Utilize face analyzers to select specific faces in the video based on order, age, and gender when needed.
  • 🛡️ Experiment with different face mask types and settings in the face debugger for precise control over the face swap effect.

Q & A

  • What is the latest version of Face Fusion mentioned in the video?

    -The latest version of Face Fusion mentioned in the video is 2.1.1.

  • If someone has never installed Face Fusion, what should they do according to the video?

    -If someone has never installed Face Fusion, they should watch the clean install video linked in the top right of the video or in the information below.

  • What is the first step to upgrade Face Fusion if you already have version 2.0.0 installed?

    -The first step to upgrade Face Fusion is to open the terminal application and ensure you are in the Face Fusion directory.

  • What command should be typed in the terminal to pull the newest version of Face Fusion from GitHub?

    -The command to pull the newest version of Face Fusion from GitHub is 'git pull'.

  • For Mac and Linux users, what commands should be used to create a virtual environment after pulling the latest version?

    -For Mac and Linux users, the specific commands to create a virtual environment are not provided in the transcript, but it is mentioned that they should type the commands for Mac and Linux.

  • What is the purpose of the 'face selector mode' in Face Fusion?

    -The 'face selector mode' in Face Fusion is used to choose the face that you want to swap in the target image or video.

  • How many face swapper models are available in Face Fusion by default?

    -By default, there are five different face swapper models available in Face Fusion.

  • What does the 'keep FPS' option do in Face Fusion?

    -The 'keep FPS' option in Face Fusion keeps the output file to its original target's frame rate instead of converting it to the default 25 FPS.

  • What does the 'face debugger' tool in Face Fusion do?

    -The 'face debugger' tool in Face Fusion is used for face masking and helps to visualize which face will be swapped and what area will be affected.

  • What are the three different face mask types available in Face Fusion's face debugger?

    -The three different face mask types available in Face Fusion's face debugger are 'Box', 'Occlusion', and 'Region'.

  • What is the recommended face enhancer model for a more realistic film look according to the video?

    -The recommended face enhancer models for a more realistic film look, according to the video, are 'Code Former' and 'GPen etc'.

Outlines

00:00

📲 Face Fusion Software Update and Installation Guide

This paragraph provides a step-by-step guide for ensuring the viewer has the latest version of Face Fusion software, version 2.1.1, and how to upgrade it if they already have an older version installed. It covers the process of opening the terminal, navigating to the Face Fusion directory, pulling the latest version from GitHub, and setting up a virtual environment for different operating systems. The instructions also include choosing the correct system for the installation, such as default for M1 Macs or Cuda for Nvidia GPUs, and the initial steps to run the software after installation.

05:01

🛠️ Customizing Face Fusion Settings and Interface Overview

The second paragraph delves into the customization options available within Face Fusion, including execution providers, thread count, and memory settings. It discusses the importance of selecting the right execution provider based on the user's hardware and the impact of the thread count on rendering speed. The paragraph also touches on the output path settings, which dictate where the final videos and images are saved, and the limitations encountered with path customization. Additionally, it outlines various options like keeping the original frame rate, retaining temporary files, and skipping audio or downloads for certain models.

10:04

🔍 Face Selection and Swapping Process in Face Fusion

This section explains the process of selecting and swapping faces within Face Fusion. It introduces the face selector mode, which allows users to choose a reference face or select multiple faces for the swap. The paragraph discusses the use of face analyzers to refine the selection based on order, age, and gender. It also covers the 'many' mode, which applies the source image to as many discernible faces as possible, and the importance of the face detector model and face detector score in accurately identifying faces for the swap.

15:04

🎨 Face Swapper Models and Enhancer Settings in Face Fusion

The fourth paragraph focuses on the different face swapper models available in Face Fusion and their respective performance in terms of rendering time and output quality. It presents a comparative analysis of models like INS-Swapper 128, Blend Swap, and Sim Swap 256, highlighting the best options based on the test results. The paragraph also explores the face enhancer settings, detailing various models like GFP-GAN 1.4, Code Former, and Gpen bfr 512, and their impact on the final output's realism and plasticky appearance. It concludes with a discussion on the blend setting in the face enhancer and the use of frame enhancer for video upscaling.

20:05

🖼️ Advanced Masking Techniques and Face Debugger in Face Fusion

This paragraph introduces advanced masking techniques in Face Fusion, such as the face debugger, which allows for precise control over which parts of the face are affected by the swap. It explains the use of face mask types like the box, which can be adjusted for padding to fine-tune the area affected, and the blur setting, which helps in making the swapped face look more natural. The paragraph also covers the occlusion mask, which intelligently handles objects partially covering faces, and the region mask, which can be used to preserve specific facial features. Additionally, it discusses the use of the face detector score to fine-tune face selection and avoid switching between similar-looking individuals.

25:05

📝 Conclusion and User Engagement Invitation

The final paragraph wraps up the video script by summarizing the key points covered in the tutorial and inviting viewers to engage with the content. It encourages viewers to ask questions in the comments section if they have any, and to like, subscribe, and leave a comment if they found the video helpful. The paragraph ends on a positive note, wishing viewers a wonderful day and reminding them to take care.

Mindmap

Keywords

💡Face Fusion

Face Fusion is the software being discussed in the video, which allows users to perform face swaps on images or videos. It is the central theme of the video, with the script focusing on its installation, upgrade, and usage. The video script mentions the latest version, 2.1.1, and how to upgrade to it, indicating its importance in the video's content.

💡Virtual Environment

A virtual environment in the context of the video refers to an isolated space where the Face Fusion software operates, separate from the main system to manage dependencies and versions. The script instructs viewers on how to create this environment for Mac and Linux, and provides alternative commands for Windows users, emphasizing its role in the setup process.

💡Terminal Application

The terminal application is a command-line interface where users can execute various commands. In the video script, it is used to navigate to the Face Fusion directory and to pull the latest version from GitHub, showcasing its importance in the software's installation and upgrade process.

💡GPU (Graphics Processing Unit)

A GPU is a specialized electronic circuit designed to manipulate and alter memory to accelerate the creation of images in a frame buffer intended for output to a display device. The script discusses the selection of Cuda or ROCm based on whether the user has an Nvidia or AMD GPU, which is crucial for optimizing the Face Fusion software's performance.

💡Face Swapper

Face Swapper is a feature within the Face Fusion software that enables users to replace the face in a target image or video with a source face. The script describes different face swapper models like 'in_swapper 128' and their performance, highlighting the core functionality of the software.

💡Source Image

The source image is the image from which the face is taken to be swapped onto another image or video. The script explains how to select and use a source image within Face Fusion, such as using Robert Downey Jr.'s image for the example, which is essential for understanding the face swap process.

💡Target Image/Video

The target image or video is the media onto which the source face is to be swapped. The script details how to select the target and how the face swap process involves changing the person's face in the target media, as demonstrated with a clip from a Tyler Hubbard video.

💡Preview Window

The preview window in Face Fusion is a tool that allows users to see the changes before rendering the final output. The script mentions its importance and how it can be used to adjust settings and select specific frames, which is vital for the video's tutorial on how to use the software effectively.

💡Face Debugger

Face Debugger is a feature in Face Fusion that provides visual cues for the face swapping process, such as a red square around the face to be swapped and key points for tracking facial features. The script discusses its use for fine-tuning the face swap and ensuring accuracy.

💡Occlusion

Occlusion in the context of the video refers to a smart masking tool within Face Fusion that automatically handles obstructions in the target video, such as a beer mug covering part of a face. The script demonstrates how occlusion can improve the face swap by correctly masking out such obstructions.

💡Face Mask

A face mask in Face Fusion is a tool that defines the area of the target image or video that will be affected by the face swap. The script explains different face mask types, such as 'Box' and 'Occlusion', and how they can be adjusted to control the extent of the face swap effect.

Highlights

Ensure having the latest version of Face Fusion (2.1.1) for new features and improvements.

Watch a clean install video for initial Face Fusion setup if not installed.

For version 2.0.0 users, a quick upgrade process is outlined.

Using terminal commands to pull the latest Face Fusion version from GitHub.

Creating a virtual environment for Mac/Linux and specific commands for Windows users.

Installing the new version with system type selection for optimal performance.

Potential automatic downloads and installs when running Face Fusion for the first time.

Basics of using the app, including selecting face swapper and execution providers.

How to choose the correct execution provider based on the platform and GPU type.

Using the source and target images or videos for face swapping.

Explaining the execution thread count based on VRAM and optimal speed.

Adjusting the output path for saving created videos and images.

Options for keeping the original frame rate or skipping audio in the output.

Using face selector mode to choose which face to swap in a video.

Utilizing face analyzers to select the desired face based on order, age, or gender.

Different face swapper models and their impact on render time and quality.

Choosing the best face enhancer model based on the desired output look.

Adjusting the face detector score for better face selection accuracy.

Using the face debugger for fine-tuning the face mask and ensuring accurate swaps.

Exploring different face mask types for various scenarios in face swapping.

The importance of fine-tuning face mask padding and blur for natural results.

How to use occlusion for handling face swaps with objects partially covering the face.

The use of region masking to preserve specific facial features during a swap.

Invitation for viewers to ask questions and engage in the comments section.

Transcripts

play00:06

hey everyone before we begin looking at

play00:08

the interface and figuring out what

play00:10

everything does make sure you have the

play00:12

newest version of face Fusion installed

play00:15

which as of this video is release is

play00:17

version

play00:18

2.1.1 that added a few new features and

play00:21

improvements if you do not have face

play00:24

Fusion installed at all make sure to

play00:25

watch my clean install video that I will

play00:27

have linked in the top right of the

play00:29

video right now or in the information

play00:31

below the video however if you already

play00:34

have version 2.0.0 installed let's do a

play00:37

quick upgrade on it you can skip to the

play00:39

next chapter if you've already done this

play00:42

first open up your terminal application

play00:44

and make sure you are in the face Fusion

play00:46

directory you should be able to just

play00:48

type

play00:49

CD face

play00:52

Fusion once you're in the proper

play00:54

directory type the following command get

play00:58

poll and hit

play01:00

enter what this will do is it'll it'll

play01:03

pull or basically download the newest

play01:05

version of face Fusion from GitHub as

play01:08

I've had problems in the past I'm going

play01:09

to next create the virtual environment

play01:12

so type the commands for mac and Linux

play01:15

if you're on either of

play01:17

those

play01:19

and and there now you're in a virtual

play01:21

environment for Windows users these are

play01:23

the commands that you should be using

play01:24

instead of those last

play01:26

two then to install the new version

play01:29

that's been hold type in this

play01:36

command at this point as per before you

play01:39

need to pick out which type of system

play01:41

you're using so for me I'll just be

play01:43

picking default as I am on M1 Mac or any

play01:47

Mac you'll be picking default if you're

play01:50

using an Nvidia based GPU choose Cuda

play01:53

otherwise I believe rocm is for anyone

play01:56

using an AMD GPU CPU I'm not sure who

play02:01

would actually pick just

play02:03

that then for another part of the

play02:05

install you choose again kind of the

play02:07

same things but instead for Mac you will

play02:10

choose between Legacy which is if you're

play02:12

on an Intel Mac otherwise you will

play02:15

choose silicon if you are on an M1 M2 or

play02:18

M3

play02:20

Mac Cuda again once again if you are on

play02:24

Nvidia and I'm not sure which of these

play02:27

two are what you're supposed to be using

play02:29

if you're on AMD I believe it's one of

play02:31

those

play02:37

two watch it do its

play02:44

installation and that's

play02:46

it at this point it should be installed

play02:49

but as per usual I believe when you run

play02:51

it for the first time you will get some

play02:53

more downloads and installs

play02:55

automatically let's find out and as

play02:57

always to run it type the command

play03:00

python

play03:05

run.py looks like there aren't any more

play03:07

installs that was it so you're ready to

play03:10

go at that point pick up the URL here

play03:13

and copy that and put it into your

play03:19

browser and here we are starting off I'm

play03:22

going to show you the absolute Basics so

play03:24

that you can easily and quickly create

play03:26

your first swap if you already know the

play03:28

app pretty well or just need to know

play03:31

about specific parts of the app feel

play03:33

free to skip around the chapters I've

play03:35

set

play03:36

up first up in the top left you should

play03:40

already have face swapper

play03:42

selected next go down to the execution

play03:46

providers and depending on which

play03:47

platform you are working on make sure

play03:50

you have the correct selections um well

play03:53

selected on a Mac if you can make sure

play03:56

core ml is

play03:58

selected

play04:01

on an Nvidia GPU machine make sure you

play04:03

have Cuda

play04:05

selected on an AMD GPU machine make sure

play04:08

you have well whatever option you're

play04:10

supposed to have not sure to be honest

play04:14

weirdos again for quick and simple skip

play04:17

everything else on the left now in the

play04:20

middle you'll drag an image to

play04:23

Source or you can click on and find your

play04:26

file this is the image you want the

play04:28

person in the new image to look like

play04:31

below that is the target drag or click

play04:34

and find your image or video that you

play04:37

want to change the person's face from

play04:39

into the source

play04:41

images at this point if your image or

play04:44

video only has one obvious person in it

play04:46

that you want to swap you should be able

play04:48

to click the start button Below in the

play04:50

middle and then wait for the output and

play04:52

done that at times can be literally all

play04:56

there is to it now what the heck is

play04:59

everything else El let's look at the

play05:01

execution providers I already mentioned

play05:03

it but just make sure you have corl Cuda

play05:06

or whatever it is for AMD selected

play05:09

otherwise renders will take much much

play05:11

longer the execution thread count is

play05:14

based on the amount of vram you have so

play05:16

this depends on the GPU that you have I

play05:19

have a 16 GB M1 Mac Mini so I set it to

play05:22

16 and that seems to work closest to the

play05:24

optimal speed but because it's shared

play05:26

memory on Apple silicon anywhere from

play05:29

about 10 to 16 gets roughly the same

play05:31

results apparently with dedicated

play05:33

graphics cards you can go with a 2:1

play05:36

ratio so if it's a 16 GB card you can go

play05:39

with 32 threads the execution Q count I

play05:43

don't touch most people will probably

play05:45

keep that at one I would only try

play05:48

increasing it if you are already getting

play05:50

really good speeds but try it out with a

play05:52

small file and test it for

play05:54

yourself max memory is there more as a

play05:57

limiter leave it at zero and it will use

play06:00

as much memory as it can otherwise if

play06:02

you need a certain amount of memory

play06:04

available for other tasks on your

play06:05

computer you can change it to suit your

play06:08

needs now output path is something that

play06:10

I wish worked a little bit better you

play06:13

can see that by default it has a very

play06:14

weird path this is where any videos and

play06:18

images you create will automatically

play06:20

reside you can change it to whatever

play06:22

directory you like however I ran to a

play06:24

problem where it doesn't seem to like

play06:26

any spaces in the path and if it did

play06:28

have any spaces it would fail if I tried

play06:30

to Output anything the other problem

play06:33

that I have with it is that it doesn't

play06:34

save the path that you change it to so

play06:37

the next time you come into phas Fusion

play06:39

it will be set back to its default I

play06:42

just don't change it and I make sure I

play06:43

have easy access to the finder for that

play06:46

directory on a Mac in order to see that

play06:49

directory you need to show hidden files

play06:52

to do this type command shift period and

play06:54

again to hide them once visible you can

play06:57

easily find the V or VAR directory in

play07:01

your user directory and go from there on

play07:04

Windows and Linux I'm not sure what the

play07:06

deal is sorry but it's actually probably

play07:09

just easier to get to the options are

play07:12

pretty simple Concepts keep FPS will

play07:15

keep your output file to its original

play07:17

targets frame rate instead of converting

play07:19

it to the default 25

play07:21

FPS keep temp will make it so that all

play07:25

of the images created for each output

play07:27

before it merges them will be kept in

play07:29

the default folder therefore no longer

play07:33

temporary skip audio will strip the

play07:35

audio from your target well technically

play07:38

it just won't add it back in when it's

play07:40

creating the output file and Skip

play07:42

download is kind of a weird one that has

play07:44

little use in my opinion when you switch

play07:47

to a particular face swapper model or a

play07:49

face enhancer model it has to download

play07:51

it the first time if you have this

play07:53

selected it won't download it at least

play07:56

that's how I've come to understand it

play07:58

it's something I've never never had to

play07:59

use for but maybe useful in some case

play08:02

that I don't understand maybe if it's

play08:05

corrupt or something for the rest of the

play08:07

features we're going to need to actually

play08:09

show what is going on so I'm going to

play08:11

put in a Target I'll use a short clip

play08:13

from a Tyler hubard video with that in

play08:16

now you can see a ton of stuff lighting

play08:18

up and change so let's start from the

play08:21

top right with the preview

play08:23

window this is probably the most

play08:25

important window as it's where you can

play08:26

see any and all changes before or

play08:29

rendering out your final picture or

play08:31

video just below that is the preview

play08:34

frame slider it's currently on frame

play08:36

zero but you can slide it around to a

play08:38

different number to see a different

play08:41

specific frame in the preview window

play08:44

switching between which frame it is on

play08:46

is very useful when you have multiple

play08:48

Cuts or scenes within a single video for

play08:50

reasons I'll explain with the options

play08:52

below first with trim frame start and

play08:56

end by default they will be set to the

play08:58

first and and last frame of your entire

play09:00

clip and if you don't change it it will

play09:03

render the entire video when you hit

play09:04

start but if you only want one portion

play09:07

of the video you use the preview frame

play09:09

above to see what frames you actually

play09:11

want to render out and then set the

play09:13

start and end to those say I only wanted

play09:16

to show one quick cut of Terry Crew

play09:19

dancing I can see that at frame

play09:24

24 it starts this cut and then it ends

play09:27

at frame 40

play09:31

so I can just easily change the trim

play09:33

frame start and the trim frame end to 24

play09:37

and 40 and that way it'll only render

play09:39

out that one little cut of 16 or so

play09:42

frames under face selector

play09:45

mode you can see there are three options

play09:49

reference one and many with reference

play09:52

selected you can see the reference face

play09:55

just below that shows a bunch of

play09:57

faces to show how this Works we're going

play09:59

to need to bring in our source

play10:03

image it seemed appropriate to use

play10:06

Robert Dy Junior for this example I'm a

play10:09

dude playing a dude disguises another

play10:11

dude you might not see anything happen

play10:13

at first and that could be because it's

play10:15

trying to put the face on someone that

play10:17

was in the beginning of the clip but not

play10:19

in this shot so what you want to do now

play10:22

with reference turned on is select the

play10:25

face that you want to swap Robert Dan Jr

play10:28

on to

play10:30

you can just as easily pick someone else

play10:32

from the references because the preview

play10:34

is such a low resolution it can be

play10:37

difficult to see how much is actually

play10:38

changing until you render it out while

play10:41

still using reference let's look at the

play10:43

reference face

play10:45

distance I'm not really sure why it's

play10:47

called distance but what it does is find

play10:50

faces that are either less or more like

play10:52

the image you chose if you turn it up

play10:55

too high it will start to think everyone

play10:57

is your reference and and change

play10:59

multiple

play11:01

faces but if you turn it down too

play11:04

low it will think it's a different

play11:06

person just between frames or scenes

play11:09

with different lighting when it's still

play11:11

the same person so you'll get flashing

play11:13

in and out if it's close or just shots

play11:16

that aren't changed at all usually the

play11:19

default works great but you'll find

play11:21

reasons to play with it a bit depending

play11:23

on your video after reference is one

play11:27

this will always only pick one face from

play11:29

the entire video the trick is getting it

play11:31

to pick the one you want now if you only

play11:34

have one person in the entire video then

play11:37

it's going to be pretty simple if you

play11:39

have two three maybe still pretty easy

play11:43

but when you have more faces in the

play11:45

video especially when you get pretty

play11:46

high up this can become a huge

play11:49

paa but if you skip down to the face

play11:52

analyzers which they spell incorrectly

play11:56

here you have a few tools to try and

play11:58

pick the the one you want and these

play12:00

analyzers work for reference and mini

play12:04

also first with order given the first

play12:07

two options you'd either get the person

play12:09

on the far right or the far left of the

play12:11

picture and it's for the first frame of

play12:14

your video if it's someone not in the

play12:17

first frame good luck if we wanted to

play12:19

pick Terry Cruz top to bottom would work

play12:23

and with large to

play12:25

small I have no idea how best or worst

play12:28

are decided but in this situation if you

play12:31

wanted one of the guys just to his left

play12:33

or right I don't see how this would work

play12:36

the age analyzer it's pretty obvious but

play12:39

it will allow you to narrow down if you

play12:42

have a range of obvious age differences

play12:44

within the video if I quickly go back to

play12:47

reference you can see that accurately

play12:49

portrays them all as adults no children

play12:52

teens or seniors the last one is

play12:55

gender I shouldn't have to explain this

play12:58

one as it's the the same as age but well

play13:01

gender male or female however this one

play13:05

doesn't seem to work as well just to

play13:06

show what I

play13:08

mean if I choose

play13:12

male there's only one image and that

play13:14

looks like it's a female and for some

play13:17

reason that's it for reference if I put

play13:20

the female for some reason that thinks

play13:23

all of them including Terry Cruz is a

play13:26

female so back to the face selector

play13:30

mode let's check many what this one is

play13:33

going to do is use your Source image on

play13:36

as many faces as it can make out well

play13:38

enough and you can use the analyzers for

play13:42

exclusions 99% of the time I'm using

play13:45

reference mode and almost never use the

play13:48

analyzers there are rare occasions where

play13:50

I find them useful but not too often the

play13:53

last thing on the right side that isn't

play13:55

part of the masking is the face detector

play13:57

model section I've always left this on

play14:00

retina face however with Retina face

play14:03

selected it makes the next part the face

play14:05

detector size absolutely worthless if

play14:08

you try anything other than the than the

play14:11

default 640x

play14:13

640 it will come up as an

play14:19

error if you switch it to

play14:23

unet and then switch it

play14:25

around it will allow you to change a

play14:28

size I haven't played around with this

play14:30

much but what it seems to be is

play14:32

something that helps you select faces

play14:33

when they're too close to the edge or

play14:36

cut off normally I wouldn't use it but

play14:39

if you can't seem to get a face selected

play14:41

try this

play14:43

out as for the face detector

play14:46

score though I don't use this too often

play14:49

it can be useful this is usually good

play14:51

set to the default Center but this is

play14:54

how tight or Loosely determines what a

play14:56

face is within your image or video

play14:59

turn it down a bit to try to recognize a

play15:01

face that wasn't all that

play15:04

obvious but go too low and it will think

play15:07

all random things are

play15:10

faces turn it

play15:12

up and you'll get fewer faces which may

play15:15

be a good thing as the ones that doesn't

play15:17

pick up still probably wouldn't have had

play15:19

much of a good output anyway but go too

play15:22

high and it won't pick up

play15:24

anything now let's switch back over to

play15:26

the very first thing we looked at for a

play15:28

half second earlier frame processors

play15:31

face swapper is what you're going to

play15:33

want to use almost all of the time for

play15:35

obvious reasons this gives you the

play15:37

option of five different face swapper

play15:40

models by default it's set to ins

play15:43

swapper 128 and it's a pretty good one

play15:46

in fact maybe the best option I was

play15:50

going to let you figure it out what is

play15:51

best on your own but instead I ran a

play15:54

test of each one to show you what they

play15:55

all look like with the basic settings

play16:00

here you can see that blend swap looks

play16:02

pretty bad and it took 56

play16:07

seconds in swapper looks pretty good and

play16:10

took 15

play16:13

seconds in swapper fp16 looks marginally

play16:18

better but also took 2 minutes and 53

play16:22

seconds Sim swap 256 looks pretty bad

play16:25

but only took 15 seconds

play16:30

and the 512 unofficial took longer at 26

play16:33

seconds but looks even worse so as I

play16:37

said in swapper 128 is probably the best

play16:41

option unless time really is of no

play16:43

concern and you want the marginally

play16:45

better output of the

play16:47

fp16 and just to show you how it turns

play16:50

out if you put on the default face

play16:52

enhancer on the two good ones and the

play16:55

maybe okay one here are how they turned

play16:57

out both of the in swappers look pretty

play17:00

darn good but I don't think the face

play17:02

enhancer was able to save the Sim swap

play17:06

so definitely no point in trying the

play17:08

other

play17:11

two now that you've seen what the

play17:13

default face enhancer can do let's take

play17:16

a look at its other models and

play17:19

settings face Fusion gives you seven

play17:21

different model options I've not tried

play17:24

all of them but I'm pretty happy with

play17:26

the ones I've used like face swapper

play17:29

let's look at the outputs of the four

play17:30

that I have used first here's what the

play17:33

clip looks like without turning on the

play17:37

enhancer for not being enhanced I'd say

play17:41

it turned out pretty decent and now here

play17:43

are the four results gfp Gan 1.4 looks

play17:48

great and took 2 minutes and 3 seconds

play17:50

to

play17:51

render however it can look a bit

play17:53

plasticky depending on the

play17:55

scene code forer took a bit longer at 2

play17:58

2 minutes and 58 seconds looks a bit

play18:01

better by not looking so

play18:03

plasticky gpen bfr 512 looks almost

play18:07

identical to code former and took the

play18:09

exact same amount of time at 2 minutes

play18:12

and 58

play18:13

seconds restore former took 4 minutes

play18:17

and 2 seconds and seems to have some

play18:20

problems you can see how it even

play18:21

distorted a large portion of the clock

play18:25

so to me it's a tossup between code

play18:27

former and gpen etc for the more

play18:30

realistic film look while gfp

play18:32

gan4 is faster and also works very well

play18:35

for cartoonish and current AI videos

play18:38

being made with Pika Moon Valley and Gen

play18:41

2 Etc there's still one more setting for

play18:44

face enhancer and that's the

play18:46

blend it's default is set to 80 and

play18:49

tends to be good enough but you can put

play18:51

it down a bit to get rid of some of the

play18:53

plasticky look I never go below 50 or up

play18:56

for some reason if you want more more

play18:59

now frame

play19:00

enhancer I never use basically it's a

play19:04

video upscaler if you need your video to

play19:07

be larger in scale then maybe this will

play19:09

be useful for you you have three options

play19:11

of

play19:12

models the first one will double the

play19:14

resolution while the other two will

play19:16

quadruple the resolution so if you start

play19:18

with a 1080p it'll get 4k or 8K

play19:23

respectively I use real ESR Gan so

play19:26

either one of these two all the time for

play19:29

still images and would recommend going

play19:31

with that the main reason I never use it

play19:33

though is the additional time is kind of

play19:36

insane if you're ever wondering why a

play19:38

render is taking so long double check

play19:40

that you didn't accidentally choose

play19:42

frame enhancer instead of face

play19:44

enhancer now the last one is face

play19:48

debugger which I think should be renamed

play19:51

personally as you aren't really doing

play19:53

any debugging but this is where all the

play19:55

face masking comes into play Let's turn

play19:58

that on and see what we get so let me

play20:00

bring in a new

play20:04

Target and a new

play20:08

source just to make sure that she is the

play20:10

one that's being selected let's choose

play20:12

her in the reference face and it's

play20:15

actually doing the wrong thing right now

play20:18

it should be showing a box and not doing

play20:21

what occlusion actually does let me try

play20:24

switching those around see what

play20:27

happens

play20:28

there we go weird so now with just her

play20:32

selected you can now see a red square

play20:35

around her face that's the face mask box

play20:38

to show you which face will be swapped

play20:40

and what area will be affected as you

play20:43

can see face mask is selected under the

play20:46

face debugger

play20:48

items turn that off and the square goes

play20:52

away KPS is also turned on but it

play20:55

doesn't seem to be doing anything with

play20:57

this Frame as I believe her face is too

play20:59

small in this to show up so let's go to

play21:01

a later point in the

play21:03

clip and because I don't want this to

play21:06

get too weird let's pick a different

play21:08

Source picture for

play21:11

this you can see when I pick his

play21:13

reference face that he now has a square

play21:15

and five dots that signify where his

play21:17

eyes nose and lips are for tracking I

play21:20

think KPS stands for key points or

play21:23

something like that now let's make him

play21:26

Steve Corell

play21:30

now B

play21:31

box I'm assuming bounding box as far as

play21:35

I can tell doesn't really do anything

play21:37

other than highlight which face will be

play21:40

swapped turn that

play21:43

on okay now it's not getting any so

play21:46

maybe this is a bug and this is

play21:48

hopefully something they'll fix really

play21:49

soon but it seems whenever I actually

play21:52

put the source image in now during face

play21:54

debugger it will then completely get rid

play21:57

of all the information in the preview

play22:00

frame to see what is actually shown for

play22:03

masking so like right now if I put Steve

play22:05

car back

play22:07

in it changes the image however the

play22:10

masking information for the debugging is

play22:15

gone changing frames or whatever does

play22:17

not change that if I get rid of Steve

play22:20

krell's

play22:21

image sure enough there the information

play22:24

is back again if I choose somebody else

play22:27

let's go with Michael J

play22:29

fox it changes the image but again lose

play22:33

all the

play22:35

information so for now I'm just going to

play22:37

keep the source out of there so you can

play22:38

see what's supposed to be happening

play22:40

without the image changing and the last

play22:43

of the face debugger items is score you

play22:46

turn that on it puts up a number in the

play22:48

box and based on that number that's how

play22:50

high you can put up the face detector

play22:52

score slider and still have it select

play22:54

that face so seeing that it's 0.9 91

play22:58

right now I should be able to put it all

play23:00

the way up to

play23:06

0.9 sure enough it still shows his face

play23:10

selected if I put that to

play23:17

0.95 no longer

play23:21

selected the real reason for using this

play23:24

is maybe if you have so many people that

play23:26

are in it that looks somewhat similar

play23:27

and you want to get as close to possible

play23:29

to only selecting that person maybe you

play23:31

can fine-tune it so that it won't

play23:34

switch I don't know so now back to face

play23:38

mask let's first turn off the score and

play23:41

let's turn off the bounding box now take

play23:43

a look over on the right where all the

play23:45

masking tools are available first we'll

play23:48

take a look at the box that's titled

play23:51

face mask type as it set up now you can

play23:53

see where that square is around his head

play23:56

everything within the square can be be

play23:58

affected by the face swap including his

play24:00

jacket and shirt most likely nothing

play24:02

will happen to them with a simple shot

play24:04

like this but if you want to make sure

play24:06

not as much is affected that's where you

play24:09

can choose the different padding sliders

play24:11

to make the square smaller or larger in

play24:14

this case maybe you just want to slide

play24:16

it up a little bit from the bottom so

play24:18

you don't get so much of a shirt so you

play24:20

just do the face mask

play24:22

padding bottom and slide that over a

play24:26

little bit see how much that changes

play24:28

oh that changed the left side for some

play24:31

reason let's try that

play24:33

again okay I don't know where that came

play24:35

from but all of a sudden the left side

play24:37

is all messed up so let's do the

play24:41

left bring that in a

play24:44

bit that seems to be

play24:48

working you just want to get close you

play24:50

don't want to go over the actual head in

play24:53

any way whatsoever unless there's

play24:54

something on the face you do not want to

play24:57

be mased

play24:58

the other option is the blur this is the

play25:01

amount or I believe more accurately the

play25:05

width of the outside of the mask that is

play25:07

blurred to make the new face look more

play25:10

natural on the target video or image

play25:14

it's very difficult to see anything

play25:15

change on such a small preview that

play25:17

you'll have to test it out for yourself

play25:19

on your own

play25:20

projects now instead of the Box face

play25:24

mask type there is

play25:26

occlusion

play25:32

this seems to be a bit smarter masking

play25:35

tool and I hope it is as there are no

play25:38

settings for it with this current shot

play25:40

though there isn't much of a reason to

play25:43

use a cusion so let's take a look at

play25:46

another

play25:48

frame you can see here that the man in

play25:51

the middle has a beer mug partially

play25:53

covering his face usually this would

play25:56

have been a big issue and caused weird

play25:58

artifacting now with

play26:00

occlusion let me first select his

play26:04

face you can see how it automatically

play26:06

mask out the mug with zero work go back

play26:09

a few

play26:12

frames and you can see how the mask

play26:14

opens up at the bottom as more of his

play26:17

face is

play26:18

revealed and for the final option which

play26:20

is

play26:23

region let's bring in one last

play26:26

clip

play26:34

this is what you use if you don't want

play26:36

something to change say you want to keep

play26:38

someone's crazy eyes or keep their

play26:40

specific eye color and the way they look

play26:43

around you can turn off the

play26:47

eyes and they won't be affected by the

play26:50

swap looking at the other options I'm

play26:53

sure you get the idea you can of course

play26:55

also use the different face mask types

play26:58

at the same time so if you like those

play27:00

eyes but he's drinking a beer at the

play27:02

same time use both occlusion and

play27:26

Regen

play27:39

anyway I think that's more than enough

play27:41

for now if you have any questions please

play27:44

feel free to ask in the comments I

play27:47

appreciate you watching the video please

play27:50

like subscribe and leave a comment below

play27:53

have a wonderful day and take

play27:56

care

Rate This

5.0 / 5 (0 votes)

Related Tags
Face FusionVersion 2.1.1Installation GuideFace SwappingVideo TutorialSoftware UpdateVirtual EnvironmentGPU OptimizationFace EnhancementTech Tutorial