Alpaca: AI Art Plugin for Photoshop (better than Generative Fill!)

Summary

The video script introduces Alpaca, an AI plugin for Photoshop that offers a range of tools for image generation and manipulation, including sketch conversion to images, style transfer, and upscaling. It highlights the plugin's ability to train custom models and integrate seamlessly with Photoshop. The user demonstrates the process of generating images from sketches and adjusting settings for different outcomes, showcasing the plugin's versatility and potential for creative enhancement in digital art and design.

Takeaways

• 🎨 Alpaca is an AI plugin for Photoshop that offers a range of tools beyond generative fill, including custom model training.
• 🔗 It's currently free to try, and users can join the beta and download the plugin from alpaca.ma.com.
• 🖌️ Alpaca enables conversion of sketches to images, offering various models like Stable to Fusion 1.5, and Packa 1 2 and 3.
• 🌟 The plugin features options to adjust sketch and color strength, and to generate images based on prompts and references.
• 📷 Alpaca can upscale images up to 4X the resolution without significant loss of quality, making it suitable for AI art enhancement.
• 🎭 The sketch tool allows for the generation of images based on user-drawn sketches, with the ability to fine-tune the output's style and detail.
• 🎨 The transfer tool can apply styles from one image to another, while the imagine function can generate new images based on prompts and model selection.
• 🔄 The plugin includes depth and edge detection features, which can be used for creating masks and other effects in Photoshop.
• 📚 Alpaca provides extensive documentation on its website to help users understand and utilize the plugin's features effectively.
• 💡 The plugin's versatility makes it a powerful addition to Photoshop, offering unique capabilities for image generation and manipulation.
• 🎥 The video provides a demonstration of how Alpaca can transform simple sketches into detailed images and how it can upscale lower resolution images.

Q & A

What is the main topic of the video transcript?

The main topic of the video transcript is an introduction and tutorial on using the Alpaca AI plugin for Photoshop, which offers various features such as image generation, sketch conversion, and style transfer.

How does the Alpaca plugin integrate with Photoshop?

The Alpaca plugin integrates with Photoshop by being downloaded and installed. Once installed, it appears in the top menu under 'Plugins', and users can access its features by logging in with their Alpaca account.

What are some of the tools and features available in the Alpaca plugin?

The Alpaca plugin offers tools for image generation, sketch conversion, style transfer, and more. It also allows users to train their own custom models for use in Photoshop.

How can users try out the Alpaca plugin?

Users can try out the Alpaca plugin for free by visiting alpaca.andma.com, joining the beta, and downloading the plugin for installation.

What is the process for converting a sketch to an image using the Alpaca plugin?

To convert a sketch to an image, users import their sketch into Photoshop, select it, and use the 'Sketch' tool in the Alpaca plugin. They can then adjust settings like sketch strength, color strength, and prompt to generate an image based on the sketch.

How does the 'Imagine' feature of the Alpaca plugin work?

The 'Imagine' feature allows users to generate images directly within Photoshop by selecting an area or the entire canvas and providing a prompt. Users can choose from different models and adjust settings to create unique images.

What is the 'Upscale' feature of the Alpaca plugin and how does it enhance images?

The 'Upscale' feature enhances the resolution of images by increasing their size without significant loss of quality. It can upscale images up to 4X the original resolution, adding detail and improving the image for uses like printing or high-resolution displays.

How can the 'Depth' feature of the Alpaca plugin be utilized?

The 'Depth' feature creates depth maps from images, which can be used for various effects such as isolating areas of an image or creating masks with different levels of transparency based on the distance of objects in the image.

What are some of the different models available in the Alpaca plugin for generating images?

The Alpaca plugin offers different models like Stable, Fusion 1.5, and Packa 1, 2, and 3. Each model provides a unique style of image generation, allowing users to experiment and achieve different visual outcomes.

How does the Alpaca plugin handle image references when generating new images?

The Alpaca plugin can reference images when generating new ones through its 'Imagine' function. Users can input a prompt and also select a reference image to guide the style, pose, depth, or edges of the generated image.

What additional resources are available for users to learn more about the Alpaca plugin?

Alpaca provides extensive documentation on their website, which includes guides for installation, tutorials on using the plugin's features, and information to help users understand and utilize the platform more effectively.

Outlines

00:00

🎨 Introducing Alpaca: The Advanced Photoshop Plugin

The paragraph introduces Alpaca, an AI plugin for Photoshop that offers a significant improvement over the generative fill function. It highlights Alpaca's capabilities, including image generation, custom model training, and various tools for enhancing Photoshop's functionality. The speaker provides a step-by-step guide on how to access, download, and integrate Alpaca into Photoshop, emphasizing its ease of use and the availability of a beta version. The paragraph also touches on the unique feature of converting sketches to images, demonstrating the process with a drawn warrior and other examples, and discusses the different models and settings available within Alpaca for generating images based on user prompts and sketches.

05:02

🖌️ Experimenting with Sketch-to-Image Conversion

This paragraph delves into the process of converting sketches to images using Alpaca's sketch tool. The speaker shares their experience with generating images based on a cartoony cat and an abstract drawing, adjusting settings like sketch strength and prompt strength to achieve desired results. The versatility of Alpaca's image generation is showcased by the ability to fine-tune prompts and generate images with a Pixar style or a 3D render. The paragraph also explores the option of using the sketch tool to enhance existing images and the potential for creating unique textures and effects by combining different settings.

10:02

🚀 Advanced Features and Upscaling with Alpaca

The final paragraph discusses Alpaca's advanced features, including the ability to upscale images up to 4X resolution without significant loss of quality. The speaker demonstrates the effectiveness of the upscaler on both AI-generated art and personal photos, highlighting its potential for print use. The paragraph also touches on the depth mapping feature, which creates depth maps from images for various applications, such as isolating areas for masking effects. The speaker emphasizes the educational resources available on Alpaca's website for users to learn more about the platform and encourages viewers to explore Alpaca's capabilities further.

Keywords

💡Photoshop

Photoshop is a widely used raster graphics editor developed and published by Adobe Inc. It is primarily used for image editing and manipulation, providing tools for tasks such as photo correction, graphic design, and digital art. In the video, Photoshop serves as the platform where the Alpaca plugin is integrated and utilized to demonstrate its features and capabilities.

💡Generative Fill

Generative Fill is a feature in Adobe Photoshop that uses artificial intelligence to fill selected areas with content that matches the surrounding context. It is designed to help users quickly and efficiently fill in gaps or create new areas within an image. However, the video suggests that while it is handy for some tasks, it may not always produce the desired results.

💡Alpaca

Alpaca is an AI plugin for Photoshop that offers a range of tools for image generation, manipulation, and even training custom models. It is presented as a significant improvement over Photoshop's native Generative Fill, providing more control and options for users to create and modify images.

💡AI Plugin

An AI plugin is a software extension that integrates with a primary application, like Photoshop, to provide additional features and functionalities powered by artificial intelligence. These plugins use machine learning algorithms to enhance the capabilities of the host application, often for tasks like image recognition, content creation, and automation.

💡Image Generation

Image generation refers to the process of creating new images from scratch or transforming existing ones using AI algorithms. This can involve generating entirely new visual content or modifying aspects of an existing image to produce a desired outcome. In the context of the video, image generation is a core feature of the Alpaca plugin, allowing users to create images based on textual prompts or sketches.

💡Sketch to Image

Sketch to Image is a feature within the Alpaca plugin that converts hand-drawn sketches into detailed images. This process leverages AI to interpret the sketch's lines and shapes and generate a corresponding digital image, often with a level of detail and realism that goes beyond the original sketch.

💡Style Transfer

Style transfer is a technique in AI and machine learning that re-creates the artistic style of one image and applies it to another image, resulting in a new image that combines the content of the original with the artistic characteristics of the style reference. This is often used to create visually striking images that mimic the look of famous artists or specific artistic styles.

💡Upscaling

Upscaling refers to the process of increasing the resolution of an image while attempting to maintain or improve its visual quality. This is often done using AI algorithms that can predict and fill in details that would have been lost when the image is enlarged. In the context of the video, upscaling is one of the capabilities of the Alpaca plugin, allowing users to enhance the quality of their images for better print or digital display.

💡Depth Map

A depth map is a visual representation that encodes the distance of objects from the viewer or camera in an image. It is typically used in 3D graphics and visual effects to determine the order in which objects should be displayed to create a sense of depth. In the video, the Alpaca plugin's depth map feature generates such maps from regular images, which can be used for various creative purposes, including advanced masking and image manipulation.

💡Custom Models

Custom models refer to AI models that have been trained or adjusted by the user to perform specific tasks or recognize particular patterns according to their needs. These models can be tailored to the user's preferences or the specific requirements of a project, offering a higher degree of personalization and control over the AI's output.

💡Beta Sign Up

Beta Sign Up refers to the process of enrolling in a testing phase for a new software or plugin before its official release. Beta versions are typically made available to a select group of users who can provide feedback and report issues, helping developers improve the product before its full launch.

Highlights

Alpaca is an AI plugin for Photoshop that offers a range of tools beyond generative fill, including custom model training.

Alpaca is free to try and integrates seamlessly into Photoshop, providing a panel with various features such as image generation, sketch conversion, and style transfer.

The sketch to image conversion feature is particularly notable, allowing users to draw sketches and then generate images based on those sketches.

Alpaca offers different models like Stable to Fusion 1.5, Packa 1 2 and 3 for varied image generation styles.

Users can adjust settings like sketch strength, color strength, and prompt strength to fine-tune the generated images.

Alpaca allows referencing visible layers for color information, enhancing the generated images with more accurate color representation.

The plugin enables users to generate images with specific prompts, such as 'powerful, angry warrior with horns', and adjust the output based on the sketch's accuracy and style.

Alpaca's rough sketch setting provides more freedom in the generated image, allowing for a less rigid and more creative interpretation of the sketch.

The ability to upscale images is a standout feature, with Alpaca capable of increasing the resolution up to 4X without significant loss of quality.

Alpaca's depth feature creates depth maps from images, which can be used for various effects and masking techniques.

The plugin includes an imagine function that works as an image generator, offering models like Alpacka 3 for diverse image creation.

Users can reference images when using the imagine function, allowing Alpaca to replicate poses or depths from the reference image in the generated content.

Alpaca's style transfer feature enables the transferring of styles from one image to another, creating unique visual effects.

The plugin's interface is user-friendly, with a toolbar that provides easy access to all its features once logged in with an Alpaca account.

Alpaca's pose feature captures the pose of an image, allowing users to generate images with the same pose in different styles.

The hard edge feature identifies and works within the edges of an image, offering another layer of creative control for image generation.

Alpaca's website provides extensive documentation to help users understand and utilize the plugin's full capabilities.

The plugin's versatility makes it suitable not only for AI art creation but also for enhancing and working with photographs.

Transcripts

when using Photoshop the generative fill

function is actually incredibly handy

for handling some things but is not that

great at others but I have a solution

today for you that can help this is

alpaca an air plugin for Photoshop and I

believe is a big step up from generative

fuel in many areas it has a lot of tools

not only just for generating images but

even training your own custom models to

use in Photoshop now alpaca are the

sponsor for today's video but if you

want to check it out it's free to try

right now head to alpaca and ma.com join

the beta sign up and then you can

actually download the plugin and install

it it'll integrate itself into Photoshop

and once you open Photoshop all you got

to do is head up top a to plugins

alpaca and then you get this little

panel over here and you just got to log

in with your alpaca account you just set

up then the alpaca toolbar is good to go

you've got your imagine for image

generation sketch for converting to

sketches transfer transferring Styles

and a few other really cool options in

there one thing you also notice is there

different models like stab to Fusion 1.5

or Packa 1 2 and 3 and you got some

Advanced options down here for when

you're generating images but one thing I

wanted to touch on really quickly is

actually converting sketches to images

first cuz I believe this is one of the

coolest features that this program

actually has so you can actually start

to draw an image or I'm going to draw a

few images and actually import them and

we're going to test this out so I can

show you exactly how it works so on my

tablet I decided to kind of draw up this

uh Warrior just a little bit of detail

nothing too insane but I've also dra on

some other images that a little bit more

basic to see what we can make happen

this abstract image which is just a few

lines there's a bit of a face in there

but it's supposed to be sort of more

abstract and a very rough cartoony

looking cat not my best drawing but uh

still something I think we can have a

play with to see what results we can get

but also I've got this image here which

is the hand and the envelope and the

actual prompt for this with the sketch

tool was just a creepy hand coming out

of an envelope and that's how we were

able to get this result right here which

I think is pretty cool but coming back

to our comic book man let's do that one

and see what we can make happen I click

on alpaca over on the right over here

choose sketch and from here this is

where I can start to work now there's a

few options I can just simply type in my

prompt here but we've also got some

settings such as how many images we want

to produce I'm going to go down to two

we go three our sketch setting we got

accurate rough or doodle we can see what

the difference is on some of these and

the sketch strength color strength we

can say if we want to use colors so you

can tile prompt strength uh you can

actually if there's visible layers you

can put use colors in that and you'll

actually reference that for those colors

but let's start off nice and basic with

the default

settings and let's type in powerful

angry warrior with horns on his head and

we're going to say wearing a headband

and we have to select so hit C contr A

to select the whole canvas and I hit

generate and we've got our options over

here on the right now I can just just

click to add one or I can add all of

these at once I'm going to scroll

through I'm going to add them all in and

now if you go to our last palette we

have a group here with our images in

there you can see the first one looks

pretty cool he's got glowing eyes and

there's fire around him the second one's

similar a little bit sort of uh

different with the eyebrows but still

very interesting and then this one

looking a little bit more like a sketch

I think number one is the best it has

the best look to it but what happens

when we change up some of these options

I'm going to turn off this group to

bring back our drawing so it references

that for the generation I head over to

alpaca and I'm going to come down and

where our sketch settings are accurate

we're going to go rough and see what

that gets us so added them all in and

this is what rough has gotten us some

cool results again a little less full on

if I compare it to what we had before

it's still very similar but uh just a

different sort of way it's handled the

image if we check the description what

we want to do is actually more

accurately tell the generator what kind

of image we're using so this is actually

to to basically Supply information about

the image but what if we decide to bring

the sketch strength down so we're at one

what if we pop it to down to about .5

and then we'll go with accurate come

back to our layers turn off that group

and the other just select our image so

now we're actually going to reference

the strength less see what kind of

different results we get from that so

referencing the image less it's actually

allowed a little bit more freedom with

the character it still followed some of

the basic framing but the we've gotten

are a little bit Freer and probably a

little bit more coherent so if our

sketches aren't quite as good as we need

them to be this could be a great way to

hand over some of the accuracy and some

of the positioning of the elements of

the image to alpaca so I think the first

of the second ones seem to be the best I

do really like that first one but here's

something I discovered Again by accident

is now that I have created that I can go

back into sketch and go back to

tools and now that I have this selected

I can actually use the same settings on

top of that image to generate something

different so now it's actually evolved

by basically using the image generated

as reference to take another image so

this image again this is a really really

solid image the teeth are a little funny

but overall everything looks really

crisp the lighting on the side the

muscles uh does a really great job and

it you don't always have to use it

exactly as intended you can always play

with things a little further to see what

you get and it's the image quality and

really unique tools like this I think

makes alpaca just a bit of a step up

from generative fill but let's move on

to the cat so I have the cat here pretty

straightforward I'm going to go into

alpaca into tools and sketch this time

I'm going on a cartoony cat drooling

wearing a

hat Pixar style and I'm going to select

the whole image and we're going to go

down to our options we've got accurate

I'm going to bring the sketch strength

up to about 8 and again I want the

colors up and the prompt strength I'm

going to bring that up cuz I want it to

reference what I'm saying saying as well

you can adjust these settings and

experiment with them but let's generate

and see what results we get as you can

see it's kind of got that Pixar style uh

a little bit not quite 3D but overall

the style I think is pretty cool uh the

the tongue looks a bit funny on this one

but um let's see what else we can make

happen with this image this time I

decreased the image accuracy and made

the prompt a bit longer I added tongue a

3D render from a PIX Pixar movie in

there and that way it's got a bit more

coherent imagery but still references

the general feel and look of the image I

provided so that's a pretty handy

feature we're going to try the last one

very quickly with abstract this time I'm

going to alpaca go on to tools and I'm

going to just say abstract

art so this looks completely different

because we actually had the sketch uh

accuracy down so I'm actually going to

go back in and crank that up I'm going

to change doodle to accurate and

generate so you can see now we've

cranked up that accuracy and we've got

something that actually matches our

image a bit more so we're able to create

and control a bit of of abstract imagery

just by drawing some basic lines but

what about adding an element to it I've

added an abstract metallic layers and

then texture or metallic texture to find

tune and see what we can make you can

see it's actually gone for a bit of a

gold look so giving it that metallic

texture has allowed me to sort of create

a bit of a weird effect with with metal

so being able to sort of create some

unique textures from your drawings could

be a really really handy idea and I

thought I'd just try that with the

warrior to see what kind of results we

get that way and these are pretty

interesting now let's not forget if I

create a blank document here I can still

select the whole thing and use alpaca

basically like an image generator I can

go straight into imagine here I have

alpaca version 3 I can choose any one of

these models and I can give it a prompt

such as a cyberpunk waterfall now as

usual I can add one by one or add all

which is what I've done here and it

actually it does a pretty good job just

as an image generator straight up that

is a pretty cool image other pretty cool

images in

there so you can see the power of this

platform for all sorts of things Beyond

just sketches and that you've got image

generation and again we can change up go

back tools go from alpaca 3 to stable to

fusion and see what we get so by

switching to stable to Fusion 1.5 we'

got a completely different style of

image

again something nice very different and

of course you got the other alpaca

versions you can play with those and see

what kind of images we get but I can

reference images also when using the

Imagine function so I've got an image in

my document here selected my prompt of a

powerful or stepping out to a doorway of

the sun anime style and under here it

says reference image I'm going to turn

that on and choose pose and it will try

and copy the pose of the image whereas

some of these other ones such as depth

will capture the depth of the image and

hard Edge actually finds like the edges

of the image and works within that but

we want to kind of get that pose so

let's generate that and see what we get

you see this one here stepping out the

sun into the doorway exact same pose as

this and again stepping out so another

pretty cool effect but let's head back

to tools and go from pose to hard Edge

and I'll show you how it really

replicates if I turn these off that

outline you can see we have another

example here of How It's replicated that

pose and if I turn off that layer it's

in the exact same spot I can take this

bring the opacity down you can see how

it overlays so you got a few different

options there to reference images as

well like I said you got depth other

bits and pieces there so uh have a play

with that and see what kind of images

you can come up with one thing I want to

say also is that these images are 1024x

1024 and you can't generate anything

larger than 1024 x 1024 when using this

tool if your selection is larger than

that it alls you to decrease the size of

the selection however one thing the

alpaca does have which is really cool is

upscale so I can actually upscale what's

on this document so I'll upscale it open

a new document we can go by two up up to

sort of four I believe eight or 16 are

in the works but um at the moment we can

go a 4X upscale so let's choose go back

here I reckon this is probably the best

image I'm going to go back in alpaca and

upscale this to four times the

resolution so looking at this image if I

zoom in it has done a pretty decent job

of adding some detail and it hasn't just

simply pixelated that image but if I

have the original image here I'll turn

on you can see how much it's improved

that upscale

some of the information is uh a little

bit altered but I believe if you're

looking for a good up cheap upscaler

this is definitely a good option but

what about if I want to take that

upscaler for something other than AI art

okay I have this image of me which I use

for a lot of my social media accounts

it's a little over 600 by 600 pixels um

so you can see the quality is not great

let's give our Packer a try upscale and

at the moment we can go up to 4X and

let's see what the image looks like once

it's been UPS go so now our image is

2428 by

2428 and it has smoothed things out a

little bit it's done a pretty decent job

while it doesn't look 100% perfect you

can see that it would be useful useful

for print or something like that however

the image it was working with wasn't

great to begin with so I think it's done

a pretty good job now this is something

where I think when it comes to AI

enlargement this will be excellent for

what you're creating and it may may

still be suitable for photos but

definitely best for the AI art side of

things so it definitely works well in

with the package so I think that uh

that's a pretty powerful option for

alpaca users this upscale feature and

next we're going to look at depth depth

is a little more basic in the sense that

what it does is it creates depth maps of

areas so I've got this image here by

going into alpaca and depth I can choose

the entire document or the selected area

I hit generate and you see how it's

created a depth map out of that image so

what happens if we get a more detailed

image and try that so we have this crowd

image we've got some people up close and

people further away this should really

sharp something a little bit different

so this time I'm going to take the whole

do document I'm going to generate that

depth and we've got this here now this

can be used effectively to uh in various

platforms I can use it to isolate

certain areas of an image so let's say I

copy this I'm going to turn off this

layer I'm going to actually create a

quick mask paste that in I exit my quick

mask and then I create a map and you can

see how it creates like this cool effect

where we've kind of ghosted the closer

stuff is closer

is sort of more visible the stuff is

further away is obviously more

transparent so by popping say a color in

the

background you can see what I mean you

actually use it for pretty cool masking

effects there's more to it than this but

this is just one thing you can do you

can also adjust this mask so I can

actually go into the mask itself grab my

levels and because I've got the mask

selected I can play with some of those

levels a bit isolate certain parts of

the image and create some pretty nifty

effects that way even have like a bit of

a like a Mist effect if I wanted to do

it that way as well so you do have some

that's a pretty cool sort of feature to

play with probably the least exciting of

all of them but still a lot of fun but

uh it's a very simple one I highly

recommend checking that out so check out

alpaca like I said they are sponsoring

this video but it is a really powerful

plugin for Photoshop if you check out

their website they have a whole bunch of

documentation there something a lot of

AI platforms seem to miss when they

first launch everything is in here if

you have any trouble even just

installing the plugin there's a lot of

information here you can follow to

actually learn the platform more in

depth I've only really chipped away at

the surface so uh check it out let me

know what you think otherwise I hope you

enjoyed the video found it interesting

if you did please consider giving it a

like otherwise I hope to see you again

soon have a great

day

[Music]