ExcaliAI Enhanced: More Visual Thinking Power

Zsolt's Visual Personal Knowledge Management
23 Dec 202330:19

Summary

TLDR在这段视频中,Jolt介绍了exol AI,一个在Obsidian中可用的脚本,它利用OpenAI的能力进行图像生成和编辑。Jolt展示了exol AI的新功能,包括从图像和提示生成恐怖风格的图像,以及创建不同风格的图像版本。他还演示了如何编辑图像,例如添加遮罩,并展示了如何通过exol AI生成与特定内容相关的图像,例如为每日名言创建图像。此外,Jolt还介绍了如何使用exol AI生成思维导图,解释白板图像,并尝试了代码生成。他强调了在使用过程中需要手动保存图像,因为OpenAI提供的URL在30分钟后会失效。最后,Jolt提供了如何安装exol AI,设置API密钥,并开始使用exol AI的步骤。他鼓励观众尝试这个工具,并在评论中分享他们的想法。

Takeaways

  • 🎨 **Exol AI 功能展示**:Exol AI 是一个在 Obsidian 中可用的脚本,用于展示和增强图像生成能力。
  • 📈 **用例多样化**:Exol AI 支持多种用例,包括从图像和提示生成图像、编辑图像、生成插图、创建思维导图、代码生成等。
  • 🔍 **逻辑流程透明**:用户可以稍微了解 Exol AI 的逻辑流程,以便更好地使用该工具。
  • 📝 **安装与设置**:介绍了如何安装 Exol AI,设置 API 密钥,以及如何开始使用。
  • ⏱️ **图像生成时间**:图像生成可能需要一些时间,取决于 OpenAI 的响应时间。
  • 🔗 **URL 有效期**:由 OpenAI 生成的图像 URL 将在 30 分钟后删除,用户需要手动保存图像以保留。
  • 🖼️ **图像编辑功能**:Exol AI 允许用户对图像进行编辑,如添加遮罩或更改提示来生成新的图像区域。
  • 🌐 **网络资源利用**:用户可以将网络图片与图标结合使用,通过 Exol AI 生成新的图像。
  • 💡 **创意启发**:Exol AI 可以用于视觉头脑风暴,通过生成与白板内容相关的图像来激发新的想法。
  • 🔧 **实验性功能**:Exol AI 还包括一些实验性功能,如将草图转换为形状,尽管这些功能可能需要进一步的调整和完善。
  • 💰 **成本考虑**:使用 Exol AI 生成图像需要在 OpenAI 上有一定的余额,但成本相对较低。

Q & A

  • 什么是exol AI?

    -exol AI是一个在Obsidian exol脚本商店中可用的脚本,它能够根据用户提供的提示或图像生成图像,并支持多种图像编辑和生成功能。

  • 如何将exol AI添加到Obsidian的侧边栏?

    -在Obsidian工具面板中找到exol AI,长按它,然后它会被添加到侧边栏,方便快速访问。

  • 使用exol AI生成图像时,需要注意哪些事项?

    -生成图像需要一些时间,因为这个过程依赖于Open AI的响应时间。另外,生成的图像以URL形式提供,且该URL在30分钟后会被删除,因此需要下载保存到本地以保留图像。

  • exol AI是如何生成图像的?

    -exol AI通过将用户的图像或提示发送给Open AI的vision接口,获取一个详细的提示,然后使用这个提示在Dolly上生成图像。

  • exol AI支持哪些图像生成风格?

    -exol AI支持多种图像风格,包括科幻、童话、山中小木屋、简单生活、梵高极简主义铅笔画、Unsplash照片风格以及黑白照片风格等。

  • 如何使用exol AI编辑图像?

    -exol AI允许用户添加遮罩到图像上,然后选择编辑图像的选项。在编辑模式下,用户可以调整遮罩来指定图像生成的区域。

  • exol AI如何帮助生成每日引语的图像?

    -用户可以通过选择'generate an image to illustrate a quote'的选项,然后粘贴或输入想要生成图像的引语,exol AI将自动生成与引语相匹配的图像。

  • exol AI是否支持代码生成?

    -是的,exol AI支持代码生成,用户可以提供应用程序的描述作为提示,exol AI将生成相应的代码框架。

  • 如何安装并开始使用exol AI?

    -首先需要在Obsidian工具面板中安装exol AI脚本,然后创建并配置Open AI的API密钥,最后在Obsidian的插件设置中配置该API密钥以启用exol AI的功能。

  • exol AI的使用成本如何?

    -使用exol AI会产生一定费用,因为需要使用Open AI的服务。费用根据生成图像的数量和复杂度而定,但据视频中的描述,成本相对较低。

  • exol AI支持哪些额外的图像生成用例?

    -除了基本的图像生成和编辑,exol AI还支持创建EXC colid draw形状、视觉头脑风暴、生成引语插图、制作思维导图等用例。

  • 为什么需要手动保存由exol AI生成的图像?

    -因为生成的图像是以URL形式提供的,如果不手动保存,URL将在30分钟后失效,导致图像无法访问。因此,用户需要主动下载保存图像以避免丢失。

Outlines

00:00

🎨 exol AI 功能展示及安装指南

本段落介绍了exol AI,这是一个Obsidian插件,可在exol draw脚本商店中获取。作者展示了过去几周对脚本所做的增强,并通过多个示例展示了exol AI的能力。接着,作者将更系统地介绍当前实现的各种用例,并简要介绍了exol AI的逻辑流程,最后说明了如何安装exol AI,设置API密钥,以及如何开始使用exol AI。

05:00

🖼️ 用exol AI编辑图像和生成图像

在这一段落中,作者展示了如何使用exol AI编辑图像,包括添加遮罩和选择不同的提示来生成新图像。还提到了OpenAI生成图像的限制,如图像必须是正方形,以及如何保存生成的图像以避免30分钟后被删除。此外,作者还展示了如何通过不同的提示来生成多种风格的图像。

10:03

📈 使用exol AI生成插图和思维导图

作者介绍了exol AI的更多功能,包括生成插图来说明引用、创建思维导图来解释白板图像,以及挑战现有的想法。还讨论了如何通过编辑mermaid脚本来手动修正由OpenAI生成的图表,以及如何通过选择不同的元素和任务来生成图像或执行其他操作。

15:05

💡 exol AI的创意应用案例

这一段落展示了exol AI在创意领域的应用,包括将图标和图片结合生成新图像,以及使用不同的功能来生成代码、创建和编辑图像、生成EXC colid画形状等。作者还分享了在实验中遇到的挑战,如有时需要去除背景颜色或使部分透明。

20:07

🛠️ exol AI的使用案例和工作原理

作者概述了exol AI的三个主要使用领域:Web开发、图像创建和编辑、以及生成新想法。讨论了如何通过选择画布上的元素和选择任务来构建提示,以及如何根据不同的任务预览不同的图像。还提到了如何通过GPT Vision和Dolly生成图像,并强调了保存图像的重要性。

25:09

🚀 开始使用exol AI的步骤

最后,作者详细介绍了如何开始使用exol AI,包括从脚本库安装exol AI、在OpenAI创建账户并充值、配置OpenAI API密钥,以及在Obsidian中设置exol AI。还提到了生成图像的成本,并鼓励观众尝试使用exol AI并分享他们的反馈。

30:10

📝 观众反馈和感谢

在视频的最后,作者鼓励观众尝试exol AI并在评论区分享他们的想法。作者表达了对exol AI的喜爱,并认为尽管需要一些费用,但所带来的价值是巨大的。

Mindmap

Keywords

💡exol AI

exol AI 是一个脚本,可用于Obsidian软件中的exol draw脚本商店。它是一个多功能工具,允许用户通过不同的提示和图像生成各种风格的图像,编辑现有图像,生成代码,以及创建思维导图等。在视频中,exol AI 被用来展示如何将简单的草图转换成具有特定风格的图像,以及如何通过OpenAI的API生成图像和文本内容。

💡Obsidian

Obsidian 是一款知识管理和笔记软件,用户可以在这个平台上使用各种插件和脚本来增强其功能。在视频中,Obsidian 被用作exol AI 脚本的运行环境,展示了如何通过Obsidian的界面来操作和生成内容。

💡图像生成

图像生成是exol AI的核心功能之一,它允许用户通过提供草图或提示来创建图像。在视频中,图像生成被用来从简单的草图创建恐怖、科幻、童话等不同风格的图像,展示了exol AI的强大创意能力。

💡API 密钥

API密钥是使用OpenAI服务时所需的一种授权凭证。在视频中,为了使用exol AI 脚本,用户需要在OpenAI上创建账户,充值,并生成一个API密钥,然后在Obsidian的插件设置中配置这个密钥以启用exol AI的功能。

💡编辑图像

编辑图像是exol AI 提供的一个功能,允许用户对已生成的图像进行修改。在视频中,编辑图像被用来向图像添加遮罩,或改变图像的某些部分,如将房子变成摩天大楼,展示了exol AI 在图像编辑方面的灵活性。

💡系统提示

系统提示是exol AI 使用过程中的一个组成部分,它指导OpenAI如何根据用户提供的提示生成内容。在视频中,系统提示被用来定制生成的图像或文本,用户可以根据需要修改系统提示以获得期望的结果。

💡用户提示

用户提示是用户给exol AI提供的具体指令或要求,它决定了生成内容的主题或风格。在视频中,用户提示被用来生成与特定主题相关的图像或文本,如生成与日常引用相关的图像。

💡视觉头脑风暴

视觉头脑风暴是一种利用图像来激发创意和思考的方法。在视频中,视觉头脑风暴被用来生成与白板内容相呼应的图像,以此激发更多的创意和思考。

💡代码生成

代码生成是exol AI 的一个实验性功能,它可以根据用户的描述生成代码。在视频中,代码生成被用来创建一个计算器的代码,展示了exol AI 在编程领域的潜在应用。

💡excol draw

excol draw 是Obsidian中的一个绘图工具,可以用来创建和编辑图形。在视频中,excol draw 被用来展示如何将草图转换成图形元素,如将手绘的圆形转换成计算机图形。

💡mermaid 图

mermaid 图是一种用于生成图表的工具,它允许用户通过文本描述来创建图表。在视频中,mermaid 图被用来生成思维导图,展示了如何将图像内容转换成结构化的图表形式。

Highlights

exol AI 是一个可在 Obsidian exol 脚本商店中获取的脚本,用于展示其在图像生成和编辑方面的不同增强功能。

通过选择不同的模型和提示词,exol AI 能够生成各种风格的图像,如恐怖、科幻、童话等。

图像生成过程耗时较长,因为依赖于 OpenAI 的响应时间。

生成的图像会通过 OpenAI 提供的 URL 获取,但该 URL 会在 30 分钟后删除,用户需要及时保存图像。

exol AI 可以将用户上传的图像和提示词发送到 OpenAI 的视觉接口,生成详细的提示并用于图像生成。

用户可以通过编辑图像用例,如添加遮罩或更改提示词,来编辑现有图像。

展示了如何使用 exol AI 编辑图像,包括添加遮罩和选择不同的提示词来改变图像内容。

exol AI 支持创建日常引用的图片,通过自动化过程减少了手动创建图片的时间。

用户可以通过系统提示和用户提示来定制图像生成的结果。

exol AI 能够生成思维导图,挑战现有思维并添加新的想法。

展示了如何使用 exol AI 将草图转换为代码,实现从设计到开发的快速转换。

exol AI 允许用户通过提供应用描述来生成 Web 应用的线框图到代码。

exol AI 的图像生成功能可以与互联网上的图标和图片结合使用,创建新的图像。

总结了 exol AI 的三个主要用例领域:Web 开发、创建插图和生成新想法。

exol AI 支持从提示生成图像、视觉头脑风暴和创建思维导图等附加用例。

介绍了如何使用 exol AI 的不同功能,包括选择画布元素、选择任务、提供文本提示和修改系统提示。

强调了用户需要手动保存生成的图像以避免丢失,因为 OpenAI 不会自动将图像保存到 Vault。

提供了如何开始使用 exol AI 的步骤,包括从脚本库安装、设置 OpenAI 账户和 API 密钥以及配置 Obsidian 插件。

强调了 exol AI 在工作流程中的应用价值,尽管需要一些成本,但所带来的图像、思维导图和工作流程的好处是非常有价值的。

Transcripts

play00:00

hey everyone jolt here exol AI is a

play00:04

script available in the obsidian exol

play00:06

draw script store and today I'd like to

play00:10

show you the different enhancements I've

play00:12

made to the script over the last couple

play00:15

of weeks first of all we're going to

play00:17

look at a number of examples to Showcase

play00:21

what exol AI is capable of then we're

play00:25

going to take a bit more structured look

play00:27

at the various use cases currently in

play00:30

implemented we're going to look under

play00:32

the hood just a little so you have an

play00:36

understanding of the logic flow of how

play00:39

to use exol Ai and finally we're going

play00:42

to look at how you can install it how

play00:45

you can set up your API key and how you

play00:48

can get started with excal AI so let's

play00:51

start with this example so I have this

play00:54

drawing here I'm going to start exol AI

play00:58

right here so it's in the obsidian tools

play01:00

panel and if I scroll down here you will

play01:04

find the robot here that's xol AI

play01:07

because we are going to use this

play01:09

frequently today I'm going to long press

play01:11

on this and by long pressing on it it

play01:15

was added here to the side panel so it's

play01:17

easier to access and now I'm going to

play01:20

click on this and here for the first

play01:23

example I'm going to choose the model

play01:27

that I want to generate an image from

play01:29

from an image and a prompt and here I'm

play01:33

going to just add

play01:36

horror I think that's enough so I want

play01:39

to create a horror image of this here I

play01:43

can set the size I'm actually going to

play01:46

set this to be portrait and here's an

play01:49

important notice that I'm going to

play01:51

explain as this generates note the

play01:55

generation takes quite some time because

play01:59

this depends deps on open AI response

play02:01

times the note I wanted to make is when

play02:05

the image is generated you receive the

play02:08

image with a URL from open AI that URL

play02:13

is going to be deleted after 30 minutes

play02:18

so if you want to keep the image then

play02:20

you will need to do the following you

play02:23

will need to right click on the image

play02:26

and you need to choose save image from

play02:29

your L to local file when I do this then

play02:33

the image was saved locally now take a

play02:37

look at what was generated I think this

play02:40

is pretty cool so first of all you can

play02:43

actually see the tree you can see the

play02:45

house with the Red Roof you can see the

play02:49

road you can see the flowers or vs in

play02:54

this case and indeed this is a horror

play02:58

image now

play03:00

what happens under the hood is I send

play03:04

this image to the vision interface of

play03:07

open Ai and ask it to generate a

play03:10

detailed prompt and so when the image is

play03:13

generated this is the detailed prompt

play03:16

that openai created which was then sent

play03:20

to doll e for the image generation and

play03:23

this is how we ended up with the image

play03:26

now let's just take a look at some of

play03:28

the examples we have so I'm going to

play03:31

pull this here and I'm going to put my

play03:33

horror image here and let's just quickly

play03:36

look at the various styles that I

play03:39

created so this was my sci-fi image this

play03:42

is my fairy tale version this is my

play03:45

mountain cabin version this is my simple

play03:48

life version vangog minimalistic pencil

play03:52

version the photo unsplash and the black

play03:56

and white photo version I think these

play03:57

are all pretty cool and of course in all

play04:01

of the cases you can see how the house

play04:05

the original pencil drawing that I

play04:07

created in exol draw on my phone was

play04:12

translated here now let's look at just

play04:15

another example here so this is again an

play04:19

example here of a city and you can see

play04:22

here these were the various versions

play04:25

that were generated from this I'm not

play04:28

going to spend the time now to generate

play04:30

them but just to show you how this works

play04:33

now what I want to show you is how you

play04:36

can edit an image so this is my image

play04:41

edit use case right here so you can see

play04:45

that I can add a mask over the picture

play04:48

now notice that the generated image is a

play04:52

square and that is a limitation by open

play04:56

AI dolly that the image must be squar

play05:00

shaped but here I can maybe change now

play05:03

my prompt I'm going to delete or just

play05:07

move my mask from there and I'm going to

play05:10

use these two masks on the side and I'm

play05:14

going to now select the image I'm going

play05:17

to start excal Ai and I need to choose a

play05:21

different prompt I'm now going to choose

play05:24

edit image now notice that when I click

play05:27

edit image and maybe let me just click

play05:31

this back so you can see it now you can

play05:34

see the image with the gray boxes around

play05:37

it if I click edit image then you will

play05:42

see that this suddenly turns into two

play05:44

now it this one right now maybe is not

play05:47

the ideal one let me just put this back

play05:50

here for a second so you can see what's

play05:52

going on I'm going to again click edit

play05:56

image and you can see here that the

play05:59

black areas are where the image is going

play06:02

to be created this one right here is the

play06:06

same size as this one it's just a bit

play06:09

because they are next to each other you

play06:11

don't see the mask but of course you can

play06:13

see the mask right here and what I want

play06:16

to do to experiment with is let's see

play06:21

what if I say that this is a busy City

play06:27

street so this might not actually work

play06:30

so well let's see what open AI doly is

play06:34

able to do this with this because of

play06:36

course this

play06:37

image is not a busy City street but

play06:41

maybe it is going to draw some houses on

play06:44

the side or something like that I'm

play06:47

super curious how open AI is going to

play06:51

solve this problem for us so let's just

play06:55

wait until this

play06:57

generates and well well yeah so this is

play07:02

not really perfect so you can see the

play07:04

busy City street this thing appeared

play07:08

here so my earlier approach with the uh

play07:12

space ship Flying Saucer was better but

play07:15

maybe we can do just one more experiment

play07:18

you can see here I generated ports here

play07:22

so I'm going to take this image right

play07:25

here I'm again going to click exol AI

play07:29

and I'm going to write here City Beach

play07:34

with lots of people so hopefully this is

play07:38

going to work out much better note the

play07:42

generation can take up to 20 30 seconds

play07:45

and wow this is so cool so you can see

play07:48

here our beach was created based on this

play07:52

image at the top just a continuation of

play07:55

the image I'm actually going to save

play07:57

this so let's now look at one more use

play08:00

case the use case I want to look at is

play08:04

generating a prompt by the way notice

play08:06

that every time I generate an image this

play08:09

message pops up just to remind you that

play08:12

if you want to keep the image you need

play08:14

to save it I'm going to close it now I

play08:17

have this practice of

play08:19

creating a picture every day for a daily

play08:24

quote so this is a quote that I created

play08:27

this image for with mid Journey so this

play08:30

is not excit and not Dolly this was my

play08:35

image generated for this quot to at Mid

play08:37

journey and I usually spend good 10 20

play08:41

minutes playing around until I get to an

play08:44

image that I really like but right now

play08:47

let's see what happens if we automate

play08:49

this process so I'm going to start exol

play08:52

AI I'm going to choose the generate an

play08:56

image to illustrate a quote and I'm

play08:59

going to just paste here the quote now

play09:02

in the meantime let me just give you a

play09:06

little bit of explanation first of all

play09:10

let me close this because I shouldn't

play09:12

have selected the text I don't want to

play09:15

send the image so now it's only going to

play09:17

be the user prompt so let me just walk

play09:20

you through what you see here on the

play09:23

screen we have already looked at this

play09:26

drop- down list this is where you can

play09:28

select the action each of the actions

play09:32

has a short help so if you read it

play09:35

hopefully that's going to give you some

play09:37

better idea of what that prompt is about

play09:41

I have a system prompt for most of the

play09:44

actions you can read the system prompt

play09:47

here you can also try to modify the

play09:50

system prompt I played a bit with these

play09:54

system prompts so they generate the type

play09:56

of result I want you can move modify

play09:59

this as well if you want and see if you

play10:03

can come up with a better system prompt

play10:05

and of course here we have the user

play10:07

prompt and here I can choose the size of

play10:10

the image I would like to see generated

play10:13

so this is now going to be a portrait

play10:16

image note that if you configure Dolly 2

play10:20

we'll look at configuration later then

play10:22

the image sizes are going to be

play10:24

different but right now let's just

play10:27

generate an image to illustrate this

play10:30

quote and let's see how this image is

play10:33

going to look like now this is also

play10:36

something that happens sometimes that

play10:38

there's an unexpected error no problem

play10:42

we can run again and usually the second

play10:45

time when you run the script it executes

play10:49

in the script I'm not doing serious

play10:52

amount of airor handling and as a result

play10:55

you sometimes get that back but again

play10:58

this is just a reminder that as long as

play11:00

you see this generating spinner here you

play11:04

know that I am waiting for the response

play11:08

from open AI because I print the image

play11:11

prompt here this usually gives you an

play11:14

understanding of the logic why open AI

play11:17

thought that this would be a good

play11:19

illustration for the quote so again our

play11:22

quote was don't ruin the present with

play11:25

the ruined past so let's read this

play11:29

create an image featuring an

play11:30

otherworldly collidoscope like landscape

play11:33

the foreground includes a figure

play11:36

standing at a Crossroads their back to

play11:39

the viewer exuding

play11:41

resilience to their left a path showing

play11:45

the past cluttered with fragments of

play11:48

broken objects and Faded memories to

play11:52

their right the path is bright leading

play11:55

to a vibrant and Lively landscape the

play11:58

figure 's outstretched arm reaches for

play12:01

the enriching future Rich contrasting

play12:05

colors should exude energy and optimism

play12:09

the scene should blur reality and

play12:11

fantasy boundaries using light and

play12:14

Shadow to symbolize a journey from past

play12:17

Darkness to present light the overall

play12:21

feeling should be hopeful capturing the

play12:23

promise of embracing the

play12:26

present so I think with this

play12:29

explanation this image is pretty good

play12:33

the next one is going to be about

play12:36

creating a mind map to explain a

play12:39

whiteboard image this was available in

play12:42

the earlier version of exol AI already I

play12:46

made a little change that I want to show

play12:48

you here you need to choose challenge my

play12:53

thinking right there and challenge my

play12:55

thinking is going to generate a mind map

play12:59

you can add a user prompt or you can

play13:02

leave the prompt empty going to submit

play13:05

this this is going to generate a mind

play13:08

map that partly summarizes the ideas on

play13:12

the image partly adds additional ideas

play13:16

to it and partly challenges the idea so

play13:20

the image was or the Mind map was

play13:23

generated but wasn't inserted so there's

play13:27

probably an issue with the script and

play13:30

here's what's new so first of all I

play13:32

inserted the mermaid script here and

play13:35

secondly here if you open the menu and

play13:37

go to mermaid to exol draw you will find

play13:41

the script here and you can try to

play13:44

manually fix it unfortunately open AI CH

play13:49

GPT sometimes results in incorrect

play13:53

formatting of mermaid diagram so I'm

play13:56

going to just now click clean this up

play13:59

probably this should be subgraph or

play14:02

something like that but let's look at

play14:04

how this looks like I'm guessing that if

play14:07

I would type here so let's just undo the

play14:10

previous changes so let's just type in

play14:12

subgraph like this and I'm going to type

play14:16

end and I'm going to just put this on my

play14:20

clipboard and replace these so this

play14:23

unfortunately happens sometimes that ch

play14:28

gbt

play14:29

generation of a mermaid graph is not

play14:32

perfect but the good thing is that you

play14:35

don't need to regenerated of course you

play14:38

could also just simply press generate

play14:40

and create a new cph or you can come in

play14:43

here and you can edit it the additional

play14:47

benefit of editing the graph is and so

play14:51

there you go it's now created this graph

play14:54

that I can also change this to be from

play14:57

instead of top down maybe to be left

play15:01

right organized and now if I insert this

play15:05

right here then I can also use my script

play15:10

select elements of type and I'm going to

play15:13

select the

play15:14

arrows and here I can make the arrows to

play15:17

be sharp instead of

play15:20

rounded I like this look of the Mind map

play15:23

a little better and now we can read what

play15:27

open AI returned to also how should we

play15:30

go about filling the page and this is

play15:32

the brick road approach to sketch noting

play15:35

and this is the expansion of the concept

play15:40

so this is an alternative to linear note

play15:44

taking and these two lines on top of are

play15:47

on top of each other so I'm just going

play15:48

to bring this down here and yeah I'm not

play15:53

going to read through the material but

play15:55

you can see here that there's this

play15:59

analysis of my drawing I can use this as

play16:02

a reflection on my thinking I'm going to

play16:06

do this after recording this video but I

play16:08

thought that this is a pretty

play16:11

interesting use case the other example I

play16:14

want to show you is the code generation

play16:17

which I think is more of just a game I'm

play16:22

going to use this calculator right here

play16:24

and I'm going to copy the prompt from

play16:28

here and now I'm going to again start

play16:31

exol AI I'm going to select here

play16:34

wireframe to code the new feature in

play16:38

this case is you can provide the

play16:40

description of the application you want

play16:43

to build as a user prompt so it's not

play16:46

part of the image so you could also add

play16:49

the text prompt under the image and send

play16:51

it as an image and then open AI would

play16:54

decode the text and generate probably

play16:58

the same

play16:59

calculator this gives you some

play17:01

flexibility and options that now you can

play17:04

add a separate prompt so let's look at

play17:07

this calculator it looks good so let's

play17:10

just see 12 plus let's maybe 5 *

play17:16

6 equal 42 so the calculator actually

play17:22

works as expected 2 over one is 0.5 so

play17:26

this is this is pretty good I'm I'm

play17:29

pretty happy with the calculator also in

play17:31

the description I asked the calculator

play17:35

to follow the color scheme of the image

play17:38

and indeed I can see that this is

play17:40

largely the color scheme I'm happy with

play17:43

the outcome and now before we quickly

play17:46

recap the various functions and look

play17:49

under the hood how to use the tool

play17:51

here's one last example so in this case

play17:54

I took a photo from the internet and I

play17:57

added some

play17:58

icons from Flat icons here and

play18:02

as C GPT or rather Dolly to create an

play18:08

image so here's the resulting image I

play18:11

think this is uh pretty nice and it's a

play18:14

nice mix of using some icons from the

play18:17

internet as well as a picture to frame

play18:21

what I'm looking for and then GPT can

play18:24

generate the image for us so with this

play18:27

let's now just recap the different use

play18:30

cases so alt together there are three

play18:34

big areas of use cases well you can play

play18:38

and that's the wireframe to code web

play18:40

development use case you can create

play18:45

illustrations and this reminds me

play18:47

there's one more example we didn't look

play18:50

at so you can also create excital

play18:52

elements and convert elements to shapes

play18:55

so let's look at this I'm going to draw

play18:58

this circle here I'm going to select

play19:02

this I'm going to select convert sketch

play19:05

to shapes I'm going to delete my prompt

play19:10

and let's run this this should be

play19:12

somewhat faster because here there's no

play19:15

image

play19:16

Generation Um it was faster but the end

play19:20

result is well not very good so this was

play19:25

converted into a box I mean I thought

play19:29

that this was a circle um so it's it's

play19:31

not perfect let's look at the other use

play19:34

case these two use cases about creating

play19:37

EXC colid draw shapes is more of an

play19:39

experiment from my side they are really

play19:42

not that good at the moment but let's

play19:44

create a smiley and let's see if the

play19:46

smiley is

play19:49

created there's our Smiley if I

play19:53

can get the smiley out of there so the

play19:56

smiley is actually pretty nice I think

play19:59

that's a I'm I'm happy with the smiley

play20:02

part the they can also try others I was

play20:06

successful with generating a car and a

play20:09

table and small things like that but

play20:11

again sometimes what's generated you

play20:14

need to remove background colors or make

play20:18

Parts transparent because it's hidden it

play20:20

takes a bit of experimentation to work

play20:23

it out but back to a look at the use

play20:27

cases so web development and play the

play20:30

other is generating EXC colit Elements

play20:33

which is super

play20:36

experimental creating and editing images

play20:39

we looked at a whole bunch of examples

play20:41

here um there are also additional use

play20:45

cases where you can just simply generate

play20:49

an image from a prompt you can also use

play20:53

this for visual brainstorming maybe we

play20:56

can look at this example as well so back

play20:58

to the brick road approach the visual

play21:02

brainstorming is about creating an image

play21:05

so I'm going to now choose visual

play21:08

brainstorm I'm just going to send this

play21:11

image over and I'm going to click run so

play21:14

the visual

play21:16

brainstorm creates a

play21:18

picture that somehow resonates with the

play21:23

content of the Whiteboard that you've

play21:25

created my idea is that looking look at

play21:28

the picture and looking at the

play21:30

Whiteboard it can spark some additional

play21:33

ideas so this is the image that was

play21:37

generated so this is about sketch noting

play21:40

for sure we have the sketch note artist

play21:42

we have this idea up here we have a bit

play21:45

of a diagram up in this corner it's

play21:48

actually this Leaf of ideas that are

play21:53

spreading all over it's it is a nice

play21:57

illustration is it helping me thinking

play21:59

about sketch noting well maybe it does

play22:02

so I can reflect on this image and

play22:06

connect it with the ideas from The Brick

play22:08

Road approach to skep thing and just see

play22:12

some links I'm actually going to save

play22:15

this image so again final reminder that

play22:18

you need to save the image locally if

play22:22

you want to keep it otherwise you come

play22:24

back tomorrow and this image is no

play22:27

longer going to be

play22:28

available I think we've looked at all

play22:31

the use cases so the other use case

play22:34

apart from illustrations is to generate

play22:36

new ideas and generate new ideas could

play22:40

be illustration of a quote it could be a

play22:42

visual brainstorm or a mermaid graph

play22:47

that illustrates an

play22:49

idea so then let's look at what's under

play22:52

the hood I'm going to be very quick on

play22:55

this but I think this is helpful and you

play22:57

also saw how I'm using this in the

play23:01

presentation so you need to select the

play23:04

elements you want to include in your

play23:07

prompt on the canvas so for example like

play23:11

this I can select these elements and

play23:14

then these are going to be the ones that

play23:16

I'm sending to open

play23:19

AI for some of the prompts like for

play23:22

example for the quote you don't need to

play23:25

select elements because then you're only

play23:28

sending the text prompt and that's

play23:32

okay then you choose the task now when

play23:36

you choose the task then depending on

play23:38

the type of task you saw that in case of

play23:43

selecting the image edit then the

play23:48

picture and the excolo elements were

play23:51

taken in two separate parts so you

play23:54

remember here that we were looking at

play23:59

this mask like that and here if I start

play24:03

excal

play24:04

AI you can see that in the normal case

play24:08

this entire image would be sent to open

play24:11

AI if I choose here edit image then this

play24:15

is split into two I have the

play24:19

picture and I have the mask and wherever

play24:24

the mask is black that's where the image

play24:26

is going to be generated maybe this can

play24:29

be much more visible if I do it here let

play24:33

me bring this to the

play24:36

front like this and so for example if I

play24:40

would want to change this house into a

play24:46

skyscraper and then I would send I would

play24:50

open exol AI like this and then you can

play24:54

see here that this is where the

play24:57

skyscraper will go you can see the mask

play25:00

and you can see the

play25:03

image so depending on the task you will

play25:06

see a different preview image either the

play25:09

image plus the mask or the image only

play25:13

you can then provide your text prompt

play25:16

and optionally modify the system prompt

play25:19

so the system prompt is this one up here

play25:23

in case of edit image there is actually

play25:25

no system prompt but most of the cases

play25:28

there are so this is the customize

play25:31

system prompt part and then when you hit

play25:34

run at the bottom then depending on the

play25:38

activity you selected different things

play25:40

will happen either a mermaid graph is

play25:44

generated or an EXC colro drawing is

play25:47

generated or a web app or maybe dolly is

play25:51

executed and an image is created in some

play25:54

cases and this is the case then you

play25:58

create an an image prompt and you want

play26:02

you add an image and a prompt and you

play26:04

want to create a new image based on that

play26:07

inspired by that like my little house so

play26:10

this was uh these are all the examples

play26:14

of that then what happens is first I

play26:17

call GPT vision and GPT Vision generates

play26:21

an image prompt and then with that I go

play26:25

to Dolly and I generate the image and

play26:29

finally if you like the image you should

play26:33

save it locally right click save locally

play26:36

or if not then open II will delete the

play26:40

image in 30

play26:42

minutes I'm not saving the images

play26:45

automatically to the Vault because I'm

play26:48

assuming that there's going to be lots

play26:49

of rubbish generated by open Ai and you

play26:52

don't want to clutter your Vault so this

play26:55

requires a bit of deliberate action on

play26:58

your side to save what you find to save

play27:02

it locally and finally let's look at

play27:05

what it takes to get started with this

play27:08

so first of all you need to install xol

play27:11

AI from the script Library how does it

play27:13

work you click here to open the obsidian

play27:16

tools panel and top left you see install

play27:20

or update excal draw scripts if I open

play27:24

this then I can search for exol

play27:28

AI like this it will take me here and if

play27:32

I click on this then here I can just

play27:34

simply click install now it's already

play27:38

installed so I didn't I don't need to

play27:40

install it but this is how I would

play27:42

install it if I click this it will say

play27:45

installed xol AI once you have exol ai

play27:49

working you need to go to open Ai and

play27:52

you need to create an account and add

play27:54

money to that account so this is the

play27:56

link you need to open and you can see

play28:00

here that this is my balance I have

play28:04

$392 by the way generating images we can

play28:07

look at how much today's usage cost so

play28:11

generating all the images we did right

play28:14

now I was already I think at 9 cents so

play28:17

today this image generation for the

play28:19

video cost me about 40 cents I don't

play28:24

think it's a huge amount of money so

play28:26

this is there you can see

play28:28

the usage information as well once you

play28:31

have your account and you've added money

play28:34

to the account you need to add at

play28:36

minimum $5 otherwise the GPT Vision

play28:40

model is not going to be available to

play28:42

you if you have at least $5 or on your

play28:45

account you still need to wait about 10

play28:48

20 minutes for open AI to activate your

play28:51

access and then you can come here and

play28:54

configure in obsidian you need to create

play28:58

an open AI API key you can see the link

play29:01

right here if I click on this it takes

play29:03

me to the API keys I can click here to

play29:06

create a new secret key and then the key

play29:10

is going to be created and then I need

play29:13

to go to plug-in settings right here and

play29:16

I need to click on EXC colar draw AI

play29:19

settings and here I can

play29:22

configure my API key and my different

play29:27

models as well and finally when you're

play29:30

done come here to the tools panel and

play29:35

find exol AI

play29:38

here amongst the downloaded scripts if

play29:41

you long click on it then you can add it

play29:43

pin it to the side panel and from then

play29:46

on it's going to work as I've

play29:48

demonstrated it to you uh in the

play29:51

video so that's all I wanted to share

play29:54

with you today I already used it a lot

play29:58

in my workflows I enjoy it so much yes

play30:02

it costs a little money but the amount

play30:04

is not so much and I think the benefit

play30:08

you're getting with the images with the

play30:10

mind maps with the workflows is super

play30:13

valuable give it a try and let me know

play30:15

what you think in the comments below

play30:18

thank you

Rate This

5.0 / 5 (0 votes)

Related Tags
AI图像生成代码转换创意工作obsidian工具open AI图像编辑视觉脑暴思维导图自动化流程API集成workflow优化
Do you need a summary in English?