"What is a mode?"

Summary

本视频脚本探讨了语言学中的多模态性，强调了超越语言本身，使用更广泛的符号资源来理解意义。讨论了模式的概念，将其定义为社会产生的文化资源，用于通过视觉、文字、声音等多种方式创造意义。通过分析BBC新闻网站的布局和设计，展示了颜色、图像和文字如何共同作用于意义的构建。同时，介绍了“符号”这一概念，作为理解多模态交流中意义构建的基本单位，强调了形式和意义的结合。

Takeaways

• 😀 语言学研究中，除了语言本身，还应考虑图像、手势等多种模态（multimodality）在传达信息中的作用。
• 🌐 在多模态交流中，可以使用更广泛的术语，如符号资源（semiotic resources），以适用于书面文字、图像、手势等多种表达方式。
• 🔍 模式（mode）是帮助我们理解不同交流方式（如视觉语言、手势语言）的术语，它们是社会生产并成为文化资源的，用于创造意义。
• 🎨 颜色、图像和文字是构建意义的模式，它们在网站设计中尤其重要，如BBC首页的颜色和图像布局。
• 🤔 在分析多模态文本时，需要考虑图像和文字各自的重要性以及它们是如何共同工作的。
• 📚 符号资源是文化提供给我们用来创造意义的资源，它们具有特定方式创造意义的潜力。
• 📈 模式的可供性（affordance）指的是它们在创造意义时所提供的可能性和限制，不同的模式（如图像和文字）以不同的方式创造意义。
• 🌟 一个模式（如图像）可能通过不同的方式（如展示一个场景）来传达信息，而文字则通过句子和段落来传达。
• 🔗 多模态文本中，不同的符号资源（如文字、图像、颜色）结合在一起，可以创造出比单一模式更丰富或更完整的意义。
• 🔑 符号（sign）是多模态研究中用来理解意义的基本单位，它由形式和意义组合而成，如图像中的坦克代表力量和暴力。

Q & A

什么是多模态性（multimodality）？

多模态性是指在交流中使用多种符号资源，如文字、图像、手势、声音等，来表达意义。它超越了传统的语言研究，考虑了视觉、听觉甚至触觉等多种感官渠道。

在多模态研究中，'模式'（mode）指的是什么？

在多模态研究中，'模式'指的是用于制造意义的资源，如视觉语言、手势语言等。它们是社会生产并成为文化资源的，能够以不同的方式（如声音、图像、触觉等）使意义具体化。

如何理解'符号资源'（semiotic resources）？

符号资源是指文化为我们提供的各种用于制造意义的工具和手段。它们包括语言、图像、颜色、音乐等，每一种都有其特定的潜能和方式来表达意义。

在多模态分析中，'可供性'（affordance）是什么意思？

在多模态分析中，'可供性'指的是某种符号资源所允许或支持的特定行为或意义构建方式。不同的模式，如文字和图像，具有不同的可供性，它们以不同的方式帮助我们理解和构建意义。

为什么在多模态研究中，'符号'（sign）被视为基本单位？

在多模态研究中，'符号'被视为基本单位，因为它结合了形式和意义，是所有符号资源共有的特征。无论是文字、图像还是声音，它们都通过特定的形式传达特定的意义。

在BBC新闻网站的首页上，颜色如何参与意义的构建？

在BBC新闻网站的首页上，颜色如顶部的深红色带和大量的白色空间，通过视觉对比和品牌识别，参与了意义的构建，帮助用户理解网站的内容和结构。

在多模态交流中，图像和文字是如何协同工作的？

在多模态交流中，图像和文字通过各自独特的可供性协同工作，共同构建意义。图像通过视觉元素传达情感和情境，而文字则提供具体信息和细节，两者结合可以提供更丰富的信息和更深刻的理解。

如何理解多模态交流中的'模块化'（modularity）？

在多模态交流中，'模块化'指的是信息被组织成独立的单元或模块，每个模块通过特定的符号资源（如文字、图像、颜色）来传达意义。这种模块化有助于用户快速识别和理解信息。

为什么在多模态分析中，要探讨不同模式的重要性？

在多模态分析中，探讨不同模式的重要性是为了理解它们在传达信息和构建意义中所扮演的角色和功能。这有助于我们更好地理解如何有效地使用这些资源来达到沟通的目的。

在多模态交流中，如何理解'意义的丰富性'？

在多模态交流中，'意义的丰富性'指的是通过结合不同的符号资源（如文字、图像、声音等），可以创造出比单一模式更复杂、更全面的意义。这种丰富性增强了信息的表达力和理解的深度。

为什么说多模态交流可以提供更全面的意义？

多模态交流可以提供更全面的意义，因为它允许使用多种感官和符号资源来表达和理解信息。这种多维度的交流方式能够触及人类认知的不同方面，从而提供更深层次的理解和更丰富的体验。

Outlines

00:00

🌐 多模态交流与符号资源

本段讨论了多模态交流的概念，强调了在多模态环境中，我们不仅关注语言，还要考虑图像、手势和声音等多种符号资源。这些资源被社会化生产并成为文化资源，用于创造意义。作者提到了“模式”这一概念，它允许我们超越语言的限制，认识到不同的符号资源（如视觉、手势、语言）在交流中的作用。通过分析BBC新闻网站的首页，作者展示了如何通过颜色、图像和文字等不同的模式来构建意义。

05:01

🔍 符号资源的功能性与意义构建

第二段深入探讨了符号资源的功能和它们在意义构建中的作用。作者指出，不同的符号资源（如图像和文字）以不同的方式创造意义。例如，图像通过视觉呈现信息，而文字则通过句子和段落的结构来传达。作者通过比较图像和文字在表达“下雨”这一概念时的不同，强调了每种资源的独特功能和它们如何共同作用以创造更丰富的意义。此外，作者还解释了“符号”这一概念，即形式和意义的结合，它是理解多模态交流中意义构建的基本单位。

Keywords

💡语言学

语言学是研究语言结构、发展和使用规律的学科。在视频中，语言学与多模态（multimodality）课程和句子有关，探讨了语言不仅仅是文字，还包括图像、手势等多种模态。

💡多模态

多模态是指使用多种符号资源（如文字、图像、声音等）来传达信息的方式。视频中提到，在多模态研究中，我们不仅关注文字和句子，还要考虑图像、手势等其他模态，它们共同构成了信息传递的丰富性。

💡模态

模态是视频中一个核心概念，指的是用于创造意义的不同资源或方式，如视觉、听觉、触觉等。视频中举例说，除了语言模态，还有视觉语言、手势语言等，它们都是社会化的产物，成为文化资源的一部分。

💡符号资源

符号资源是指文化提供给我们用于创造意义的各种手段。视频中提到，符号资源是多模态研究中的一个广义术语，它不仅限于语言，还包括图像、颜色等，它们都具有以特定方式创造意义的潜力。

💡可供性

可供性是视频中讨论的一个概念，指的是某种模态或符号资源所允许或支持的行为或功能。例如，视频中提到，文字可以构造句子和段落，而图像则通过视觉元素传达意义，它们各自以不同的方式支持信息的传递。

💡意义模块

意义模块是指在多模态文本中，由文字、图像、颜色等元素组合起来传达特定意义的单元。视频中以BBC新闻首页为例，说明了如何通过意义模块来理解网站的功能和设计。

💡符号

符号是视频中用来描述所有创造意义的实体的术语。它由形式和意义组合而成，如视频中提到的坦克图片，其形式（坦克）与意义（力量、暴力）相结合，构成了一个符号。

💡文化资源

文化资源是指社会和文化中用于交流和表达意义的工具和实践。视频中强调，模态如语言、图像、手势等都是文化资源，它们被社会群体在长期和相似情境中使用，形成了一定的规律性。

💡BBC首页

BBC首页是视频中用来说明多模态分析的一个实例。视频中分析了BBC首页上的颜色、图像、文字等元素如何共同工作，以及它们各自在传达信息中的作用和重要性。

💡组合意义

组合意义是指通过将不同的模态或符号资源结合起来，创造出比单一模态更丰富或完整的意义。视频中提到，文字和图像在传达信息时各有特点，它们的组合可以提供更全面的理解。

Highlights

在多模态性中，我们可以使用比语言更广泛的术语，如符号资源，来描述图像、写作、手势和语言。

模式是一种资源，我们可以通过它来使意义具体化，让别人能够看到、听到甚至触摸到。

模式是社会产生的，随着时间的推移在相似情境中被社区使用，形成了规律性。

模式可以是物质的，如声音、图像、触觉，甚至是气味。

BBC首页新闻的顶部有一个深红色的条带，这显示了颜色在意义构建中的重要性。

BBC的logo是一个图像，即使在宽带中也存在，这表明图像在意义构建中的重要性。

在BBC首页的大片空白区域，我们可以看到由文本和图像组成的模块化意义单元。

颜色、图像和写作是这个网站主要的模式，它们共同构成了意义。

在多模态性中，图像和写作可能执行不同的工作，或者它们的重要性可能不同。

符号资源是文化为我们提供的意义构建工具，它们具有特定方式构建意义的潜力。

模式的可供性是一个重要议题，因为它允许我们以不同的方式处理相似的问题。

例如，写作可以描述雨，而图像可以直观地展示雨天的场景。

不同模式的组合可以产生更丰富或更完整的意义。

在BBC网站上，'六名士兵在阿富汗被杀'的文本和士兵站在坦克上的图像共同构建了一种意义。

符号是多模态性中用来理解意义的基本单位，它结合了形式和意义。

例如，坦克的形象可能意味着力量或暴力，这是符号所传达的意义。

Transcripts

so if we're talking about linguistics in

linguistics and courses and sentences

but um well there are basic categories

if you're talking amost a modality well

some of the we don't of course if you're

in multi modality you can still look at

words and clauses and sentences and

paragraphs but you might want to have

much more general terms which will apply

to image as much as it is writing to

gesture as much as it does to speech and

some of the basic categories some there

we will talk about and we can do that

now our mode of course think about the

notion instead of having a term such as

language have a more general term such

as some semiotic resources and then what

can these things do which we talked

about this affordance and of course and

we're in linguistics maybe the sentence

is the basic unit in multi modality in a

semiotic kind of bridge we might talk

about sign okay so to explain me but

what what exactly then is mode mode is a

term that allows us to get away from

using language for everything whereas

you might say this visual language in

this gestural language and their self

language of flowers we now say there are

different modes and modes are resources

web whereby we can make meaning material

I want to mean something I want to

communicate something how do I make my

meaning evident material so others can

kind of take it in see it hear it maybe

even touch it and modes are these things

which are socially produced and they

become cultural resources for making

meaning that regular because the

community uses these resources and over

long periods of time in similar kinds of

circumstances

so there's a regularity that applies to

them they are material they have sound

or they have image like that where a

tactile or you know they even smell

I suppose them and so modes are these

things which are culture and has as

means of making meaning

and it allows us to get away from making

gin of making language to general and

maybe therefore too vague a term to be

useful okay so we have this website here

okay and what would them be mold if

we're looking at this website well on

that BBC homepage news you have a kind

of a band at the top which is in a dark

red color then underneath that there is

a kind of a lot of white so color is

obviously important in some way and we'd

have to say is color significant this

meaning being made with color in the

broad band at the top this also

something which people who know the BBC

will recognize as a logo so there's an

image even in the broadband there and is

imaging important but of course then

when you go below it to this big

basically wide space what you have is

kind of chunks of stuff you have modules

of meaning and these modules of meaning

here seem to be made out for from bits

of writing which are next to or

underneath them an image they have image

and writing you have color so this would

be the main modes and then the question

I suppose that would appear after a

little while of kind getting going with

this is to say is image more important

than writing or is writing more

important or do they do the same job or

do they do different kinds of jobs and

so that's how I would begin to make them

my inroads into understanding how this

website functions okay and earlier you

mentioned semiotic resources yeah what

is matter resource then and it's a

general way again of of saying what does

the culture make available for us to

make our meetings with semiotic is about

meaning and resources for making meaning

and saying semiotic resources is a way

of not making you necessary to list a

whole long list of them of things that

you know that the culture has but it

says there are many and all of them

have potentials for making meanings in

particular ways okay so in in this sense

that these or the different modes you're

talking like image and the writing and

the color are different semiotic

resources that they have made use of and

I might have mentioned when we started

this little conversation that them we're

assuming and that all these semiotic

resources are capable of making meaning

but not in the same way and so an image

for instance doesn't have words mm-hmm

it doesn't have paragraphs writing does

have words and as sentences and

paragraphs and the question then is what

can you do with writing what is writing

afford what does it make possible to do

so for instance outside at the moment

there the weather is a bit kind of moist

and you know we say it's raining we

don't know what the it is that is

raining but language kind of forces a

indo kind of saying something is raining

but if I had an image here I would just

have a rainy day it might be everything

but is it does things but does them

differently and the difference is

significant and so affordance of a mode

is an important issue because we're

saying these are not just repetitions

they're not just parallel they're not

just the same thing done differently but

rather they are they allow us to do

somewhat different things in relation to

a similar kind of issue so it's raining

writing that's it in one way imaged us

in another way but we could have a sound

recording of rain on a roof or on the

surface or or something like that so it

allows us to make kinds of combinations

of things which together make a richer

meaning or a fuller meaning that a

single mode by itself would enable us to

do so that's the reason for example why

we have the text and the colors the

images I think so

I think so for instance there it says

six soldiers killed in Afghanistan

and the writing bulky was a little bit

of information about what happened on

their day in Afghanistan the image is an

image of a tank with soldiers kind of

standing on it what does that image do

what is immediately kind of transports

us into an arid landscape a huge tank

which takes up just about most of the

image these people in battle fatigues

and they're a different kind of firm

meaning being made by each of those

components and yet they kind of firm

come together and give us an overall

sense of what's going on there and the

last term you mention was sign yeah can

you explain that well I'm in if you if

you if you spoke to the man or the woman

in the street and said what's language

about they'd say words and sentences

probably um in other words people have a

kind of a common sense about what are

the units of language words and

sentences and when we're thinking about

many modes gesture doesn't have words

image doesn't have word music only when

it's sung as words where there's melody

it has different kinds of firm entities

and so the question is what is a common

kind of thing to all of these things all

of these things make meaning and the

entity of meaning that we use let's say

in multi modality not everybody but

people who have a semiotic approach is

the sign the sign is a combination of a

form and the meaning so in here for

instance we have a tank that's the kind

of form that means might power the

violence whatever yeah so the sign is

the basic unit which is common in the

semiotic approach and to all attempts to

understand what meaning is being made

there here for instance you have writing

and you have image so you have the

science made in writing you have the

science made an image color comes into

it the arid color of the image with up

there so all of these are signs and we

can ask what are the form what is the

form

which is being used here and what is the

meaning which is being attached to the

form that's what the sign is about