Skip to main content

Systematically Working with Multimodal Data: Research Methods in Multimodal Discourse Analysis

Systematically Working with Multimodal Data: Research Methods in Multimodal Discourse Analysis

Sigrid Norris

ISBN: 978-1-119-16834-8

Feb 2019, Wiley-Blackwell

312 pages

$43.99

Product not available for purchase

Description

A guide that offers a step-by-step process to data-driven qualitative multimodal discourse analysis

Systematically Working with Multimodal Data is a hands-on guide that is theoretically grounded and offers a step-by-step process to clearly show how to do a data-driven qualitative Multimodal Discourse Analysis (MDA). This full-color introductory textbook is filled with helpful definitions, notes, discussion points and tasks. With illustrative research examples from YouTube, an Experimental and a Video Ethnographic Study, the text offers many examples of how to deal with small to large amounts of data, including information on how to transcribe video data multimodally, including online videos, and how to analyze the data.

This textbook contains ample theory, directions for literature, and a teaching guide to help with a clear understanding of how to work with multimodal data.

  • Contains new research data, exceptional illustrations and diagrams
  • Offers step-by-step processes of working through examples, transcriptions and online videos
  • Goes into great depth so that students can use the book as hands-on material to engage with their own data analysis
  • Designed to be easy-to-use with color-coded definitions, tasks, discussion points and notes

Written for advanced undergraduate, graduate and PhD level students, as well as participants in research workshops, Systematically Working with Multimodal Data is an authoritative guide to understanding data-driven qualitative Multimodal Discourse Analysis. 

Related Resources

Instructor

Request an Evaluation Copy for this title

List of Figures

List of Tables

Acknowledgements

About the Companion Website

Chapter 1

Chapter 1.0

What this book is about

Systematically working with video data: Phases I-V

Chapter 1: Systematically working with multimodal data: Introduction

Chapter 2: Philosophical and theoretical background

Chapter 3: Systematically working with multimodal data Phase I

Chapter 3.0: Phase I: Data collection

Chapter 3.1: Systematically working with small data sets/data pieces: Phase I

Chapter 3.2: Systematically working with medium-sized data sets: Phase I

Chapter 3.3: Systematically working with large data sets: Phase I

Chapter 4: Systematically working with video data Phase II

Chapter 4.0: Phase II: Delineating the data

Chapter 4.1: Systematically working with small data sets/data pieces: Phase II

Chapter 4.2: Systematically working with a medium-sized data set: Phase II

Chapter 4.3: Systematically working with a large data set: Phase II

Chapter 5: Systematically working with video data Phase III

Chapter 5.0: Phase III: Selecting data pieces for microanalysis

Chapter 5.1: Systematically working with small data sets/data pieces: Phase III

Chapter 5.2: Systematically working with medium-sized data sets: Phase III

Chapter 5.3: Systematically working with large data sets: Phase III

Chapter 6: Systematically working with video data Phase IV

Phase IV: Transcribing data using multimodal transcription conventions

Chapter 7: Systematically working with multimodal data Phase V

Phase V: Using analytical tools

Chapter 8: Systematically working with multimodal data

Chapter 1.1

Multimodal discourse analysis: Some other research

Multimodal discourse analysis: Research underpinning this book

Mediated discourse theory

Philosophy and theory

Timing and rhythm

Chapter 2

Chapter 2.0

Philosophical underpinnings

Primacy of perception

Primacy of embodiment

Theoretical Underpinnings: One Principle, two sub-principles

The principle of social action

The sub-principle of communication

The sub-principle of history

Principle and sub-principles: A perfect fit

Multimodal mediated theory: Basic theoretical concepts

Embodiment & perception: Multimodal mediated theory

Unit of analysis: The mediated action

Social actors

Mediational means/cultural tools

The mediated action

Non-human social actors

Humans and animals as mediational means

Multiple mediational means/cultural tools in a mediated action

Lower-level mediated action

Lower-level mediated actions: Perception

Lower-level mediated actions: Embodiment

Higher-level mediated action

Higher-level mediated actions: Perception

Higher-level mediated actions: Embodiment

Frozen mediated action

Frozen mediated actions: Perception

Frozen mediated actions: Embodiment

Practices and Discourses

Practice: Perception

Practice: Embodiment

Site of engagement

Site of engagement: Perception

Site of engagement: Embodiment

Chapter 2.1

Scollon referenced Vygotsky and Nishida

Scollon & Vygotsky: Some musings

Scollon & Nishida: Some musings

Scollon’s theory: Some musings

Scollon’s practice: Some musings

Philosophical and theoretical background: Summary

Philosophical and theoretical background: Things to remember

Chapter 3

Chapter 3.0

So, where do we begin?

Phase I: Data collection

Step 1: Identifying a theme or  topic

Step 2: Developing research questions

Step 3: Considerations before setting out on data collection: What is data?

Step 4: Considerations before setting out on data collection: What are naturally occurring data?

Step 5: Considerations before setting out on data collection: Ethics

Step 6: Video recording and camera placement

Step 7: Collecting video data, taking field notes & interviewing participants

Step 8: Producing a data collection table

Step 9: Identifying the recording equipment, the researcher(s), video recorded (inter)action and animals recorded or not recorded

Step 10: Collating and time stamping

Phase I: Summary

Phase I – Data collection: Things to remember

Chapter 3.1

A Step-by-Step guide to analyze a YouTube video

Phase I: Data collection

Step 1: Identifying a theme or  topic

Step 2: Developing research questions

Step 3: Considerations before setting out on data collection: What is data?

Step 4: Considerations before setting out on data collection: What are naturally occurring data?

Step 5: Considerations before setting out on data collection: Ethics

Step 6: Video recording and camera placement

Step 7: Collecting video data, taking field notes & interviewing participants

Step 8: Producing a data collection table

Step 9: Identifying the researcher in relation to the YouTube video

Phase I: Summary

Chapter 3.2

A Step-by-Step guide to analyze experimental data

Phase I: Data collection

Step 1: Identifying a theme or topic

Step 2: Developing research questions

Step 3: Considerations before setting out on data collection: What is data?

Step 4: Considerations before setting out on data collection: What are naturally occurring data?

Step 5: Considerations before setting out on data collection: Ethics

Step 6: Video recording and camera placement

Step 7: Collecting video data, taking field notes & interviewing participants

Step 8: Producing a data collection table

Step 9: Identifying the recording equipment, the researcher(s), and the video recorded (inter)action

Step 10: Collating and time stamping

Phase I: Summary

Chapter 3.3

A Step-by-Step guide to analyze video ethnographic data

Phase I: Data collection

Step 1: Identifying a theme or topic

Step 2: Developing research questions

Step 3: Considerations before setting out on data collection: What is data?

Step 4: Considerations before setting out on data collection: What are naturally occurring data?

Step 5: Considerations before setting out on data collection: Ethics

Step 6: Video recording and camera placement

Step 7: Collecting video data, taking field notes & interviewing participants

Step 8: Producing a data collection table

Step 9: Identifying the recording equipment, the researcher(s), and the video recorded (inter)action

Step 10: Collating and time stamping

Phase I: Summary

Chapter 4

Chapter 4.0

So, where do we begin?

Phase II: Delineating the data

Step 1: Identifying your data set

Step 2: Understanding the site of engagement that includes the researcher and the data set

Step 3: Identifying a data piece

Step 4: Understanding the site of engagement that includes the researcher and the data piece

Step 5: Phrasing a research question that encircles your data

Phase II: Summary

Phase II – Delineating your data: Things to remember

Chapter 4.1

A Step-by-Step guide to analyze a YouTube video

Phase II: Delineating the data

Step 1: Identifying your data set

Step 2: Understanding the site of engagement that includes the researcher and the data set

Step 3: Identifying a data piece

Step 4: Identifying the site of engagement that embraces the researcher/viewer in relation to the data piece

Step 5: Phrasing a research question that encircles your data

Phase II: Summary

Chapter 4.2

A Step-by Step guide to analyze experimental data

Phase II: Delineating your data

Step 1: Identifying your data set

Step 2: Understanding the site of engagement that includes the researcher and the data set

Step 3: Identifying a data piece

Step 4: Identifying the site of engagement that embraces the researcher in relation to the data piece

Step 5: Phrasing a research question that encircles your data

Phase II: Summary

Chapter 4.3

A Step-by Step guide to analyze video ethnographic data

Phase II: Delineating your data

Step 1: Identifying your data set

Step 2: Understanding the site of engagement that includes the researcher and the data set

Step 3: Identifying a data piece

Step 4: Identifying the site of engagement that embraces you, the viewer/researcher and the data piece

Step 5: Phrasing a research question that encircles your data

Phase II: Summary

Chapter 5

Chapter 5.0

So, where do we begin?

Phase III: Selecting data pieces for analysis

Step 1: The MEDIATED ACTION: Re-phrasing your general research question

Step 2: Demarcating higher-level mediated actions

Step 3: Developing an overview of higher-level mediated actions in your data

Step 4: Narrowing the site of engagement

Phase III: Summary

Phase III – Selecting data pieces for micro analysis: Things to remember

Chapter 5.1

A Step-by-Step guide to analyze a YouTube video

Phase III:Selecting data pieces for micro analysis

Step 1: The MEDIATED ACTION: Re-phrasing your data-driven research question

Step 2: Demarcating higher-level mediated actions

Step 3: Developing an overview of higher-level mediated actions in your data

Step 4: Selecting data pieces for microanalysis: Narrowing the site of engagement

Phase III: Summary

Chapter 5.2

A Step-by Step guide to analyze experimental data

Phase III: Selecting data pieces for micro analysis

Step 1: The MEDIATED ACTION: Re-phrasing your data-driven research question

Step 2: Demarcating higher-level mediated actions

Step 3: Developing an overview of higher-level actions in your data

Step 4: Selecting data pieces for microanalysis: Narrowing the site of engagement

Phase III: Summary

Chapter 5.3

A Step-by-Step guide to analyze video ethnographic data

Phase III: Selecting data pieces for micro analysis

Step 1: The MEDIATED ACTION: Re-phrasing your data-driven research question

Step 2: Demarcating higher-level mediated actions

Step 3: Developing an overview of higher-level mediated actions in your data

Step 4: Selecting data pieces for microanalysis: Narrowing the site of engagement

Phase III: Summary

Chapter 6

So, where do we begin?

Phase IV: Transcribing data using multimodal transcription conventions

Step 1: Identifying a mode

Step 2: Transcribing Layout

Step 3: Transcribing Proxemics

Step 4: Transcribing Posture

Step 5: Transcribing Gesture

Step 6: Gaze

Step 7: Transcribing head movement

Step 8: Transcribing Facial expression

Step 9: Transcribing object handling

Step 10: Transcribing Language

Step 11: Producing a final transcript

Phase IV: Summary

Phase IV – Transcribing data using multimodal transcription conventions: Things to remember

Chapter 7

Phase V: Using analytical tools

Step 1: Selecting analytical tools for micro analysis

Chapter 8

A quick guide for instructors of undergraduate classes

Chapter 3.0 from Phase I: Data collection onwards & Chapter 3.1

Chapter 4.0 & Chapter 4.1

Chapter 5.0 & Chapter 5.1

Chapter 6

Chapter 7

A quick guide for instructors of graduate courses

Chapter 1 from Multimodality: Some other research onward

Chapter 2 up to and including the section on the site of engagement

Chapter 3.0 & Chapter 3.2

Chapter 4.0 & Chapter 4.2

Chapter 5.0 & Chapter 5.2

Chapter 6

Chapter 7

A quick guide for instructors of PhD seminars and research team leaders

Chapter 1 from Multimodality: Some other research onward

Chapter 2

Chapter 3.0 & Chapter 3.3

Chapter 4.0 & Chapter 4.3

Chapter 5.0 & Chapter 5.3

Chapter 6

Chapter 7