Exploring the Validity of the Advanced Placement (AP) Japanese Computer-Simulated Interpersonal Speaking Task

Domain Definition Inference

Authors

DOI:

https://doi.org/10.5195/jll.2026.309

Abstract

This study examined the domain definition inference for the AP Japanese exam, which aims to measure language proficiency in situations reflecting real life. For the domain definition inference, this exam attempts to claim that (a) features of examinee performance that provide evidence of language proficiency have been identified, and (b) the assessment tasks are relevant to and representative of the real-life domain. Focusing on the computer-simulated conversation task of the AP Japanese exam, four assumptions underlying these claims were investigated: (1) the target domain is clearly identified; (2) critical language skills and knowledge needed in the target domain are identified; (3) assessment tasks that are representative of the target domain are identified; and (4) assessment tasks that require critical skills and are representative of the target domain are simulated. Backing for these assumptions was gathered through analyses of exam-related documents and test task characteristics, including context, input language, and scoring criteria. This study found reasonable backing for the first two assumptions and partial backing for the others. Therefore, this paper argues that the two claims that the exam attempts to make for the domain definition inference are not fully supported. It also discusses possible ways to improve the validity argument.

Author Biography

Nana Suzumura-Smith, California State University, Long Beach

California State University, Long Beach

Assistant Professor

References

American Council on the Teaching of Foreign Languages. 2012. “ACTFL Proficiency Guidelines.” http://www.actfl.org/sites/default/files/pdfs/public/ACTFLProficiencyGuidelines2012_FINAL.pdf.

Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford: Oxford University Press.

———. 2002. “Some Reflections on Task-Based Language Performance Assessment.” Language Testing 19 (4): 453–76.

https://doi.org/10.1191/0265532202lt240oa.

Bachman, Lyle F., and Adrian S. Palmer. 1996. Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford Applied Linguistics. Oxford: Oxford University Press.

Baum, David I. 2007. “Establishing AP Japanese Language and Culture Exam Validity Using College Professors’ Grading Standards.” Educational Testing Service. http://apcentral.collegeboard.com/apc/public/repository/collegeCompStudy_japaneseLang_07.pdf.

Bialystok, Ellen. 1981. “The Role of Linguistic Knowledge in Second Language Use.” Studies in Second Language Acquisition 4 (1): 31–45. https://doi.org/10.1017/S0272263100004265.

Breiner-Sanders, Karen E., Pardee Lowe, John Miles, and Elvira Swender. 2000. “ACTFL Proficiency Guidelines—Speaking: Revised 1999.” Foreign Language Annals 33 (1): 13–18. https://doi.org/10.1111/j.1944-9720.2000.tb00885.x.

Brown, Gillian, and George Yule. 1983. Teaching the Spoken Language: An Approach Based on the Analysis of Conversational English. Cambridge Language Teaching Library. Cambridge, U.K.: Cambridge University Press.

Canale, Michael, and Merrill Swain. 1980. “Theoretical Bases of Communicative Approaches to Second Language Teaching and Testing.” Applied Linguistics 1 (1): 1–47. https://doi.org/10.1093/applin/I.1.1.

Chapelle, Carol A. 2008. “The TOEFL Validity Argument.” In Building a Validity Argument for the Test of English as a Foreign Language, edited by Carol A. Chapelle, Mary K. Enright, and Joan M. Jamieson, 319–52. ESL & Applied Linguistics Professional Series. New York: Routledge.

Chapelle, Carol A., Mary K. Enright, and Joan M. Jamieson. 2008. “Test Score Interpretation and Use.” In Building a Validity Argument for the Test of English as a Foreign Language, edited by Carol A. Chapelle, Mary K. Enright, and Joan M Jamieson, 1–25. ESL & Applied Linguistics Professional Series. New York: Routledge.

Chapelle, Carol A., and Hye-won Lee. 2021. “Understanding Argument-Based Validity in Language Testing.” In Validity Argument in Language Testing: Case Studies of Validation Research, edited by Carol A. Chapelle and Erik Voss, 19–44. The Cambridge Applied Linguistics Series. Cambridge, U.K.: Cambridge University Press. http://doi.org/10.1017/9781108669849.004.

Clark, Herbert H. 1996. Using Language. Cambridge, U.K.: Cambridge University Press. https://doi.org/10.1017/CBO9780511620539.

College Board. 2007a. “AP Japanese Language and Culture 2007 Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap-2007-japanese-language-free-response-questions.pdf.

———. 2007b. “AP Japanese Language and Culture 2007 Scoring Commentary.” https://secure-

media.collegeboard.org/apc/ap07_japanese_is_conversation.pdf.

———. 2007c. “Student Performance Q&A: 2007 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap07_japanese_q_a.pdf.

———. 2008a. “AP Japanese Language and Culture 2008 Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap-2008-japanese-language-free-response-questions.pdf.

———. 2008b. “AP Japanese Language and Culture 2008 Scoring Commentary.” https://secure-media.collegeboard.org/apc/ap08_japanese_interpersonal_speaking_conversation.pdf.

———. 2008c. “Student Performance Q&A: 2008 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap08_japanese_qa.pdf.

———. 2009a. “AP Japanese Language and Culture 2009 Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap-2009-japanese-language-free-response-questions.pdf.

———. 2009b. “AP Japanese Language and Culture 2009 Scoring Commentary.” https://secure-media.collegeboard.org/apc/ap09_japanese_interpersonal_speaking.pdf.

———. 2009c. “Student Performance Q&A: 2009 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap09_japanese_qa.pdf.

———. 2010a. “AP Japanese Language and Culture 2010 Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap-2010-japanese-language-free-response-questions.pdf.

———. 2010b. “AP Japanese Language and Culture 2010 Scoring Commentary.” https://secure-media.collegeboard.org/apc/ap10_japanese_interpersonal_speaking.pdf.

———. 2010c. “Student Performance Q&A: 2010 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap10_japanese_qa.pdf.

———. 2011a. “AP Japanese Language and Culture 2011 Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap-2011-japanese-language-free-response-questions.pdf.

———. 2011b. “AP Japanese Language and Culture 2011 Scoring Commentary.” https://secure-media.collegeboard.org/apc/ap11_japanese_interpersonal_speaking.pdf.

———. 2011c. “Student Performance Q&A: 2011 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap11_japanese_language_scoring_statistics.pdf.

———. 2012a. “AP Japanese Language and Culture 2012 Free-Response Questions.” https://secure-media.collegeboard.org/apc/ap_2012_frq_japanese.pdf.

———. 2012b. “AP Japanese Language and Culture 2012 Scoring Commentary.” https://secure-media.collegeboard.org/apc/ap12_japanese_interpersonal_speaking.pdf.

———. 2012c. “Student Performance Q&A: 2012 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap12_japanese_qa.pdf.

———. 2013a. “AP Japanese Language and Culture 2013 Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap13_frq_japanese.pdf.

———. 2013b. “AP Japanese Language and Culture 2013 Scoring Commentary.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap13_japanese_language_interpersonal_speaking.pdf.

———. 2013c. “Student Performance Q&A: 2013 AP Japanese Language and Culture Free-Response Questions.” College Board. https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap13_japanese_language_qa.pdf.

———. 2014a. “AP Japanese Language and Culture 2014 Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap14_frq_japanese_language.pdf.

———. 2014b. “AP Japanese Language and Culture 2014 Scoring Commentary.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap14_japanese_language_interpersonal_speaking.pdf.

———. 2014c. “Student Performance Q&A: 2014 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap14-japanese-qa.pdf.

———. 2015a. “AP Japanese Language and Culture 2015 Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap15_frq_japanese_language.pdf.

———. 2015b. “AP Japanese Language and Culture 2015 Scoring Commentary.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap15_Japanese_interpersonal_speaking_convo.pdf.

———. 2015c. “Student Performance Q&A: 2015 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap15-japanese-student-performance-qa.pdf.

———. 2016a. “AP Japanese Language and Culture 2016 Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap16_frq_japanese_language.pdf.

———. 2016b. “AP Japanese Language and Culture 2016 Scoring Commentary.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/apcentral/ap16_japanese_interpersonal_speaking_convo.pdf.

———. 2016c. “Student Performance Q&A: 2016 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap16_japanese_student_performance_qa.pdf.

———. 2017a. “AP Japanese Language and Culture: Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap-japanese-language-frq-2017.pdf.

———. 2017b. “AP Japanese Language and Culture: Sample Student Responses and Scoring Commentary.” https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap17-japanese-interpersonal-speaking-conversation.pdf.

———. 2017c. “Chief Reader Report on Student Responses: 2017 AP Japanese Language and Culture Free-Response Questions.” https://secure-media.collegeboard.org/ap/pdf/ap17-chief-reader-report-japanese-language.pdf.

———. 2018a. “AP Japanese Language and Culture: Sample Student Responses and Scoring Commentary.” https://secure-media.collegeboard.org/ap/pdf/ap18-japanese-interpersonal-speaking-conversation.pdf.

———. 2018b. “Chief Reader Report on Student Responses: 2018 AP Japanese Language and Culture Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap18-japanese-language-chief-reader-report.pdf.

———. 2019a. “AP Japanese Language and Culture: Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap19-frq-japanese-language_0.pdf.

———. 2019b. “AP Japanese Language and Culture: Sample Student Responses and Scoring Commentary.”

https://apcentral.collegeboard.org/media/pdf/ap19-apc-japanese-language-t3-interpersonal-speaking_1.pdf.

———. 2019c. “Chief Reader Report on Student Responses: 2019 AP Japanese Language and Culture Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap19-chief-reader-report-japanese-language.pdf.

———. 2020. “AP Japanese Language and Culture: Course and Exam Description.” https://apcentral.collegeboard.org/pdf/ap-japanese-language-and-culture-course-and-exam-description.pdf?course=ap-japanese-language-and-culture.

———. 2021a. “AP Japanese Language and Culture: Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap21-frq-japanese-language.pdf.

———. 2021b. “AP Japanese Language and Culture: Sample Student Responses and Scoring Commentary.” https://apcentral.collegeboard.org/media/pdf/ap21-apc-japanese-language-task-3.pdf.

———. 2021c. “Chief Reader Report on Student Responses: 2021 AP Japanese Language and Culture Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap21-chief-reader-report-japanese-language.pdf.

———. 2022a. “AP Japanese Language and Culture: Sample Student Responses and Scoring Commentary.” https://apcentral.collegeboard.org/media/pdf/ap22-apc-japanese-language-task-3.pdf.

———. 2022b. “AP Japanese Language and Culture: Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap22-frq-japanese-language.pdf.

———. 2022c. “AP Japanese Language and Culture Scoring Guidelines.” https://apcentral.collegeboard.org/media/pdf/ap22-sg-japanese-language.pdf.

———. 2022d. “AP Japanese Language and Culture Student Score Distributions – Global AP Exams – May 2022.” https://apcentral.collegeboard.org/media/pdf/ap22-japanese-language-score-distributions.pdf.

———. 2022e. “Chief Reader Report on Student Responses: 2022 AP Japanese Language and Culture Free-Response Questions.” https://apcentral.collegeboard.org/media/pdf/ap22-cr-report-japanese-language.pdf.

Enright, Mary K., Brent Bridgeman, Daniel Eignor, Robert N. Kantor, Pamela Mollaun, Susan Nissan, Donald E. Powers, and Mary Schedl. 2008. “Prototyping New Assessment Tasks.” In Building a Validity Argument for the Test of English as a Foreign Language, edited by Carol A. Chapelle, Mary K. Enright, and Joan M. Jamieson, 97–143. ESL & Applied Linguistics Professional Series. New York: Routledge.

Ford, Cecilia E., and Junko Mori. 1994. “Causal Markers in Japanese and English Conversations: A Cross-Linguistic Study of Interactional Grammar.” Pragmatics 4 (1): 31–61. https://doi.org/10.1075/prag.4.1.03for.

Fulcher, Glenn. 2003. Testing Second Language Speaking. Applied Linguistics and Language Study. New York: Routledge.

Hutchby, Ian., and Robin Wooffitt. 1998. Conversation Analysis: Principles, Practices and Applications. Cambridge, U.K. and Malden, MA: Polity Press.

Hymes, Dell. 1985. “Toward Linguistic Competence.” Revue d l’AILA: AILA Review 2: 9–23.

Iwasaki, Shoichi. 1997. “The Northridge Earthquake Conversations: The Floor Structure and the ‘Loop’ Sequence in Japanese Conversation,” in “Japanese Pragmatics, ” ed. Yoshiko Matsumoto, special issue, Journal of Pragmatics 28 (6): 661–93. https://doi.org/10.1016/S0378-2166(97)00070-2.

Jamieson, Joan M., Daniel Eignor, William Grabe, and Antony John Kunnan. 2008. “Frameworks for a New TOEFL.” In Building a Validity Argument for the Test of English as a Foreign Language, edited by Carol A. Chapelle, Mary K. Enright, and Joan M. Jamieson, 55–95. ESL & Applied Linguistics Professional Series. New York: Routledge.

Johnson, Marysia. 2000. “Interaction in the Oral Proficiency Interview: Problems of Validity.” Pragmatics 10 (2): 215–31.

Johnson, Marysia, and Andrea Tyler. 1998. “Re-Analyzing the OPI: How Much Does It Look like Natural Conversation?” In Talking and Testing: Discourse Approaches to the Assessment of Oral Proficiency, edited by Agnes Weiyun He and Richard Young, 27–51. Amsterdam: John Benjamins Publishing Company.

Kane, Michael T. 1992. “An Argument-Based Approach to Validity.” Psychological Bulletin 112 (3): 527. https://doi.org/10.1037/0033-2909.112.3.527.

Kane, Michael T., Terence Crooks, and Allan Cohen. 1999. “Validating Measures of Performance.” Educational Measurement: Issues and Practice 18 (2): 5–17. https://doi.org/10.1111/j.1745-3992.1999.tb00010.x.

Kasper, Gabriele, and Steven J. Ross. 2007. “Multiple Questions in Oral Proficiency Interviews.” in “High Stakes Gatekeeping Encounters and their Consequences: Discourses in Intercultural Institutional Settings,” ed. Julie Kerekes, special issue, Journal of Pragmatics 39 (11): 2045–70. https://doi.org/10.1016/j.pragma.2007.07.011.

Laver, John. 1975. “Communicative Functions of Phatic Communion.” In Organization of Behavior in Face-to-Face Interaction, edited by Richard M. Harris, Adam Kendon, and Mary Ritchie Key, 215–38. World Anthropology. The Hague: Mouton. https://doi.org/10.1515/9783110907643.215.

Malinowski, Bronislaw. 1953. “The Problem of Meaning in Primitive Languages.” In The Meaning of Meaning: A Study of the Influence of Language upon Thought and of the Science of Symbolism, edited by C. K. Ogden and I. A. Richards, 8th ed., 296–336. New York: Harcourt, Brace, & Co.

McCormick, Dawn E., and Richard Donato. 2000. “Teacher Questions as Scaffolded Assistance in an ESL Classroom.” In Second and Foreign Language Learning through Classroom Interaction, edited by Joan Kelly Hall and Lorrie Stoops Verplatse, 183–201. Mahwah, N.J. and London: Erlbaum.

Messick, Samuel. 1989. “Validity.” In Educational Measurement, edited by R. L. Linn, 3rd ed., 13–103. New York: Macmillan.

Mori, Junko. 1999. Negotiating Agreement and Disagreement in Japanese: Connective Expressions and Turn Construction. Studies in Discourse and Grammar, vol. 8. Amsterdam: John Benjamins Publishing Company. https://doi.org/10.1075/sidag.8.

———. 2005. “Why Not Why? The Teaching of Grammar, Discourse, Sociolinguistic and Cross-Cultural Perspectives.” Japanese Language and Literature 39 (2): 255–89. https://doi.org/10.2307/30038902.

National Standard Collaborative Board. 2015. World-Readiness Standards for Learning Languages. 4th ed. Alexandria, VA: American Council on the Teaching of Foreign Languages.

National Standards in Foreign Language Education Project. 1999. Standards for Foreign Language Learning in the 21st Century. 2nd ed. Yonkers, NY: Author.

Ockey, Gary J., and Reza Neiriz. 2021. “Evaluating Technology-Mediated Second Language Oral Communication Assessment Delivery Models.” Assessment in Education: Principles, Policy & Practice 28 (4): 350–68. https://doi.org/10.1080/0969594X.2021.1976106.

Park, Moonyoung. 2021. “Domain Definition Inference for a Virtual Interactive Aviation English Test (VIAET) for Military Air Traffic Controllers.” In Validity Argument in Language Testing: Case Studies of Validation Research, edited by Carol A. Chapelle and Erik Voss, 73–95. The Cambridge Applied Linguistics Series. Cambridge, U.K.: Cambridge University Press.

Sacks, Harvey, Emanuel A. Schegloff, and Gail Jefferson. 1974. “A Simplest Systematics for the Organization of Turn-Taking for Conversation.” Language 50 (4): 696–735. https://doi.org/10.2307/412243.

Savignon, Sandra J. 1983. Communicative Competence: Theory and Classroom Practice. Menlo Park, CA: Addison-Wesley Publishing Company.

Schegloff, Emanuel A. 1982. “Discourse as an Interactional Achievement: Some Uses of ‘Uh Huh’ and Other Things That Come between Sentences.” In Analyzing Discourse: Text and Talk, edited by Deborah Tannen, 71–93. Washington, DC: Georgetown University Press.

Schegloff, Emanuel A. 2007. Sequence Organization in Interaction: A Primer in Conversation Analysis, vol. 1. Leiden: Cambridge University Press. https://doi.org/10.1017/CBO9780511791208.

Schegloff, Emanuel A., and Harvey Sacks. 1973. “Opening up Closing.” Semiotica 8: 289–327. https://doi.org/10.1515/semi.1973.8.4.289.

Searle, John R. 1969. Speech Acts: An Essay in the Philosophy of Language. London: Cambridge University Press. https://doi.org/10.1017/CBO9781139173438.

Searle, John R. 1979. Expression and Meaning: Studies in the Theory of Speech Acts. Cambridge, U.K.: Cambridge University Press. https://doi.org/10.1017/CBO9780511609213.

Shepard, Lorrie A. 1993. “Evaluating Test Validity.” Review of Research in Education 19: 405–50. https://doi.org/10.2307/1167347.

Streeck, Jürgen. 1980. “Speech Acts in Interaction: A Critique of Searle.” Discourse Processes 3 (2): 133–53. https://doi.org/10.1080/01638538009544483.

Suzuki, Takao. 1981. “Aisatsu Towa Nanika [What Is Aisatsu?].” In Aisatsu to Kotoba [Greetings and Words], edited by Agency for Cultural Affairs, 14: 34–46. Printing Bureau of the Ministry of Finance.

Tanaka, Hiroko. 1999. Turn-Taking in Japanese Conversation: A Study in Grammar and Interaction. Pragmatics & Beyond New Series 56. Amsterdam: John Benjamins Publishing Company. https://doi.org/10.1075/pbns.56.

Tateyama, Yumiko. 2000. “Use of Japanese Connectives, Sorede, Dakara, and Ja in JFL Classroom Discourse [Paper Presentation].” In Proceedings 2000: Selected Papers from the Fourth College-Wide Conference for Students in Languages, Linguistics and Literature, edited by G. Sibley, N. Ochner, and K. Russell, 58–67. Honolulu, HI: National Foreign Language Resource Center, University of Hawai‘i, Mānoa.

Tohsaku, Yasu-hiko. 2009. “AP Japanese Language and Culture: Teacher’s Guide.” College Board. http://apcentral.collegeboard.com/apc/public/repository/japanese_teachers_guide.pdf.

Downloads

Published

2026-04-27

Issue

Vol. 60 No. 1 (2026): Japanese Language and Literature

Section

LINGUISTICS AND PEDAGOGY ARTICLES

License

Copyright (c) 2026 Nana Suzumura

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

  1. The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
  2. Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
  3. The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons Attribution 4.0 Licenseor its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
    1. Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site;
    with the understanding that the above condition can be waived with permission from the Author and that where the Work or any of its elements is in the public domain under applicable law, that status is in no way affected by the license.
  4. The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgement of its initial publication in this journal.
  5. Authors are permitted and encouraged to post online a pre-publication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
  6. Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
  7. The Author represents and warrants that:
    1. the Work is the Author’s original work;
    2. the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
    3. the Work is not pending review or under consideration by another publisher;
    4. the Work has not previously been published;
    5. the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
    6. the Work contains no libel, invasion of privacy, or other unlawful matter.
  8. The Author agrees to indemnify and hold Publisher harmless from Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.
  9. The Author agrees to digitally sign the Publisher’s final formatted PDF version of the Work.