The Concise Encyclopedia of Applied Linguistics. Carol A. Chapelle

Figure 2 List of phonological forms

      The form‐based approach to assessing knowledge of grammatical forms was the dominant paradigm in L2 assessment until the 1980s and remains even today the basis for test development in many contexts globally. Assessments rooted in this model are organized around the elicitation of discrete grammatical forms, whether they are assessed via selected‐response (SR), limited‐production (LP), or extended‐production (EP) tasks. Finally, the measurement of discrete grammatical forms is currently the mainstay of automated speech and writing assessments, as will follow.

To make the form‐based approach more useful for assessment, Purpura (2004) proposed a model of grammatical knowledge identifying how forms can be organized on the (sub)sentential and discourse levels. This model specifies graphological, phonological, lexical, morphosyntactic, cohesive, information management, and interactional forms (see Figure 3). These categories can be further elaborated to develop content specifications for grammar assessments, and to ultimately provide evidence of content representativeness. Figure 3 also shows how these discrete forms have typically been measured in SR and LP tasks.

Figure 3 Grammatical knowledge as form (adapted from Purpura, 2004, reproduced with permission of Cambridge University Press through PLSclear)

      The form‐based approach to grammar assessment is useful for providing fine‐grained information about a range of structures across proficiency levels. This approach is useful in diagnostic assessment, in assessments designed to provide individualized feedback, or in automated scoring protocols. Assessments based on the measurement of one or more discrete grammatical forms, however, should not be interpreted as a measure of L2 proficiency, as has been the case in many studies. L2 proficiency involves much more than knowledge of grammatical forms. That said, grammatical knowledge is, in fact, a fundamental component of L2 proficiency, and several studies (e.g., Grabowski, 2009; Kim, 2009; Liao, 2009) have produced consistently strong evidence of a relationship between grammatical knowledge and the ability of learners to use the L2 in context.

      In the end, a form‐based conceptualization of L2 knowledge is narrow in scope because in language use a grammatical form is rarely disassociated from its meaning potential. Consequently, this conceptualization fails to address the semantic dimension of grammar, where, for example, an ‐ed affix encodes past time. It also fails to capture how a sequence of forms in an utterance contribute to the conveyance of propositional meaning, or even how forms used in certain contexts can extend meanings by encoding social status, formality, culture, affect, stance, or other implied pragmatic meanings. The limitation of a form‐based conceptualization is especially evident in cases where meaning extensions can only be derived from context and are dependent upon an understanding of shared norms, assumptions, expectations, and interlocutor presuppositions. Thus, the semantic dimension must be considered if meaningful communication is prioritized over grammatically flawless communication. Finally, the semantic dimension must also be addressed if assessment is to provide comprehensive feedback, since some learners have mastered the form, but not its meaning, or vice versa. Or learners might understand the forms and associated semantic meanings but be incapable of expressing or interpreting meanings extended in context.

Conceptualizing L2 Proficiency as a Set of Resources for Communicating Contextualized Meanings

Linguists acknowledge that almost all linguistic forms are associated with semantic meaning, and that semantico‐grammatical knowledge is a critical component of the ability to comprehend and generate literal propositions (Purpura, 2016). In other words, graphological/phonological, lexical, morphosyntactic, cohesive, information management, and interactional forms all encode a semantic dimension, and when these form‐meaning mappings are arranged in syntax, they produce utterances which carry propositional meaning (Purpura, 2004). In assessment, the semantic dimension needs to be taken into account since response data vary in terms of semantic meaningfulness. Imagine a context in which a patient calls his doctor for a consultation, and the doctor replies: “I work with a patient now” (literal meaning, my current job is to do this work). This response reflects a knowledge gap in the connection between the morphosyntactic form work and its associated meaning (habitual time), and in this context, such an error may produce a misunderstanding. However, if the doctor responded: “I working with a patient now” or “I'm working with a patient now” the meaning in both cases, despite the form error, would be: “I am currently occupied—and unavailable to talk.” The meaning of the proposition would have been conveyed. Note that assessment decisions related to all three responses would obviously be different, again underscoring the importance of the meaning dimension. To highlight the importance of semantic meaning as a resource for L2 proficiency, Purpura (2004, 2016) extended the form‐based model of grammatical knowledge to include a semantic dimension. Figure 4 presents a characterization of semantico‐grammatical knowledge, along with items typically used to measure this dimension.

Figure 4 Semantico grammatical knowledge (adapted from Purpura, 2004, reproduced with permission of Cambridge University Press through PLSclear, and Purpura, 2016, used with permission)

      When grammatical forms combine with their individual meanings in a well‐formed utterance, they express a proposition (i.e., an idea, opinion, belief). This is referred to as the propositional (also, topical or content) meaning of an utterance. Propositional meaning is encoded in all utterances. An examinee draws on propositional or topical knowledge in LTM (long‐term memory) when she understands or expresses ideas. Thus, propositional or topical knowledge is intrinsically related to semantico‐grammatical ability and to L2 proficiency, since without propositional content, we would have language ability with nothing to say. Furthermore, it is unlikely that we could express well‐formed propositional content with no symbolic resources for expressing this content.

Moving beyond the semantic meaning of individual forms, language assessment focuses on the evaluation of one or more propositions in response data. However, given the long tradition of a form‐based approach to assessment, the scoring of utterances revolves mostly around the accuracy of the forms, rather than the quality or meaningfulness of the information expressed. To highlight the importance of propositional meaning as a resource for communication, Purpura (2016) extended the notion of semantico‐grammatical knowledge to include a propositional dimension. Figure 5 presents a characterization of propositional knowledge, along with items typically used to measure this dimension.

In many L2 assessments, examinees are expected to understand or express utterances with no reference to context beyond what is embodied in a sentence or two (see Figure 5). This aspect of semantics is referred to as the linguistic meaning of a sentence. In real‐life language use, however, language users have full access to the situational context. In these instances, they use semantico‐grammatical forms to understand and express utterances that carry propositional information within some goal‐oriented, interactional activity. The propositional content of the utterances comes from each interlocutor's topical knowledge in LTM (e.g., situational, interpersonal, transactional, experiential, autobiographical, imaginative, academic, or professional information). Interlocutors use these literal propositions not only to communicate topical content, but also to perform communicative acts or