Journal of Universal Language
Sejong University Language Research Institue
Article

A PCA-Based Pseudotime Approach to Syntactic Complexity Development in L2 Writing

Wonbin Kim1
1Sejong University, Korea
Corresponding author : Assistant Professor, Department of English Data Convergence, Division of International Studies, Sejong University, Korea, Email: wbkim@sejong.ac.kr

Copyright © 2026 Language Research Institute, Sejong University. Journal of Universal Language is an Open Access Journal. All articles are distributed online under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: Jun 15, 2026; Revised: Aug 03, 2026; Accepted: Sep 16, 2026

Published Online: Sep 30, 2026

Abstract

This study aims to construct a pseudo-developmental axis for examining developmental patterns in syntactic complexity and investigate how different subdimensions of syntactic complexity develop along this inferred axis. To this end, it measured 14 syntactic complexity indices from essays written by Asian learners of English and native speakers in the International Corpus Network of Asian Learners of English. Principal component analysis was applied to four theoretically selected syntactic complexity indices to construct a continuous developmental axis, or pseudotime. Its validity was assessed through proficiency-level associations and bootstrap-based stability analyses. Changes in six indices along this axis were then analyzed using generalized additive models and bootstrap-based sup-t simultaneous confidence bands. The results showed that pseudotime values increased with higher proficiency levels, and the developmental axis was structurally stable, supporting pseudotime as a measure of syntactic development. Along this axis, the five indices related to length, clausal subordination, syntactic complexity, and complex nominals increased significantly, whereas the coordination index, T/S, showed no significant change, indicating that the subdimensions of syntactic complexity did not develop uniformly. This study provides empirical support for treating syntactic complexity as a multidimensional construct and offers a new analytical approach to investigating language development without longitudinal data.

Keywords: syntactic complexity; pseudotime; principal component analysis; generalized additive model; second language writing

1. Introduction

In L2 writing, the complexity and variety of syntactic structures produced by learners have generally been considered to reflect their level of language development (e.g., Kuiken and Vedder 2019; Martínez 2018). Accordingly, syntactic complexity has been widely used in writing assessment, proficiency evaluation, and research on L2 development (e.g., Barrot and Agdeppa 2021; Grant and Ginther 2000; Hwang 2025; Kim and Crossley 2018; Kyle and Crossley 2018; Li and Yang 2023; Sarte and Gnevsheva 2022; Vyatkina 2012; Wu and Lu 2024). In particular, advances in computational tools capable of capturing various aspects of syntactic complexity, including subordination, coordination, phrasal elaboration, and the length of production units, have enabled researchers to measure syntactic complexity using multiple indices at different structural levels, such as clauses, T-units, sentences, and phrases, stimulating extensive research on the multidimensional nature of syntactic complexity.

However, these different dimensions of syntactic complexity do not necessarily develop in the same way, and syntactic complexity needs to be regarded as a multidimensional construct, with different dimensions becoming more important at different levels of proficiency. Norris and Ortega (2009) proposed that the primary source of syntactic complexity may shift from coordination to subordination and eventually to phrasal elaboration as proficiency develops. Biber, Gray, and Poonpon (2011) further argued that, in advanced academic writing, phrasal complexity, particularly complex noun phrases, is a more important characteristic than clause-level subordination. In addition, Bulté and Housen (2014) reported that commonly used subordination-based measures may not adequately capture short-term development, indicating that syntactic development should be examined using multiple dimensions rather than relying on subordination alone. These studies suggest that different dimensions of syntactic complexity may follow different developmental patterns. Nevertheless, relatively few studies have examined from a continuous perspective how multiple dimensions change together or differently over the course of development.

To investigate such developmental patterns, longitudinal data that track the same learners over time are ideal. However, collecting longitudinal data is time-consuming and costly, and it is often difficult in practice to build large datasets covering a sufficient number of time points. Because of these constraints, many studies have relied on cross-sectional approaches that compare learners at different proficiency levels (e.g., Lu 2011; Verspoor, Schmid, and Xu 2012). However, comparisons of mean values across proficiency groups treat development as a limited number of discrete stages, making it difficult to capture in detail how syntactic complexity changes along a continuous developmental process and how its multiple dimensions change together throughout this process.

To address these limitations, the present study proposes an approach that reconstructs developmental ordering without requiring long-term longitudinal observation by ordering cross-sectional observations along an inferred developmental continuum, or pseudotime. Specifically, the present study applies PCA1 to a theoretically selected subset of syntactic complexity indices to construct a continuous developmental axis (pseudotime). It then quantitatively models how other syntactic complexity indices change along this axis using GAMs and bootstrap-based simultaneous confidence bands.

The present study aims to examine whether the pseudotime axis can function as a developmental axis and whether different dimensions of syntactic complexity exhibit similar or distinct patterns along this axis from a continuous perspective. Accordingly, the present study addresses the following two research questions:

  1. Does the pseudotime axis validly reflect learners’ actual proficiency development?

  2. How do different dimensions of syntactic complexity change along this developmental axis?

2. Literature Review

2.1. Multidimensionality of Syntactic Complexity in L2 Writing

Advances in computational tools for the automatic measurement of syntactic complexity have encouraged research on syntactic complexity. In particular, tools such as L2SCA have made it possible to automatically calculate multiple indices at different structural levels, including clauses, T-units, sentences, and phrases, thereby providing researchers with a basis for empirically examining the multidimensional nature of syntactic complexity. Table 1 presents 14 syntactic complexity indices generated by L2SCA (Lu 2010), which have been widely used in L2 writing research. These 14 indices can be classified into five categories: length of production units, sentence complexity, subordination, coordination, and particular structures. Many researchers have used these indices to compare syntactic complexity across proficiency levels or L1 groups (e.g., Khushik and Huhta 2020; Lu 2011; Lu and Ai 2015; Yoon 2017).

Table 1. 14 Syntactic Complexity Indices Generated by L2 Syntactic Complexity Analyzer (L2SCA)
Category Index (Abbreviation) Definition
Length of production unit mean length of clause (MLC) number of words / number of clauses
mean length of sentence (MLS) number of words / number of sentences
mean length of T-unit (MLT) number of words / number of T-units
Sentence complexity clauses per sentence (C/S) number of clauses / number of sentences
Subordination clauses per T-unit (C/T) number of clauses / number of T-units
complex T-units per T-unit (CT/T) number of complex T-units / number of T-units
dependent clauses per clause (DC/C) number of dependent clauses / number of clauses
dependent clauses per T-unit (DC/T) number of dependent clauses / number of T-units
Coordination coordinate phrases per clause (CP/C) number of coordinate phrases / number of clauses
coordinate phrases per T-unit (CP/T) number of coordinate phrases / number of T-units
T-units per sentence (T/S) number of T-units / number of sentences
Particular structures complex nominals per clause (CN/C) number of complex nominals / number of clauses
complex nominals per T-unit (CN/T) number of complex nominals / number of T-units
verb phrases per T-unit (VP/T) number of verb phrases / number of T-units
Download Excel Table

For example, Lu (2011) conducted a cross-sectional comparison of the 14 L2SCA indices using the WECCL, with university year levels (Years 1–4) serving as a proxy for proficiency. After controlling for institutional, genre, and timing conditions, the study examined which indices significantly distinguished adjacent proficiency levels. The results showed that only 10 of the 14 indices significantly differentiated levels. Measures of length, nominal complexity, and phrasal coordination (MLC, MLS, MLT, CN/T, CN/C, CP/T, and CP/C) increased at higher levels, whereas C/S, DC/C, and DC/T decreased. In contrast, C/T, CT/T, T/S, and VP/T did not show significant differences across levels.

Lu and Ai (2015) examined how syntactic complexity in college-level English argumentative writing varied according to learners’ L1 backgrounds. Their dataset consisted of 200 essays written by native English-speaking U.S. university students from LOCNESS and 1,400 essays written by EFL learners from seven different L1 backgrounds in ICLE 2.0, with 200 essays from each L1 group. All essays were analyzed using the 14 syntactic complexity indices generated by L2SCA. When the learners’ L1 backgrounds were ignored and all NNSs were compared with NSs as a single group, significant differences were found in only three of the 14 indices: MLC, CN/C, and CN/T. However, when the learners were separated according to L1 background, significant differences emerged in all 14 indices between the NS group and at least one L1 group, and the individual L1 groups differed from the NS group in substantially different ways.

Taken together, studies comparing individual dimensions of syntactic complexity across groups suggest that syntactic complexity cannot be adequately treated as a single, unitary characteristic. Different dimensions may show different directions and degrees of change across groups; significant differences may appear in some indices but not in others, and the patterns of difference may also vary across groups. This aligns with Norris and Ortega’s (2009) view of syntactic complexity as a multidimensional construct with distinct subdimensions. Norris and Ortega (2009) proposed that syntactic complexity should be assessed across multiple dimensions, including global complexity, subordination, coordination, and phrasal elaboration. They further emphasized that the primary source of syntactic complexity may change as proficiency develops. Coordination may play a relatively important role at earlier stages, followed by greater use of subordination, while phrasal elaboration may become a more important resource at higher proficiency levels.

From this perspective, the development of syntactic complexity can be regarded not as a process in which all syntactic structures increase uniformly with proficiency, but rather as a process in which different dimensions of syntactic complexity become more prominent at different stages of development. Therefore, a more accurate understanding of syntactic complexity development requires moving beyond group comparisons of individual indices and examining how multiple dimensions change together across a continuous developmental process.

2.2. Approaches to Investigating Syntactic Complexity Development: Longitudinal vs. Cross-Sectional

Two main approaches have been used to investigate how syntactic complexity changes over the course of learner development. One is a longitudinal approach, which repeatedly observes the same learners over a period of time, and the other is a cross-sectional approach, which compares learners at different proficiency levels at a single point in time. Although the longitudinal approach is ideal in that it allows researchers to directly observe development, collecting data from the same learners over an extended period with a sufficient number of observation points is difficult in terms of both time and cost. Indeed, longitudinal studies of changes in syntactic complexity have been relatively rare and have often been limited by small sample sizes or a small number of observation points (Kim 2021). Because of these constraints, many studies have relied on cross-sectional approaches, indirectly inferring developmental patterns by comparing learners at different proficiency levels (e.g., Jiang, Bi, and Liu 2019; Kuiken and Vedder 2019; Lu 2011; Verspoor, Schmid, and Xu 2012).

As an example of the longitudinal approach, Kim (2021) examined longitudinal changes in lexical and syntactic features in the writing of beginning-level Korean EFL university students. The study analyzed 630 essays produced by 90 learners at seven time points over an academic semester. LME models, which treated time as a continuous variable and accounted for individual differences among learners, were used to examine changes in 13 measures (one text-length measure, seven lexical measures, and five syntactic measures), while repeated measures correlations were used to investigate longitudinal relationships among the features. The results showed significant developmental patterns in lexical features, including the use of more sophisticated content words and an increased use of function words. In contrast, little significant change over time was found in syntactic complexity, with CN/C being the only measure that changed significantly, and it showed a decreasing pattern. Kim suggested that beginning-level learners may develop lexical features to a greater degree than syntactic features and that commonly used syntactic complexity measures may not be sufficiently sensitive to capture short-term developmental changes over a single semester.

In contrast, Jiang, Bi, and Liu (2019), representing the cross-sectional approach, examined syntactic complexity cross-sectionally in 410 narrative essays written by beginner- and intermediate-level EFL learners across four proficiency levels. Seven large-grained measures were obtained using L2SCA, and eight fine-grained measures were extracted from a dependency-annotated corpus. For the statistical analyses, MANOVA and post hoc tests were applied to measures that met the assumptions of normality and homogeneity of variance, whereas the Kruskal–Wallis test was used for measures that did not meet these assumptions to determine which measures best discriminated and predicted writing proficiency. The results showed that most large-grained measures increased with proficiency, with MLT, MLS, and DC/C showing particularly strong discrimination across levels, whereas CP/C did not. Fine-grained analyses showed greater use of subordinate clauses and post-nominal modifiers at higher levels, while compound nouns decreased and complement clauses followed a nonlinear pattern. They interpreted these findings as supporting a developmental shift from coordination to subordination and then to phrasal elaboration, and emphasized that syntactic complexity develops dynamically across multiple dimensions.

Although many studies have relied on the cross-sectional approach because of its advantages, it also has several limitations. By dividing development into a small number of discrete stages or groups for comparison, this approach makes it difficult to capture in detail how syntactic complexity changes along a continuous developmental process and how its multiple subdimensions change together or differently over that process (O’Leary and Steinkrauss 2022; Verspoor, Schmid, and Xu 2012). Comparisons across proficiency levels show only mean differences between adjacent groups and do not model development as a continuous process. To address this gap, the present study proposes a new analytical approach that reconstructs development from large-scale cross-sectional data along a continuous axis without requiring longitudinal data and examines how multiple dimensions of syntactic complexity change along that axis.

3. Methods

3.1. Data

The present study utilized data from the ICNALE (https://language.sakura.ne.jp/icnale/download.html; Ishikawa 2013) because it provides a large learner sample, common writing tasks across groups with different first-language backgrounds, learner-level proficiency information, and detailed background survey data. ICNALE includes English data from learners representing 10 Asian L1 backgrounds: CHN, HKG, IDN, JPN, KOR, PAK, PHL, SIN, THA, and TWN. The corpus is organized into five modules—Spoken Monologue, Spoken Dialogue, Written Essays, Written Essays Plus, and Edited Essays—of which only the Written Essays module was analyzed in this study.

The dataset analyzed in the present study, which included 10 Asian L1 groups and ENS, consisted of 5,598 argumentative essays produced by 2,800 participants (two prompts per learner, with two exceptions for whom only one prompt was available). Each learner responded to two controlled prompts: (i) whether it is important for college students to have part-time jobs and (ii) whether smoking should be completely banned in restaurants. The learners were required to write an essay using a word processor within 20–40 minutes, with a target length of 200–300 words. Dictionary use was not permitted to reduce external assistance that might affect the linguistic characteristics of the written production. Asian learners’ proficiency was classified into four ICNALE proficiency bands aligned with the CEFR: A2_0, B1_1, B1_2, and B2_0. A2_0 corresponds to the pre-intermediate level, B1_1 and B1_2 to the intermediate level, and B2_0 to the upper-intermediate level. The distribution of essays by L1 background and proficiency level is presented in Table 2. The dataset was unevenly distributed across proficiency levels, with B1_1 and B1_2 essays accounting for the largest proportions. By contrast, the 400 essays written by 200 ENS participants were not divided into proficiency levels.

Table 2. Distribution of Essays across L1 Backgrounds and CEFR Proficiency Levels
L1 Background A2_0 B1_1 B1_2 B2_0 Total
CHN 100 464 208 26 798
HKG 2 60 104 34 200
IDN 64 164 166 6 400
JPN 308 358 98 36 800
KOR 150 122 176 152 600
PAK 36 182 176 6 400
PHL 4 22 352 22 400
SIN 0 0 268 132 400
THA 238 358 200 4 800
TWN 58 174 122 46 400
Total 960 1904 1870 464 5198
Download Excel Table
3.2. Data Analysis

Values for 14 syntactic complexity indices were calculated from the argumentative essay dataset using the L2SCA measures implemented in the TAASSC (Kyle 2016). To construct a developmental pseudotime for syntactic complexity, a subset of the 14 syntactic complexity indices was selected based on a theoretical review. Given the relatively narrow CEFR proficiency range in the dataset used in the present study (from A2_0 to B2_0) and the finding by Bulté and Housen (2014) that subordination-ratio indices may not sufficiently capture short-term developmental changes, subordination-focused indices were excluded. As Biber, Gray, and Poonpon (2011) suggested that, in advanced academic writing, phrase-level complexity, such as complex noun phrases, is relied on more heavily than clause-level complexity involving embedded or dependent clauses, CN/C, which represents complex nominals per clause, was selected. CN/T, another complex nominal index, was excluded because it exhibited extremely high correlations with subordination-related indices, specifically C/T (r ≈ .92) and DC/T (r ≈ .91). In addition, Norris and Ortega (2009) viewed syntactic complexity as a multidimensional construct and proposed that the primary source of complexity shifts from coordination to subordination and ultimately to phrasal elaboration over the course of development. Accordingly, the coordination-related indices CP/C and CP/T were selected. Finally, MLC was selected as a length-based index capable of capturing phrasal expansion and structural elaboration within clauses.

To evaluate the suitability of the four selected indices (CN/C, CP/C, CP/T, and MLC) for constructing the developmental pseudotime, Bartlett’s test of sphericity was conducted, the KMO measure of sampling adequacy was calculated, and individual MSA was computed for each index. After the statistical appropriateness of summarizing the four indices along a common dimension was confirmed, the four indices were standardized so that no single index would dominate due to scale differences. Then, PCA was performed to reduce them to a single composite value. The percentage of the total variance accounted for by the PC1 was examined, and its retention was further supported by Horn’s parallel analysis based on the 95th percentile of eigenvalues from 1,000 randomly generated datasets. PC1 was oriented using MLC and CN/C so that higher scores indicated greater phrasal elaboration. Finally, the resulting PC1 scores were rescaled to range from 0 to 1 using min–max scaling, and the rescaled score was defined as pseudotime representing each learner’s position along the syntactic developmental axis.

To verify whether the pseudotime axis reflects actual proficiency development, three validation procedures were conducted. First, to prevent the two essays written by the same learner from being treated as independent samples, a mean pseudotime score was calculated for each learner. Using these learner-level scores, the study examined whether the mean pseudotime increased sequentially across the CEFR levels (A2_0 < B1_1 < B1_2 < B2_0 < ENS). Secondly, Welch’s ANOVA and Games–Howell post hoc tests were used to assess the statistical significance of mean pseudotime differences across the proficiency groups. Thirdly, Spearman’s rank correlation was used to verify the monotonic relationship between the CEFR proficiency and pseudotime. In addition to assessing the construct validity of the pseudotime axis, its structural stability was evaluated by performing 1,000 learner-level bootstrap resamples, reapplying PCA to the four indices in each iteration, and estimating the sign stability and 95% confidence intervals of the PC1 loadings.

After establishing the validity of the pseudotime axis as a developmental trajectory of syntactic complexity, changes in the syntactic complexity indices not used in axis construction were analyzed along this developmental timeline. Among the remaining 10 indices (14 – 4), highly correlated and redundant measures were removed, and only the representative indices for each dimension were included in the final analysis. Specifically, indices showing learner-level correlations of |r| ≥ .80 were treated as redundant. MLS was highly correlated with MLT (r = .81), DC/T with C/T (r = .98), CT/T with DC/C (r = .89), and VP/T with CN/T (r = .87); therefore, MLS, DC/T, CT/T, and VP/T were excluded. As a result, six indices were retained: C/T and DC/C for subordination, MLT for length, C/S for syntactic complexity, T/S for coordination, and CN/T for phrasal complexity. With the pseudotime score for each learner as a continuous explanatory variable (x-axis) and C/T, DC/C, MLT, C/S, T/S, and CN/T as outcome variables (y-axis), GAMs based on penalized B-splines were fitted. Aggregating both the explanatory and outcome variables to learner-level mean values eliminated the non-independence arising from treating two essays written by the same learner as separate independent observations. Each GAM used a cubic B-spline basis (basis dimension = 10), with the smoothing penalty parameter fixed at α = 1. EDF were estimated for each smooth to assess the degree of nonlinearity in the fitted curves. An EDF of approximately 1 indicates an almost linear relationship, whereas larger EDF values indicate increasingly complex nonlinear patterns.

Since the fitted curves obtained through GAMs are based on a specific sample, namely the ICNALE written essay sample, their shapes may vary across samples. Therefore, the statistical stability of the results was evaluated by presenting confidence bands that reflect this uncertainty. Specifically, curve uncertainty was estimated using learner-level bootstrapping. The learner sample was resampled with replacement 300 times, with the curve refitted once for each resample. During this process, any resamples for which model fitting failed were discarded and replaced by newly drawn resamples rather than by the original curve, thereby preventing bootstrap variability from being artificially deflated. To determine the boundaries of the 95% simultaneous confidence bands from the 300 bootstrap curves, standardized deviations between the original fitted curve and the bootstrap curves were calculated at each pseudotime point.

Taking the first bootstrap curve as an example, at each of the 200 points along the pseudotime axis, we calculated the deviations of the first bootstrap curve from the original estimated curve. These deviations were then divided by the standard deviation of the values obtained across the 300 bootstrap iterations at each point (i.e., the bootstrap standard error) to obtain the standardized deviation. Next, the maximum absolute value among the 200 standardized deviations from the first bootstrap curve was identified. By repeating this procedure for the remaining 299 bootstrap curves, a total of 300 maximum absolute standardized deviations were obtained. These values were ordered from smallest to largest, and the 95th percentile of the resulting empirical distribution was used as the critical value for determining the width of the 95% sup-t simultaneous confidence band. At each pseudotime point, the width of the confidence band was determined by multiplying this critical value by the bootstrap standard error at that point. Intervals of significant change were defined as regions where the simultaneous confidence band for the slope of the curve (i.e., the first derivative) did not include zero, because a slope of zero indicates no increase or decrease in the fitted curve. To address potential estimation instability at the boundaries, where sparse data at the extreme ends of the pseudotime axis might produce spurious curvature, the outer 1% at each end was trimmed, and only the central 98% of the axis was evaluated. All these analyses in the present study were conducted in Python (version 3.14.3).

4. Results

Prior to the construction of the developmental axis (pseudotime), the statistical appropriateness of summarizing the four selected indices (MLC, CP/T, CP/C, and CN/C) into a single principal component was evaluated. Bartlett’s test of sphericity was significant, χ2(6) = 6,815.5, p < .001, indicating that the indices were sufficiently correlated for PCA. The overall KMO measure of sampling adequacy was .60, meeting the acceptable threshold, and all individual MSAs exceeded .50 (MLC = .69, CN/C = .71, CP/C = .57, and CP/T = .56), supporting the suitability of the four indices for PCA.

Next, the four indices were standardized, and PCA was conducted. PC1 explained 54.6% of the total variance (eigenvalue ≈ 2.18), with positive loadings for all four indices (CP/C = .87, CP/T = .81, CN/C = .66, and MLC = .58). Horn’s parallel analysis based on 1,000 randomly generated datasets and the 95th-percentile criterion indicated that PC1 was the only component whose observed eigenvalue exceeded the corresponding random threshold, thereby further supporting the retention of PC1. PC1 was oriented using CN/C and MLC as theoretical reference indices because CN/C is a key index directly reflecting nominal elaboration, whereas MLC reflects overall structural expansion within clauses; accordingly, the direction of the axis was oriented to align with the signs of these two indices. Finally, the PC1 scores were rescaled to a range from 0 to 1 using min–max scaling, and the resulting values were defined as pseudotime.

Three validation procedures were used to assess whether the pseudotime axis reflected actual proficiency development. First, the mean pseudotime score averaged across the two essays for each learner was examined across CEFR proficiency levels. The result showed a monotonic increase, with the mean pseudotime of each proficiency rising sequentially from A2_0 (M = .138, SD = .05) to B1_1 (M = .139, SD = .04), B1_2 (M = .157, SD = .05), B2_0 (M = .163, SD = .05), and ENS (M = .172, SD = .05). Second, Welch’s ANOVA indicated significant differences across proficiency groups (p < .001, η2p = .07). Games–Howell post hoc comparisons further showed significant differences in 7 of the 10 pairwise contrasts. The adjacent contrasts A2_0 and B1_1, B1_2 and B2_0, and B2_0 and ENS were not significant, suggesting that the developmental signal was concentrated mainly in the transition from lower-intermediate to higher-intermediate proficiency. Third, Spearman’s rank correlation showed a significant positive monotonic relationship between learner-level pseudotime averaged across the two essays for each learner and the ordered CEFR proficiency levels (rs = .27, p < .001). In addition to this construct-related evidence, the structural stability of the pseudotime axis was examined by reapplying PCA to the four indices across 1,000 learner-level bootstrap resamples. The PC1 loadings retained the same sign in all bootstrap iterations (sign stability = 1.00), and none of their 95% confidence intervals included zero, indicating that the structure of the developmental axis was stable across resampled datasets. Given the modest effect size, the pseudotime axis was interpreted as reflecting proficiency development in a small but consistent manner.

Penalized B-spline GAMs were fitted with pseudotime as the continuous explanatory variable and each of the six syntactic complexity indices (C/T, DC/C, MLT, C/S, T/S, and CN/T) as the outcome variable. Each GAM used a cubic B-spline basis (basis dimension = 10), with the smoothing penalty parameter fixed at α = 1. The EDFs were approximately 1.03 across all indices, indicating that the fitted curves were essentially linear. Figure 1 presents the fitted curves with 95% sup-t simultaneous confidence bands obtained through learner-level bootstrapping, and Figure 2 presents their first derivatives with the corresponding 95% sup-t simultaneous confidence bands (the darker shading represents the 95% simultaneous confidence band for the first derivative, whereas the lighter background shading indicates intervals where the band excludes zero and thus denotes statistically significant change). A horizontal reference line was drawn at y = 0 (slope = 0) to determine whether the confidence band for the first derivative included zero.

jul-27-2-75-g1
Figure 1. GAM-Fitted Curves of Six Syntactic Complexity Indices along Pseudotime C/S, Clauses per Sentence; C/T, Clauses per T-unit; CN/T, Complex Nominals per T-unit; DC/C, Dependent Clauses per Clause; GAM, generalized additive model; MLT, Mean Length of T-unit; PC1, first principal component; T/S, T-units per Sentence.
Download Original Figure
jul-27-2-75-g2
Figure 2. First Derivatives of GAM-Fitted Curves with 95% Sup-t Simultaneous Confidence Bands C/S, Clauses per Sentence; C/T, Clauses per T-unit; CN/T, Complex Nominals per T-unit; DC/C, Dependent Clauses per Clause; GAM, generalized additive model; MLT, Mean Length of T-unit; PC1, first principal component; T/S, T-units per Sentence.
Download Original Figure

Except for T/S, five of the six indices showed significant increases with pseudotime. For these indices, the 95% simultaneous confidence bands for the first derivatives did not include zero across most of the evaluated pseudotime range, indicating statistically significant positive changes. The estimated total changes across the pseudotime axis were relatively large for MLT (Δ ≈ +15.8) and CN/T (Δ ≈ +2.1), while positive changes were also observed for C/T (Δ ≈ +0.59), C/S (Δ ≈ +0.60), and DC/C (Δ ≈ +0.06). Δ was calculated as the endpoint fitted value minus the starting-point fitted value. In contrast, T/S showed a slight decrease across pseudotime (Δ ≈ −0.03), but its first-derivative simultaneous confidence band included zero throughout the evaluated range, indicating no statistically significant change. Overall, the fitted curves were generally gradual, with no pronounced abrupt changes observed across the pseudotime axis.

5. Discussion

This study applied PCA to four syntactic complexity indices capturing clause-internal and phrasal elaboration to construct a pseudotime axis representing syntactic development and modeled how six other syntactic complexity indices varied along this axis. Interestingly, only T/S did not show a statistically significant change along pseudotime. Although its fitted curve exhibited a slight downward pattern, the 95% simultaneous confidence band for the first derivative included zero throughout the evaluated range, indicating that no statistically significant change in coordination was observed along pseudotime.

This finding is consistent with Norris and Ortega’s (2009) view that syntactic complexity develops through a progression from coordination, through subordination, to increasingly elaborate phrasal structures. In the present study, T/S did not change significantly along pseudotime, whereas indices of length, clausal subordination, syntactic complexity, and complex nominals increased significantly. This pattern suggests that, within the proficiency range of the present study, syntactic development was more closely related to clausal and phrasal elaboration than to coordination, which may have played a greater role at earlier stages. Given that the present dataset is concentrated largely at the intermediate proficiency levels, the observed pattern may reflect a developmental stage in which coordination has already become established, while clausal and phrasal elaboration continue to develop. Further, the findings of the present study support treating syntactic complexity as a multidimensional construct as they showed that different dimensions do not develop uniformly along the developmental axis.

The contribution of the present study is that it modeled a pseudo-developmental axis of syntactic complexity using PCA, an approach that has rarely been applied in L2 writing research. Because collecting longitudinal writing data over extended periods is often difficult and resource-intensive, particularly when the same learners must be tracked repeatedly over time, examining long-term patterns of syntactic development is challenging. Accordingly, this approach enables researchers to approximate long-term patterns of syntactic development without collecting longitudinal data over a prolonged period. It offers a practical way to investigate continuous patterns of syntactic development in large cross-sectional learner corpora when long-term longitudinal tracking is not feasible.

However, the present study has several limitations. First, although pseudotime represents syntactic development along a continuous scale, it should not be interpreted as actual longitudinal developmental time. The axis was inferred from cross-sectional learner data; therefore, the resulting ordering represents an estimated developmental continuum rather than an ordering directly observed in the same learners over time. To further validate the PCA-based pseudotime approach, longitudinal research is needed. Future studies should track the same learners over time to determine whether the patterns of syntactic change observed in the present study are also evident in within-learner development.

Secondly, because the pseudotime axis was constructed from four theoretically selected indices, using a different set of indices to construct the axis may result in different patterns of change in the present outcome variables along pseudotime, including differences in their direction, magnitude, and statistically significant intervals. This limitation suggests that the patterns of syntactic change observed in the present study may not represent fixed patterns of syntactic development but may instead be conditional on the choice of indices used to construct the axis. Therefore, future research should assess the robustness of the present findings to alternative index specifications through sensitivity analyses by reconstructing the axis using different sets of indices and examining whether the patterns of syntactic change observed in the present study remain consistent.

6. Conclusion

This study applied PCA to four theoretically selected syntactic complexity indices to construct a continuous developmental axis (pseudotime) and analyzed changes in six syntactic complexity indices along this axis using GAMs and bootstrap-based sup-t simultaneous confidence bands. The findings for the two research questions are summarized as follows. First, the constructed pseudotime axis tended to increase with higher proficiency levels and showed structural stability in the bootstrap analyses, thereby supporting its validity as a pseudo-longitudinal measure reflecting syntactic development. Second, along this developmental axis, indices related to length, clausal subordination, syntactic complexity, and complex nominals increased significantly, whereas coordination (T/S) showed no statistically significant change, suggesting that the various dimensions of syntactic complexity do not change uniformly along the developmental axis.

The results of the present study have implications in two respects. Theoretically, the fact that the subdimensions of syntactic complexity did not develop in a completely uniform manner provides empirical support for treating syntactic complexity as a multidimensional construct. Methodologically, the study offers a new analytical framework for learner language research in which longitudinal data are difficult to collect. By inferring a developmental ordering from large-scale cross-sectional data and examining the co-development of multiple indices along this axis, the approach provides an alternative means of investigating developmental patterns without directly observing change over time.

Nevertheless, pseudotime represents an inferred developmental continuum rather than actual longitudinal time, and its construction depends on the particular indices selected to define the axis. Thus, future research should validate the present methodology using actual longitudinal data and conduct sensitivity analyses with alternative sets of indices to determine whether learner ordering and patterns of change remain consistent across different pseudotime constructions.

Notes

The following abbreviations are used in this paper: CEFR (Common European Framework of Reference for Languages), CHN (China), CN/C (Complex Nominals per Clause), CN/T (Complex Nominals per T-unit), C/S (Clauses per Sentence), C/T (Clauses per T-unit), CP/C (Coordinate Phrases per Clause), CP/T (Coordinate Phrases per T-unit), CT/T (Complex T-units per T-unit), DC/C (Dependent Clauses per Clause), DC/T (Dependent Clauses per T-unit), EDF (Effective Degrees of Freedom), EFL (English as a Foreign Language), ENS (English native speakers), GAMs (generalized additive models), HKG (Hong Kong), ICLE (International Corpus of Learner English), ICNALE (International Corpus Network of Asian Learners of English), IDN (Indonesia), JPN (Japan), KMO (Kaiser-Meyer-Olkin), KOR (Korea), L1 (first language), L2 (second language), L2SCA (L2 Syntactic Complexity Analyzer), LME (Linear mixed-effects), LOCNESS (Louvain Corpus of Native English Essays), MANOVA (Multivariate Analysis of Variance), MLC (Mean Length of Clause), MLS (Mean Length of Sentence), MLT (Mean Length of T-unit), MSA (Measure of Sampling Adequacy), NNSs (non-native speakers), NSs (native speakers), PAK (Pakistan), PCA (principal component analysis), PC1 (first principal component), PHL (the Philippines), SIN (Singapore), TAASSC (Tool for the Automatic Analysis of Syntactic Sophistication and Complexity), THA (Thailand), T/S (T-units per Sentence), TWN (Taiwan), VP/T (Verb Phrases per T-unit), WECCL (Written English Corpus of Chinese Learners).

References

1.

Barrot, Jessie S., and Joan Y. Agdeppa. 2021. “Complexity, Accuracy, and Fluency as Indices of College-Level L2 Writers’ Proficiency.” Assessing Writing 47: 100510.

2.

Biber, Douglas, Bethany Gray, and Kornwipa Poonpon. 2011. “Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development?” TESOL Quarterly 45(1): 5–35.

3.

Bulté, Bram, and Alex Housen. 2014. “Conceptualizing and Measuring Short-Term Changes in L2 Writing Complexity.” Journal of Second Language Writing 26: 42–65.

4.

Grant, Leslie, and April Ginther. 2000. “Using Computer-Tagged Linguistic Features to Describe L2 Writing Differences.” Journal of Second Language Writing 9(2): 123–145.

5.

Hwang, Haerim. 2025. “The Impact of Subordination Type and Finiteness on Second Language Development in Timed Impromptu Writing: An NLP-Based Analysis Using the Subordination Sophistication Analyzer.” Written Communication 42(1): 193–222.

6.

Ishikawa, Shin’ichiro. 2013. “The ICNALE and Sophisticated Contrastive Interlanguage Analysis of Asian Learners of English.” Learner Corpus Studies in Asia and the World 1: 91–118.

7.

Jiang, Jingyang, Peng Bi, and Haitao Liu. 2019. “Syntactic Complexity Development in the Writings of EFL Learners: Insights from a Dependency Syntactically-Annotated Corpus.” Journal of Second Language Writing 46: 100666.

8.

Khushik, Ghulam Abbas, and Ari Huhta. 2020. “Investigating Syntactic Complexity in EFL Learners’ Writing across Common European Framework of Reference Levels A1, A2, and B1.” Applied Linguistics 41(4): 506–532.

9.

Kim, Minkyung. 2021. “Exploring Longitudinal Changes in Lexical and Syntactic Features in Beginning-Level EFL Learner Writing.” System 103: 102680.

10.

Kim, Minkyung, and Scott A. Crossley. 2018. “Modeling Second Language Writing Quality: A Structural Equation Investigation of Lexical, Syntactic, and Cohesive Features in Source-Based and Independent Writing.” Assessing Writing 37: 39–56.

11.

Kuiken, Folkert, and Ineke Vedder. 2019. “Syntactic Complexity across Proficiency and Languages: L2 and L1 Writing in Dutch, Italian, and Spanish.” International Journal of Applied Linguistics 29(2): 192–210.

12.

Kyle, Kristopher. 2016. “Measuring Syntactic Development in L2 Writing: Fine Grained Indices of Syntactic Complexity and Usage-Based Indices of Syntactic Sophistication.” PhD diss., Georgia State University.

13.

Kyle, Kristopher, and Scott A. Crossley. 2018. “Measuring Syntactic Complexity in L2 Writing Using Fine-Grained Clausal and Phrasal Indices.” The Modern Language Journal 102(2): 333–349.

14.

Li, Yuxi, and Ruiying Yang. 2023. “Assessing the Writing Quality of English Research Articles Based on Absolute and Relative Measures of Syntactic Complexity.” Assessing Writing 55: 100692.

15.

Lu, Xiaofei. 2010. “Automatic Analysis of Syntactic Complexity in Second Language Writing.” International Journal of Corpus Linguistics 15(4): 474–496.

16.

Lu, Xiaofei. 2011. “A Corpus-Based Evaluation of Syntactic Complexity Measures as Indices of College-Level ESL Writers’ Language Development.” TESOL Quarterly 45(1): 36–62.

17.

Lu, Xiaofei, and Haiyang Ai. 2015. “Syntactic Complexity in College-Level English Writing: Differences among Writers with Diverse L1 Backgrounds.” Journal of Second Language Writing 29: 16–27.

18.

Martínez, Ana Cristina Lahuerta. 2018. “Analysis of Syntactic Complexity in Secondary Education EFL Writers at Different Proficiency Levels.” Assessing Writing 35: 1–11.

19.

Norris, John M., and Lourdes Ortega. 2009. “Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity.” Applied Linguistics 30(4): 555–578.

20.

O’Leary, John A., and Rasmus Steinkrauss. 2022. “Syntactic and Lexical Complexity in L2 English Academic Writing: Development and Competition.” Ampersand 9: 100096.

21.

Sarte, Kayla Marie, and Ksenia Gnevsheva. 2022. “Noun Phrasal Complexity in ESL Written Essays under a Constructed-Response Task: Examining Proficiency and Topic Effects.” Assessing Writing 51: 100595.

22.

Verspoor, Marjolijn, Monika S. Schmid, and Xiaoyan Xu. 2012. “A Dynamic Usage Based Perspective on L2 Writing.” Journal of Second Language Writing 21(3): 239–263.

23.

Vyatkina, Nina. 2012. “The Development of Second Language Writing Complexity in Groups and Individuals: A Longitudinal Learner Corpus Study.” The Modern Language Journal 96(4): 576–598.

24.

Wu, Jifeng, and Xiaofei Lu. 2024. “Noun Phrase Complexity and Second Language Chinese Proficiency: An Analysis of Narratives by Korean Learners of Chinese.” Assessing Writing 59: 100810.

25.

Yoon, Hyung-Jo. 2017. “Linguistic Complexity in L2 Writing Revisited: Issues of Topic, Proficiency, and Construct Multidimensionality.” System 66: 130–141.