Emotional granularity (EG) is an individual's ability to describe their emotional experiences in a nuanced and specific way. In this paper, we propose that researchers adopt latent Markov factor analysis (LMFA) to invest...Emotional granularity (EG) is an individual's ability to describe their emotional experiences in a nuanced and specific way. In this paper, we propose that researchers adopt latent Markov factor analysis (LMFA) to investigate within-person variability in qualitative EG (i.e., variability in distinct granularity patterns between specific emotions across time). LMFA clusters measurement occasions into latent states according to state-specific measurement models. We argue that state-specific measurement models of repeatedly assessed emotion items can provide information about qualitative EG at a given point in time. Applying LMFA to the area of EG for negative and positive emotions separately by using data from an experience sampling study with 11,662 measurement occasions across 139 participants, we found three latent EG states for the negative emotions and three for the positive emotions. Momentary stress significantly predicted transitions between the EG states for both the negative and positive emotions. We further identified two and three latent classes of individuals who differed in state trajectories for negative and positive emotions, respectively. Neuroticism and dispositional mood regulation predicted latent class membership for negative (but not for positive) emotions. We conclude that LMFA may enrich EG research by enabling more fine-grained insights into variability in qualitative EG patterns.
Item omissions in large-scale assessments may occur for various reasons, ranging from disengagement to not being capable of solving the item and giving up. Current response-time-based classification approaches allow rese...Item omissions in large-scale assessments may occur for various reasons, ranging from disengagement to not being capable of solving the item and giving up. Current response-time-based classification approaches allow researchers to implement different treatments of item omissions presumably going back to different mechanisms. These approaches, however, are limited in that they require a clear-cut decision on the underlying missingness mechanism and do not allow to take the uncertainty in classification into account. We present a response-time-based model-based mixture modeling approach that overcomes this limitation. The approach (a) facilitates disentangling item omissions stemming from disengagement from those going back to solution behavior, (b) considers the uncertainty in omission classification, (c) allows for omission mechanisms to vary on the item-by-examinee level, (d) supports investigating person and item characteristics associated with different types of omission behavior, and (e) gives researchers flexibility in deciding on how to handle different types of omissions. The approach exhibits good parameter recovery under realistic research conditions. We illustrate the approach on data from the Programme for the International Assessment of Adult Competencies 2012 and compare it against previous classification approaches for item omissions.
Regression component analysis (RCA) replaces the factors in a factor analysis model with weighted composites of the model's observed variables. The weight matrix may be calculated from the factor model's parameter estima...Regression component analysis (RCA) replaces the factors in a factor analysis model with weighted composites of the model's observed variables. The weight matrix may be calculated from the factor model's parameter estimates. Thus, RCA parameter estimates can be obtained using factor model software, but RCA composites have determinate scores, rather than the indeterminate scores of factors. Analytically, RCA equates to modeling with "regression method" factor scores, except that, while those scores will be inconsistent with the original factor model, they are strictly consistent with the RCA model. When the original factor model is strictly correct in the population and the composites in RCA are standardized, RCA parameter estimates replicate those from regression-weighted forms of partial least squares (PLS) path modeling and generalized structured component analysis (GSCA)-affirming that those methods also equate to modeling with regression method factor scores under the same conditions. Parallel measurement allows RCA to replicate both correlation weight and regression weight versions of PLS and GSCA. These results suggest that RCA and regression-weighted forms of PLS and GSCA are all consistent approaches for modeling data that conforms to a factor model. All analytical methods are described using one consistent symbol palette. Complete R syntax is provided.
Experience sampling studies often aim to capture social interactions. A central methodological question in such studies is whether to use event- or signal-contingent sampling. The little existing research on this issue h...Experience sampling studies often aim to capture social interactions. A central methodological question in such studies is whether to use event- or signal-contingent sampling. The little existing research on this issue has not taken into account that social interactions occur with unique interaction partners (e.g., Anna or Tom). We analyze one week of social interaction data of 286 students from the University of Pittsburgh (60.8% male, mean age 19.2 years), taking into account the unique interaction partners of each student. Specifically, we investigate the differences between event- and signal contingent sampling in (1) the total number of unique interaction partners captured, as well as (2) the kinds of relationships, and (3) the quality of social interactions with these captured interaction partners. Apart from a larger quantity of interactions and unique interaction partners in the event-contingent sampling design, our analyses indicate subtle differences between the two designs when aiming to assess social interactions with more distant interaction partners, such as coworkers or strangers. Most importantly, in our analyses, specific interaction partners and social roles explained a considerable amount of variance in the quality of social interactions (up to 20.5%), suggesting that future research would benefit greatly from considering "with whom" individuals interact.
Multivariate Behav Res
· 2024 · PMID 38587864
·
Full text
Calculating confidence intervals and -values of edges in networks is useful to decide their presence or absence and it is a natural way to quantify uncertainty. Since lasso estimation is often used to obtain edges in a n...Calculating confidence intervals and -values of edges in networks is useful to decide their presence or absence and it is a natural way to quantify uncertainty. Since lasso estimation is often used to obtain edges in a network, and the underlying distribution of lasso estimates is discontinuous and has probability one at zero when the estimate is zero, obtaining -values and confidence intervals is problematic. It is also not always desirable to use the lasso to select the edges because there are assumptions required for correct identification of network edges that may not be warranted for the data at hand. Here, we review three methods that either use a modified lasso estimate (desparsified or debiased lasso) or a method that uses the lasso for selection and then determines -values without the lasso. We compare these three methods with popular methods to estimate Gaussian Graphical Models in simulations and conclude that the desparsified lasso and its bootstrapped version appear to be the best choices for selection and quantifying uncertainty with confidence intervals and -values.
Researchers are often interested in comparing predictors, a practice commonly done informal comparisons of standardized regression slopes. However, formal interval-based approaches offer advantages over informal compari...Researchers are often interested in comparing predictors, a practice commonly done informal comparisons of standardized regression slopes. However, formal interval-based approaches offer advantages over informal comparison. Specifically, this article examines a delta-method-based confidence interval for the difference between two standardized regression coefficients, building upon previous work on confidence intervals for single coefficients. Using Monte Carlo simulation studies, the proposed approach is evaluated at finite sample sizes with respect to coverage rate, interval width, Type I error rate, and statistical power under a variety of conditions, and is shown to outperform an alternative approach that uses the standard covariance matrix found in regression textbooks. Additional simulations evaluate current software implementations, small sample performance, and multiple comparison procedures for simultaneously testing multiple differences of interest. Guidance on sample size planning for narrow confidence intervals, an R function to conduct the proposed method, and two empirical demonstrations are provided. The goal is to offer researchers a different tool in their toolbox for when comparisons among standardized coefficients are desired, as a supplement to, rather than a replacement for, other potentially useful analyses.
Recent shifts to prioritize prediction, rather than explanation, in psychological science have increased applications of predictive modeling methods. However, composite predictors, such as sum scores, are still commonly...Recent shifts to prioritize prediction, rather than explanation, in psychological science have increased applications of predictive modeling methods. However, composite predictors, such as sum scores, are still commonly used in practice. The motivations behind composite test scores are largely intertwined with reducing the influence of measurement error in answering explanatory questions. But this may be detrimental for predictive aims. The present paper examines the impact of utilizing composite or item-level predictors in linear regression. A mathematical examination of the bias-variance decomposition of prediction error in the presence of measurement error is provided. It is shown that prediction bias, which may be exacerbated by composite scoring, drives prediction error for linear regression. This may be particularly salient when composite scores are comprised of heterogeneous items such as in clinical scales where items correspond to symptoms. With sufficiently large training samples, the increased prediction variance associated with item scores becomes negligible even when composite scores are sufficient. Practical implications of predictor scoring are examined in an empirical example predicting suicidal ideation from various depression scales. Results show that item scores can markedly improve prediction particularly for symptom-based scales. Cross-validation methods can be used to empirically justify predictor scoring decisions.
An important goal when analyzing multivariate time series is the identification of heterogeneity, both within and across individuals over time. This heterogeneity can represent different ways in which psychological proce...An important goal when analyzing multivariate time series is the identification of heterogeneity, both within and across individuals over time. This heterogeneity can represent different ways in which psychological processes manifest, either between people or within a person across time. In many instances, those differences can have systematic patterns that can be related to future outcomes. In close relationships, for example, the daily exchange of affect between two individuals in a couple can contain a particular structure that is different across people and can result in varying levels of relationship satisfaction. In this paper we use Louvain, a clustering method, as a tool to characterize heterogeneity in multivariate time series data. Using affect measures from dyadic interactions, we first determine that Louvain is adept at detecting homogeneous patterns that are distinct from one another. Additionally, these homogeneous points are linked, at some level, by time. Thus, we find that clustering Louvain is useful to find time periods of stable, reoccurring patterns. However, using measures founded on information theory reveals that there is some level of information loss that is inevitable when clustering on levels of variable expression. Finally, we evaluate the predictive validity of the clustering method by examining the relation between the identified clusters of affect and measures outside the time series (i.e., relationship satisfaction and breakup taken one and two years later).
Multivariate Behav Res
· 2024 · PMID 38389431
·
Full text
Collider bias is a statistical phenomenon that occurs when a researcher adjusts for a common outcome variable that is shared between a predictor and its criterion. This biased adjustment can happen in one of two ways: (1...Collider bias is a statistical phenomenon that occurs when a researcher adjusts for a common outcome variable that is shared between a predictor and its criterion. This biased adjustment can happen in one of two ways: (1) treating the collider variable as a confounder and adjusting for it during statistical analysis, or (2) incidental sample selection on the collider variable. Improperly addressing collider bias can result in invalid estimates of the population relationships psychologists wish to measure, often attenuating the sample estimates toward 0 and reducing power to detect a significant effect.
Accelerated longitudinal designs allow researchers to efficiently collect longitudinal data covering a time span much longer than the study duration. One important assumption of these designs is that each cohort (a group...Accelerated longitudinal designs allow researchers to efficiently collect longitudinal data covering a time span much longer than the study duration. One important assumption of these designs is that each cohort (a group defined by their age of entry into the study) shares the same longitudinal trajectory. Although previous research has examined the impact of violating this assumption when each cohort is defined by a single age of entry, it is possible that each cohort is instead defined by a range of ages, such as groups that experience a particular historical event. In this paper we examined how including cohort membership in linear and quadratic multilevel models performed in detecting and controlling for cohort effects in this scenario. Using a Monte Carlo simulation study, we assessed the performance of this approach under conditions related to the number of cohorts, the overlap between cohorts, the strength of the cohort effect, the number of affected parameters, and the sample size. Our results indicate that models including a proxy variable for cohort membership based on age at study entry performed comparably to using true cohort membership in detecting cohort effects accurately and returning unbiased parameter estimates. This indicates that researchers can control for cohort effects even when true cohort membership is unknown.
Propensity score (PS) analyses are increasingly popular in behavioral sciences. Two issues often add complexities to PS analyses, including missing data in observed covariates and clustered data structure. In previous re...Propensity score (PS) analyses are increasingly popular in behavioral sciences. Two issues often add complexities to PS analyses, including missing data in observed covariates and clustered data structure. In previous research, methods for conducting PS analyses with considering either issue alone were examined. In practice, the two issues often co-occur; but the performance of methods for PS analyses in the presence of both issues has not been evaluated previously. In this study, we consider PS weighting analysis when data are clustered and observed covariates have missing values. A simulation study is conducted to evaluate the performance of different missing data handling methods (complete-case, single-level imputation, or multilevel imputation) combined with different multilevel PS weighting methods (fixed- or random-effects PS models, inverse-propensity-weighting or the clustered weighting, weighted single-level or multilevel outcome models). The results suggest that the bias in average treatment effect estimation can be reduced, by better accounting for clustering in both the missing data handling stage (such as with the multilevel imputation) and the PS analysis stage (such as with the fixed-effects PS model, clustered weighting, and weighted multilevel outcome model). A real-data example is provided for illustration.
Multivariate Behav Res
· 2024 · PMID 38361218
·
Full text
The walktrap algorithm is one of the most popular community-detection methods in psychological research. Several simulation studies have shown that it is often effective at determining the correct number of communities a...The walktrap algorithm is one of the most popular community-detection methods in psychological research. Several simulation studies have shown that it is often effective at determining the correct number of communities and assigning items to their proper community. Nevertheless, it is important to recognize that the walktrap algorithm relies on hierarchical clustering because it was originally developed for networks much larger than those encountered in psychological research. In this paper, we present and demonstrate a computational alternative to the hierarchical algorithm that is conceptually easier to understand. More importantly, we show that better solutions to the sum-of-squares optimization problem that is heuristically tackled by hierarchical clustering in the walktrap algorithm can often be obtained using exact or approximate methods for -means clustering. Three simulation studies and analyses of empirical networks were completed to assess the impact of better sum-of-squares solutions.
Singh M, Verhulst B, Vinh P
… +10 more, Zhou YD, Castro-de-Araujo LFS, Hottenga JJ, Pool R, de Geus EJC, Vink JM, Boomsma DI, Maes HHM, Dolan CV, Neale MC
Multivariate Behav Res
· 2024 · PMID 38358370
·
Full text
Cross-lagged panel models (CLPMs) are commonly used to estimate causal influences between two variables with repeated assessments. The lagged effects in a CLPM depend on the time interval between assessments, eventually...Cross-lagged panel models (CLPMs) are commonly used to estimate causal influences between two variables with repeated assessments. The lagged effects in a CLPM depend on the time interval between assessments, eventually becoming undetectable at longer intervals. To address this limitation, we incorporate instrumental variables (IVs) into the CLPM with two study waves and two variables. Doing so enables estimation of both the lagged (i.e., "distal") effects and the bidirectional cross-sectional (i.e., "proximal") effects at each wave. The distal effects reflect Granger-causal influences across time, which decay with increasing time intervals. The proximal effects capture causal influences that accrue over time and can help infer causality when the distal effects become undetectable at longer intervals. Significant proximal effects, with a negligible distal effect, would imply that the time interval is too long to estimate a lagged effect at that time interval using the standard CLPM. Through simulations and an empirical application, we demonstrate the impact of time intervals on causal inference in the CLPM and present modeling strategies to detect causal influences regardless of the time interval in a study. Furthermore, to motivate empirical applications of the proposed model, we highlight the utility and limitations of using genetic variables as IVs in large-scale panel studies.
Adolescence is a time period characterized by extremes in affect and increasing prevalence of mental health problems. Prior studies have illustrated how affect states of adolescents are related to interactions with paren...Adolescence is a time period characterized by extremes in affect and increasing prevalence of mental health problems. Prior studies have illustrated how affect states of adolescents are related to interactions with parents. However, it remains unclear how affect states among family triads, that is adolescents and their parents, are related in daily life. This study investigated affect state dynamics (happy, sad, relaxed, and irritated) of 60 family triads, including 60 adolescents ( = 15.92, 63.3% females), fathers and mothers ( = 49.16). The families participated in the RE-PAIR study, where they reported their affect states in four ecological momentary assessments per day for 14 days. First, we used multilevel vector-autoregressive network models to estimate affect dynamics across all families, and for each family individually. Resulting models elucidated how family affect states were related at the same moment, and over time. We identified relations from parents to adolescents and vice versa, while considering family variation in these relations. Second, we evaluated the statistical performance of the network model a simulation study, varying the percentage missing data, the number of families, and the number of time points. We conclude with substantive and statistical recommendations for future research on family affect dynamics.
Recent technological advances have provided new opportunities for the collection of intensive longitudinal data. Using methods such as dynamic structural equation modeling, these data can provide new insights into moment...Recent technological advances have provided new opportunities for the collection of intensive longitudinal data. Using methods such as dynamic structural equation modeling, these data can provide new insights into moment-to-moment dynamics of psychological and behavioral processes. In intensive longitudinal data ( > 20), researchers often have theories that imply that factors that change from moment to moment within individuals act as moderators. For instance, a person's level of sleep deprivation may affect how much an external stressor affects mood. Here, we describe how researchers can implement, test, and interpret dynamically changing within-person moderation effects using two-level dynamic structural equation modeling as implemented in the structural equation modeling software Mplus. We illustrate the analysis of within-person moderation effects using an empirical example investigating whether changes in spending time online using social media affect the moment-to-moment effect of loneliness on depressive symptoms, and highlight avenues for future methodological development. We provide annotated Mplus code, enabling researchers to better isolate, estimate, and interpret the complexities of within-person interaction effects.
Park JJ, Chow SM, Epskamp S
… +1 more, Molenaar PCM
Multivariate Behav Res
· 2024 · PMID 38351547
·
Full text
Recent years have seen the emergence of an "idio-thetic" class of methods to bridge the gap between nomothetic and idiographic inference. These methods describe nomothetic trends in idiographic processes by pooling intra...Recent years have seen the emergence of an "idio-thetic" class of methods to bridge the gap between nomothetic and idiographic inference. These methods describe nomothetic trends in idiographic processes by pooling intraindividual information across individuals to inform group-level inference or vice versa. The current work introduces a novel "idio-thetic" model: the subgrouped chain graphical vector autoregression (scGVAR). The scGVAR is unique in its ability to identify subgroups of individuals who share common dynamic network structures in both lag(1) and contemporaneous effects. Results from Monte Carlo simulations indicate that the scGVAR shows promise over similar approaches when clusters of individuals differ in their contemporaneous dynamics and in showing increased sensitivity in detecting nuanced group differences while keeping Type-I error rates low. In contrast, a competing approach-the Alternating Least Squares VAR (ALS VAR) performs well when groups were separated by larger distances. Further considerations are provided regarding applications of the ALS VAR and scGVAR on real data and the strengths and limitations of both methods.
Student evaluation of teaching (SET) questionnaires are ubiquitously applied in higher education institutions in North America for both formative and summative purposes. Data collected from SET questionnaires are usually...Student evaluation of teaching (SET) questionnaires are ubiquitously applied in higher education institutions in North America for both formative and summative purposes. Data collected from SET questionnaires are usually item-level data with cross-classified structure, which are characterized by multivariate categorical outcomes (i.e., multiple Likert-type items in the questionnaires) and cross-classified structure (i.e., non-nested students and instructors). Recently, a new approach, namely the cross-classified IRT model, was proposed for appropriately handling SET data. To inform researchers in higher education, in this article, the cross-classified IRT model, along with three existing approaches applied in SET studies, including the cross-classified random effects model (CCREM), the multilevel item response theory (MLIRT) model, and a two-step integrated strategy, was reviewed. The strengths and weaknesses of each of the four approaches were also discussed. Additionally, the new and existing approaches were compared through an empirical data analysis and a preliminary simulation study. This article concluded by providing general suggestions to researchers for analyzing SET data and discussing limitations and future research directions.
In psychology and education, tests (e.g., reading tests) and self-reports (e.g., clinical questionnaires) generate counts, but corresponding Item Response Theory (IRT) methods are underdeveloped compared to binary data....In psychology and education, tests (e.g., reading tests) and self-reports (e.g., clinical questionnaires) generate counts, but corresponding Item Response Theory (IRT) methods are underdeveloped compared to binary data. Recent advances include the Two-Parameter Conway-Maxwell-Poisson model (2PCMPM), generalizing Rasch's Poisson Counts Model, with item-specific difficulty, discrimination, and dispersion parameters. Explaining differences in model parameters informs item construction and selection but has received little attention. We introduce two 2PCMPM-based explanatory count IRT models: The Distributional Regression Test Model for item covariates, and the Count Latent Regression Model for (categorical) person covariates. Estimation methods are provided and satisfactory statistical properties are observed in simulations. Two examples illustrate how the models help understand tests and underlying constructs.