- Validation of Measurement Instruments
- Open Access
- Published:
Revisiting the five-facet structure of mindfulness
Measurement Instruments for the Social Sciences volume 2, Article number: 7 (2020)
Abstract
The current study aimed to replicate the development of the Five-Facet Mindfulness Questionnaire (FFMQ) in a sample of 399 undergraduate students. We factor analyzed the Mindful Attention and Awareness Questionnaire (MAAS), the Freiburg Mindfulness Scale, the Southampton Mindfulness Questionnaire (SMQ), the Cognitive Affective Mindfulness Scale Revised (CAMS-R), and the Kentucky Inventory of Mindfulness Skills (KIMS), but also extended the analysis by including a conceptually related measure, the Philadelphia Mindfulness Scale (PHLMS), and a conceptually unrelated measure, the Langer Mindfulness Scale (LMS). Overall, we found a partial replication of the five-factor structure, with the exception of non-reacting and non-judging which formed a single factor. The PHLMS items loaded as expected with theoretically related factors, whereas the LMS items emerged as separate factor. Finally, we found a new factor that was mostly defined by negatively worded items indicating possible item wording artifacts within the FFMQ. Our conceptual validation study indicates that some facets of the FFMQ can be recovered, but item wording factors may threaten the stability of these facets. Additionally, measures such as the LMS appear to measure not only theoretically, but also empirically different constructs.
Introduction
How robust are our current conceptualizations of mindfulness? Should dispositional mindfulness be thought of as a one-dimensional construct or are there multiple facets and, if yes, how many? This question is important because different traditions of Eastern and Western mindfulness exist. Yet, it is unclear how sensitive current measures are to those distinctions or whether those approaches can be integrated. Dispositional mindfulness is defined as “paying attention in a particular way: on purpose, in the present moment, non-judgmentally” (Kabat-Zinn, 1994, p.4) and it has been measured with a number of instruments (Bergomi, Tschacher, & Kupper, 2013b, 2013a; Sauer et al., 2013). Trying to find a common structure, Baer, Smith, Hopkins, Krietemeyer, and Toney (2006) factor analyzed 112 items from the Mindful Attention and Awareness Scale(MAAS), the Kentucky Inventory of Mindfulness Skills (KIMS), the Freiburg Mindfulness Inventory (FMI), the Cognitive Affective Mindfulness Scale (CAMS), and the Southampton Mindfulness Questionnaire (SMQ) (Baer et al., 2006) and reported a five-factor solution of mindfulness when using principal axis factoring with an oblique rotation. Based on this emergent empirical structure, they developed the Five Facet Mindfulness Questionnaire (FFMQ) using the 39 highest loading items from the original pool of items. The identification of these five common dimensions across a number of widely used instruments has led to the implicit recognition and acceptance of a multidimensional model of mindfulness (i.e., the Five-Facet Model of Mindfulness, FFMM), with the FFMQ considered to be the prime measure of an underlying multidimensional model of mindfulness (which we call FFMM). Given the widespread use of the instrument and the theoretical implications of the conceptualization of mindfulness, it is important to verify and replicate the emergence of the FFMM even when using different mindfulness measures and with different samples to assess the appropriateness of the FFMQ to measure mindfulness and the validity of the FFMM as a conceptual model of mindfulness.
Since this seminal analysis by Baer et al. (2006), other scales measuring dispositional mindfulness, such as the Philadelphia Mindfulness Scale (Cardaciotto, Herbert, Forman, Moitra, & Farrow, 2008) and the Langer Mindfulness Scale (Pirson, Langer, Zilcha, & Zilcha, 2018), have been developed. These scales were not included in the original analysis conducted by Baer et al. (2006), but a rigorous replication of the steps taken by Baer et al. (2006) including these scales may indicate the robustness of both the theoretical model of the FFMM and the empirical validity of the FFMQ. The aim of the current study is to examine the comprehensiveness and robustness of the five-factor structure by examining whether the similar five facets emerge if the factor analysis is extended to those new measures.
History of mindfulness assessment
To provide some historical context, the source scales of the FFMQ were supposed to capture a number of related but distinct dimensions, initially derived from an adaptation of Eastern philosophical thinking to Western audiences (Baer et al., 2006; Kucinskas, 2018). The MAAS (Brown & Ryan, 2003) assesses the lack of attention to one’s emotions, thoughts, sensations, and behaviors in general and is proposed to measure present-awareness (Brown & Ryan, 2003; Carlson & Brown, 2005). The KIMS (Baer, Smith, & Allen, 2004) conceptualizes mindfulness as a four-dimensional construct with acting with awareness, accept without judgment, describing, and observing facets. The revised FMI (Walach, Buchheld, Buttenmüller, Kleinknecht, & Schmidt, 2006) assesses a general factor of non-judgmental present-moment awareness, therefore adding the lack of self-evaluation as an important component of the construct. The CAMS-R (Feldman, Hayes, Kumar, Greeson, & Laurenceau, 2007) assesses four facets of mindfulness: self-regulation of attention, orientation to present-moment experience, awareness of experience, and accepting or non-judging attitude toward experience. The SMQ (Chadwick et al., 2008) assesses mindfulness in response to distressing images, focusing on decentered awareness, staying open to difficult experience, non-judgmental acceptance, and seeing difficult cognitions as transient mental events without reacting to them to measure a single score of mindfulness.
Despite their differences, a factor analysis of these instruments using principal axis factoring with an oblique rotation based on all 112 items suggested that five main facets were sufficient to represent the data (Baer et al., 2006). Of the original set of 112 items, 64 items loaded substantially on one of the five facets. The observing facet measures the awareness of internal experiences (emotions, cognitions) and external experiences (sounds, sights, and smells). The describing facet measures the tendency and ability to describe these internal and external experiences with words. The acting with awareness facet measures the tendency to bring full awareness and undivided focus to actions and experiences. The non-judging facet measures the tendency to refrain from evaluating inner experiences. The non-reactivity facet measures the tendency to accept emotions and states as transient and refrain from reacting to them. All these facets seem to capture elements that were central to the Eastern philosophical foundations of mindfulness, except that the spiritual and religious components have been excluded (Kabat-Zinn, 1994; Kucinskas, 2014).
Mindfulness assessment since the development of the FFMQ
Since the development of the FFMQ, a number of additional measures have been proposed. One such novel measure is the Philadelphia Mindfulness Scale (PHLMS, Cardaciotto et al., 2008) which measures present-moment awareness and acceptance as two related but empirically distinct concepts. These two dimensions maintain a Buddhist philosophical approach to mindfulness, and previous research has shown this measure to be conceptually related to the FFMQ (Siegling & Petrides, 2016).Therefore, we expect that the Philadelphia Mindfulness Scale (PHLMS) items will emerge jointly with other related items and can be integrated in the five-facet theoretical model .
However, non-Buddhist measures of mindfulness have also been proposed more recently, most notably the Langer Mindfulness Scale (LMS, Pirson et al., 2018). Pirson et al. (2012) defined mindfulness as “a mindset of openness to novelty in which the individual actively constructs novel categories and distinctions” (Pirson et al., 2012, p.3). This Western approach to mindfulness is more focused on the socio-cognitive elements of mindfulness, highlighting that mindfulness is typically goal-oriented and involves problem-solving and other cognitive exercises. Instead of the more meditative-contemplative aspect of Eastern mindfulness conceptualizations, it explicitly draws on the external, material, and social context of the individual. Their new measure is supposed to capture three-facets: novelty-production, novelty-seeking, and engagement. From our perspective, it is interesting to note that the philosophical orientation and the relevant motivational core of mindfulness are different, but the constituent cognitive and attentional elements might be similar. Not surprisingly, while theoretically and philosophically distinct, the LMS and the overall score of the FFMQ have been found to correlate moderately at r = .33 to .37 (Pirson et al., 2018; Siegling & Petrides, 2014). This raises the question whether these Western-based mindfulness components can be integrated in the existing structure of the FFMQ. Given the theoretical philosophical background of this Western mindfulness tradition, we expect the items of LMS would emerge on distinct factor(s) in a joint factor analysis of mindfulness constructs. One of the interesting questions is how distinct these Western-derived mindfulness dimensions are when analyzed together with instruments that have been inspired by Eastern philosophy.
Current research
In summary, the FFMQ has emerged as the prime measure to capture the FFMM (Baer et al., 2006). The FFMQ has been derived in a bottom-up approach by factor analyzing pre-existing measures (Baer et al., 2006). This empirically driven approach requires confirmation and replication to assess the theoretical appropriateness of the FFMQ as the principal measure of a multidimensional mindfulness construct (Magnusson, 1992; Tellis, 2017). While previous studies have employed a confirmatory strategy using only the final FFMQ (Gu et al., 2016; Williams, Dalgleish, Karl, & Kuyken, 2014), no study to date has undertaken a conceptual replication of the generation of the underlying FFMM. One reason this is important is to examine the potential presence of item wording effects in the current measurement of mindfulness (for studies reporting such method factors in the FFMQ see: Aguado et al., 2015; Van Dam, Hobkirk, Danoff-Burg, & Earleywine, 2012). Further, these studies have shown that a bi-factor model of the FFMQ, in which all items load onto a general factor of mindfulness and their individual facets while including wording factors, substantially improved the structure. This indicates that beyond their assignment to individual facets mindfulness items might share some common variance that could be explained by a general factor (for a discussion of this interpretation of a bi-factor model see: Bonifay, Lane, & Reise, 2017). In the FFMQ, this factor could represent Buddhist-inspired mindfulness raising the question if a similar bi-factor model emerges when Western-oriented measures of mindfulness are included. Investigating the emergent structure of the mindfulness measures is also of interest because both novel Buddhist inspired as well as Western-oriented measures of mindfulness have been developed since the publication of the FFMQ, raising important questions both about the comprehensiveness of the FFMM and the appropriateness of the FFMQ to measure such a multidimensional model of mindfulness. The current study aims to extend the current research on the dimensionality of mindfulness by re-examining the emergence of multi-dimensional mindfulness structures including recent measures of mindfulness.
Methods
Participants
We sampled 404 undergraduate students at Victoria University of Wellington. Five participants (1.24% of the total) started the questionnaire but did not finish it. Due to the low number of participants that did not answer the survey completely, we removed those five individuals from the dataset, leaving an effective sample size of 399. The average age of the participants was 19.21(SD = 3.93), and 68.92% of the total sample were female.
Previous mindfulness practice
Of the total sample, 8.77% reported previous mindfulness experience, 9.52% reported yoga experience, and 10.03% reported meditation experience. This sample composition in terms of age and mindfulness experience is comparable to the original FFMQ study (Baer et al., 2006). Due to the low number of participants with previous meditation experience, we did not perform separate analysis comparing meditation practitioners and participants with no meditation experience.
Procedure
Participants filled out an online survey on Qualtrics (the Qualtrics survey file and a word version of the survey are available on the OSF: https://osf.io/k2m35/). The mindfulness scales were presented as part of a larger survey pack. The survey pack also contained measures of personality (Soto & John, 2017), reinforcement sensitivity (Corr & Cooper, 2016), values (Schwartz et al., 2012), impression management (Blasberg, Rogers, & Paulhus, 2014), self-deception (Paulhus & Reid, 1991), satisfaction with life (Diener, Emmons, Larsen, & Griffin, 1985), flourishing (Diener et al., 2010), and a number of behavioral tasks (pen choices) to assess group conformity. The complete data are available on the OSF. Individuals participated as part of an Introduction to Psychology course and received course credit.
Open science statement
The current study reports an exploratory analysis into the structure of mindfulness. Recent studies (e.g., Silberzahn et al., 2018) demonstrate the impact of analytic freedom on reported outcomes. We aim to provide maximum transparency of the analysis by providing the full raw data set, the analytic code, and all materials associated with the study on the Open Science Framework (https://osf.io/k2m35/). The current study was part of a larger pack of surveys administered to the participants.
Instruments
The Mindful Attention and Awareness Scale
The MAAS (Brown & Ryan, 2003) uses 15 items that a participant rates on a scale from 1 (almost always) to 6 (almost never). Example items are “I do jobs or tasks automatically, without being aware of what I’m doing.” and “I find myself listening to someone with one ear, doing something else at the same time.” Lower scores on these items indicate greater mindfulness.
The Southampton Mindfulness Questionnaire
We used the 16-item SMQ (Chadwick et al., 2008), with a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree). The questionnaire was preceded by the statement: “Usually when I experience distressing thoughts and images...” Example items are “I am able just to notice them without reacting.” and “They take over my mind for quite a while afterwards.”
The Cognitive and Affective Mindfulness Scale-Revised
The Cognitive and Affective Mindfulness Scale-Revised (CAMS-R) is a 12-item measure with four subcomponents (Feldman et al., 2007). Participants answered the items on a 4-point Likert scale ranging from 1 (rarely/not at all) to 4 (almost always). Example items for the individual subcomponents are “It is easy for me to concentrate on what I am doing.” (attention), “I am able to focus on the present moment.” (present focus), “It’s easy for me to keep track of my thoughts and feelings.” (awareness), “I can tolerate emotional pain.” (acceptance).
The Freiburg Mindfulness Inventory
We used the 14-item FMI (Walach et al., 2006) with the original 4-point Likert scale ranging from 1 (rarely) to 4 (almost always). Example items are “I am open to the experience of the present moment.” and “I sense my body, whether eating, cooking, cleaning or talking.” In their original study Baer et al. (2006) used an earlier developmental version of the FMI which had 30 items.
Kentucky Inventory of Mindfulness Skills
We used the 39-item KMI to assess a multi-dimensional conceptualization of mindfulness (Baer et al., 2004). The items are rated on a 5-point Likert scale ranging from 1 (never or very rarely true) to 5 (very often or always true). Example items are “I’m good at finding the words to describe my feelings.” (describing); “I notice changes in my body, such as whether my breathing slows down or speeds up.” (observing); “When I do things, my mind wanders off and I’m easily distracted.” (acting with awareness); “I criticize myself for having irrational or inappropriate emotions.” (non-judging).
The Langer Mindfulness Scale
We used the 14-item LMS (Pirson et al., 2018) to assess a multi-dimensional conceptualization of socio-cognitive mindfulness. The items are rated on a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree). Example items are “I am rarely alert to new developments.” (engagement); “I make many novel contributions.” (novelty producing); “I like to investigate things.” (novelty seeking).
We report the reliabilities and scale descriptives of all measures in Table 1. We decided to evaluate reliability using ω, the greatest lower bound (GLB), and coefficient H (H). These indicators have been shown in previous research to provide better estimations of reliability compared to α (McNeish, 2018; Trizano-Hermosilla & Alvarado, 2016). We nevertheless report α for comparison purposes. Both α and ω are reported with bootstrapped 95% confidence intervals. All reliability coefficients were obtained using the userfriendlyscience package (version 0.7.2) in R (Peters, 2018). The reliabilities were acceptable (values above .7), except for LMS engagement, CAMS awareness, CAMS acceptance, and CAMS present focus.
Analytical approach
We first examined the theoretically proposed fit for each mindfulness scale using separate CFAs. This analysis provides important information on the internal validity of each of these measures and therefore, offers important background information for understanding the replication study. For each scale, we fitted the structures which were proposed by the original authors of the measures. Specifically, we fitted a uni-dimensional model for the FMI, the SMQ, and the MAAS, respectively. For the PHLMS, we fitted a model with two correlated first-order factors (acceptance, awareness). For the LMS, we fitted a model with three correlated first-order factors (novelty producing, novelty seeking, engagement). For the KIMS, we fitted a model with four first-order factors (observing, describing, non-judging, and acting with awareness) and a second-order factor representing mindfulness. For the CAMS-R, we fitted a model with four first-order factors (attention, present focus, awareness, and acceptance) and a second-order factor representing overall mindfulness. Therefore, we have a number of single factor models (FMI, SMQ, MAAS); a two-factor model (PHLMS); a three-factor model (LMS); and two four-factor models with a second-order mindfulness factor (CAMS-R, KIMS).
Due to multivariate non-normality of our data, all models were fitted using an WLSMV estimator rather than parceling items (Li, 2016; Maydeu-Olivares, 2017). We use the following fit indices: A χ2/degrees of freedom ratio of < 5 is considered acceptable (Wheaton, Muthen, Alwin, & Summers, 1977), CFI and γ (with .90 defined as threshold for acceptable fit and .95 defined as threshold for good fit, Marsh, Hau, & Wen, 2004), RMSEA (with less than 0.01, 0.05, and 0.08 to indicate excellent, good, and mediocre fit respectively, MacCallum, Browne, & Sugawara, 1996), and SRMR (acceptable fit is indicated by values less than .08, Hu & Bentler, 1999). We further report χ2 and degrees of freedom for each model, but do not focus on these indicators due to the known dependency on sample size.
Second, we ran an exploratory factor analysis using all mindfulness items to investigate the structure across all items and all instruments. We started off with a parallel analysis using the complete pool of items from the all mindfulness scales to determine the optimal number of components while accounting for components occurring due to random chance. We used Glorfeld’s (1995) conservative approach instead of Horn’s (1965) parallel analysis. We retained components which had eigenvalues greater than one after adjusting the initial eigenvalues for the eigenvalues observed in a random data set.
To examine the unfolding of the factor structure (see Goldberg, 2006), we implemented an iterative process in which we ran a PCA with 1 up to the number of factors proposed by the parallel analysis. After extracting each set of components using a principal component analysis with a varimax rotation using the psych package (version 1.8.12) in R (Revelle, 2018), we correlated participants’ scores on these components with the previously extracted component (Goldberg, 2006). This approach provides insight into the pattern of emergence of components (for examples see: De Raad et al., 2014; De Raad & Van Oudenhoven, 2008, 2011) .
Results
Confirmatory factor analysis
The CFA of the individual scales showed acceptable fit for the FMI, the MAAS, and the CAMS-R. Interestingly, the CAMS-R showed good fit while its individual scales had poor reliability. The other measures showed less than acceptable overall fit (see Table 2). Compared to previous studies using these measures, we found that in our sample the FMI and CAMS-R showed better fit, whereas the PHLMS, KIMS, SMQ, and LMS showed worse fit compared to other studies (we include a table reporting fit statistics from previous studies which we used to compare our results against on the OSF).
Factorial structure
The parallel analysis suggested 6 components (adjusted eigenvalues 15.61, 8.27, 2.39, 1.55, 1.37, 1.27). We therefore extracted 1 to 6 components based on the parallel analysis explaining 34% of the total variance. For the 6-component structure, we report the highest negative and positive loading items for each component in Table 3 to allow for easier interpretation. Additionally, the full loading matrix for the 6-component solution can be found in Table 4. We only interpreted loadings > .40 when examining the loading matrices of the items. No items were deleted. Due to space constraints, we made the full rotated component matrices for all solutions available on the OSF:(https://osf.io/k2m35/). The final six components were labelled as follows: “Non-Judgement/Non-Reacting”, “Observing”, “Acting with Awareness”, “Reacting/Judgement”, “Describing”, “Openness/Western Mindfulness”.
When examining the single component extracted first, it was primarily defined by non-judgmental awareness items. This single factor seems to support the interpretation of mindfulness in line with Kabat-Zinn’s definition of mindfulness as: “paying attention in a particular way: on purpose, in the present moment, non-judgmentally” (1994, p.4), indicating that the core element of mindfulness is a quality of awareness rather than describing emotions or non-reactance. As can be seen in Fig. 1, observing then split off from this general component. In the third step, a component defined by describing and focus items emerged. This component was positively related to observing and negatively to judgment. In the fourth step, the describing/focus component splits into self-criticism and describing/openness. In the fifth step, self-criticism splits into acting with awareness and self-criticism. In the sixth step, describing/openness splits into describing and openness.
Overall, the first distinct components within the larger structure to emerge were observing and non-judgment in the three-component solution. These components remained uncorrelated to all other components (with the exception of observing being correlated with describing), highlighting the distinctiveness of these mindfulness components from the remainder of the mindfulness construct. A further empirically distinct component was acting with awareness which emerged in the five-component solution, followed by describing and by openness (LMS) in the 6-component solution.
Focusing on the origins of the individual components of the final six-component solution, non-judgment/non-reacting was defined by items of the SMQ and the FMI. Some unique items of the PHLMS, such as “I wish I could control my emotions more easily,” showed substantial negative loadings on this component. The items from the LMS did not load substantially on this component. Observing was mostly defined by PHLMS items, such as “When I walk outside, I am aware of smells or how the air feels against my face”. Some KIMS items measuring observing, such as “I pay attention to sensations, such as the wind in my hair or sun on my face” also loaded on this component. Overall, we did not find substantial negative loadings on this component. Acting with awareness was positively defined by reverse keyed MAAS items, such as “I find myself doing things without paying attention,” and negatively defined by KIMS items, such as “When I do things, my mind wanders off and I’m easily distracted”. We found no substantial loadings of either LMS or PHLMS items. Reacting/judgment was largely defined by PHLMS items, such as “If there is something I don’t want to think about, I’ll try many things to get it out of my mind”. A number of KIMS items, such as “I tell myself that I shouldn’t be feeling the way I’m feeling.”, also loaded positively on the component. We did not find substantial negative loadings on this component. Describing was positively defined by KIMS items, such as “I’m good at finding the words to describe my feelings,” and negatively by KIMS items, such as “It’s hard for me to find the words to describe what I’m thinking”. We did not find substantial loadings of the LMS and only one item “When someone asks how I am feeling, I can identify my emotions easily” of the PHLMS loaded substantially. Last, openness/Western mindfulness was largely defined by LMS items, such as “I like to be challenged intellectually”. The only two non-LMS item loading substantially positively on the component were from the KIMS “I notice visual elements in art or nature, such as colors, shapes, textures, or patterns of light and shadow” and “I tend to evaluate whether my perceptions are right or wrong.” Substantial negative loading items were exclusively LMS items, such as “I am not an original thinker”.
As suggested by an anonymous reviewer, to examine the possibility of a general response factor, we ran confirmatory factor analysis with lavaan using a WLSMV estimator (for further model specifications and analytical code, see the supplementary material on the OSF). We fitted a model in which each item loaded on the factor on which it showed the highest loading in the exploratory factor analysis reported above. Additionally, all items were loaded on a separate general response factor, which was uncorrelated with the substantive factors. Item loadings were freely estimated by standardizing the latent variable. The relative fit of the six-factor structure is significantly improved when including a general response factor ΔCFI from the model without response factor, .087. Unfortunately, we were unable to fully explore positively vs negatively wording factors because the emerging factors in our analysis were not well-balanced in their phrasing. In order to disentangle possible content and method-artifacts, future studies need to include balanced item sets using both positively and negatively phrased items across all domains. Our exploratory findings suggest that item wording effects need greater attention in the measurement of mindfulness.
Discussion
The goal of the current research was to examine whether the commonly accepted multidimensional structure of mindfulness as exemplified in the FFMQ can be conceptually replicated using measures originally included in the development of the FFMQ while also including additional theoretically similar (PHLMS) and dissimilar (LMS) measures.
While we recovered three facets that expressed the same content as observing, describing, and acting with awareness in the FFMQ, we did not find separate non-judging and non-reacting components. This indicates that the distinction between those two components of mindfulness requiring distinct cognitive and behavioral reactions, while theoretically important, might not be sufficiently clear and distinct for participants in our sample. Both components require adaptation of cognitive and behavioral responses after noticing internal or external sensations, emotions, and thoughts. These distinctions appear to be too subtle, as these two factors merged to a generic non-reactivity factor in our sample. Similar factors combining non-judgment and non-reaction have been reported in other instruments (for example the CAMS-R, PHLMS). At the same time, when including an additional measure of mindfulness with a distinct philosophical background, we identified an additional factor. Overall, this indicates that while some individual components can be recovered and are broadly in line with previous conceptualizations of mindfulness, we did not recover the complete structure of the FFMQ with all its nuances and it may miss additional components of interest to mindfulness researchers.
We also found that openness/Western conceptualization of mindfulness emerged as a clearly defined separate component. This supports the theoretical separation of these measures because openness as a core component of a Western mindfulness definition can be empirically separated from items supposed to measure Eastern-philosophical perspectives on mindfulness (Pirson et al., 2018). Interestingly, the LMS is supposed to show a three-dimensional structure, but in our sample the overall fit for the three factors was poor, and in the item level analysis, a single distinct factor emerged. At the same time, our examination of the unfolding component structure provides important insight into the components that the Eastern and Western conceptualizations of mindfulness share, which helps to explain positive relationships between the LMS and the FFMQ reported in previous research (Siegling & Petrides, 2016, 2014). The positive relationship of the LMS noted in previous research might be due to the describing facet of the FFMQ (the describing facet showed the strongest positive correlations with the LMS during validation studies, see Pirson et al., 2018). In the current study the LMS/openness components were most clearly associated with describing during the unfolding of the facture structure, and the LMS/openness only splits from this factor and emerged as a separate factor when six components were extracted. This suggests that the ability to describe one’s feelings and experiences is an important correlate of being open for new experience as well as enjoying those experiences. Therefore, our analysis suggests that even though Western conceptualizations of mindfulness draw upon different philosophical traditions, the relevant social and cognitive components might still be shared with Eastern-based conceptualizations of mindfulness.
We found a component that expressed judging/reacting and was mostly defined by negatively worded items. This further highlights possible method artifacts in the measurement of mindfulness (Aguado et al., 2015). Studies using a person-centered approach to the FFMQ found a profile that was defined by judging, rather than non-judging (e.g., Bravo, Boothe, & Pearson, 2016; Pearson, Lawless, Brown, & Bravo, 2015). These patterns raise the possibility that a number of reversely worded items, possibly from the non-judging or non-reacting facets, do not measure the polar opposites of the positively worded items, but rather tap into a separate construct masked as a response style component. This is a finding consistent with previous studies that found that the fit of the FFMQ can be improved through a bi-factor model, indicating the potential presence of a g-factor of mindfulness explaining variance beyond the individual facets (Aguado et al., 2015; Van Dam, Hobkirk, Danoff-Burg, & Earleywine, 2012). The interpretation of bi-factor models has been controversial (Bonifay et al., 2017) and further research is needed to understand the meaning of such a factor in the context of mindfulness
Strengths
Our current study brings together theoretically similar and distinct measures of mindfulness, highlighting the general robustness of the FFMM and appropriateness of the FFMQ to measure mindfulness. It also shows that it is possible to discriminate Western-based conceptualizations of mindfulness from Eastern mindfulness measures. At the same time, it appears that Western-based measures of mindfulness may tap into similar social and cognitive processes that are also fundamental to the traits and abilities captured by Eastern-based mindfulness measures. We used a shortened version of the FMI; therefore, our current study did not employ the exact measures of the study conducted by Baer et al. (2006). Nevertheless, we only recovered three facets (observing, describing, acting with awareness), and one facet that expressed a combination of non-reacting/non-judging. Together with our finding that some items form a negative wording factor, this indicates that the current dimensional conceptualization of mindfulness might need revision.
Limitations
A limitation of our current study, while still closely resembling the sample used by Baer et al. (2006) during the development of the FFMQ, is the use of a sample of young adults in a Western educational context with a low percentage of active meditators. Previous research found that the observing facet is more strongly related to the general factor of mindfulness in samples with meditation experience (Lilja, Lundh, Josefsson, & Falkenström, 2013). However, our New Zealand-based sample is conceptually interesting because New Zealand has an official bi-cultural status, in which the national culture is actively co-constructed from both Western influences and traditional Maori culture (for a concise review of New Zealand history see: Mein Smith, 2011). This bi-cultural model undergirds the social and educational context which has led to more nuanced perceptions of the mind-body duality in a general population compared to North American or Western European settings. This interweaving of cultural practices is increasingly recognized, and more explicit connections between specific Maori cultural practices and Eastern-based mindfulness practices are explored (Higgins & Eden, 2018). Therefore, the insights from this sample are informative even in the absence of a larger number of meditators or mindfulness practitioners.
Conclusions
Overall, we found that three of the five FFMM components (observing, describing, acting with awareness) emerged in a conceptual replication and two of the factors merged, which has been found in the structures of other mindfulness instruments. This indicates potentially simpler cognitive and behavioral mindfulness components in lay audiences than indicated by the FFMM. Furthermore, conceptually distinct LMS items emerged as a separate component, highlighting that (a) at least three of the five dimensions of the FFMQ seem to reliably emerge even if new measures of mindfulness are included and (b) that there might be additional components of mindfulness from a Western perspective that are not captured in the FFMM. A third important insight from the unfolding analysis is that the different facets capture distinct aspects of mindfulness with low intercorrelations across some of the facets across the different levels of unfolding, which implies that it is more relevant to use mindfulness scores at a facet level rather than as a general score. Finally, negative wording effects were also apparent, and a number of the negative items might not tap into the proposed concepts but rather capture response tendencies.
Availability of data and materials
All materials, data, and analytic code is available on the OSF (https://osf.io/k2m35/)
References
Aguado, J., Luciano, J. V, Cebolla, A., Serrano-Blanco, A., Soler, J., & García-Campayo, J. (2015). Bifactor analysis and construct validity of the five facet mindfulness questionnaire (FFMQ) in non-clinical Spanish samples. Frontiers in Psychology, 6, 404. https://doi.org/10.3389/fpsyg.2015.00404
Baer, R. A., Smith, G. T., & Allen, K. B. (2004). Assessment of mindfulness by self-report: The Kentucky inventory of mindfulness skills. Assessment, 11(3), 191–206. https://doi.org/10.1177/1073191104268029.
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13(1), 27–45. https://doi.org/10.1177/1073191105283504.
Bergomi, C., Tschacher, W., & Kupper, Z. (2013a). Measuring mindfulness: First steps towards the development of a comprehensive mindfulness scale. Mindfulness, 4(1), 18–32. https://doi.org/10.1007/s12671-012-0102-9.
Bergomi, C., Tschacher, W., & Kupper, Z. (2013b). The assessment of mindfulness with self-report measures: Existing scales and open issues. Mindfulness, 4(3), 191–202. https://doi.org/10.1007/s12671-012-0110-9.
Blasberg, S. A., Rogers, K. H., & Paulhus, D. L. (2014). The Bidimensional Impression Management Index (BIMI): Measuring agentic and communal forms of impression management. Journal of Personality Assessment, 96(5), 523–531. https://doi.org/10.1080/00223891.2013.862252.
Bonifay, W., Lane, S. P., & Reise, S. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184–186. https://doi.org/10.1177/2167702616657069.
Bravo, A. J., Boothe, L. G., & Pearson, M. R. (2016). Getting personal with mindfulness: a latent profile analysis of mindfulness and psychological outcomes. Mindfulness, 7(2), 420–432. https://doi.org/10.1007/s12671-015-0459-7.
Brown, K. W., & Ryan, R. M. (2003). The benefits of being present: Mindfulness and its role in psychological well-being. Journal of Personality and Social Psychology, 84(4), 822–848. https://doi.org/10.1037/0022-3514.84.4.822.
Cardaciotto, L., Herbert, J. D., Forman, E. M., Moitra, E., & Farrow, V. (2008). The assessment of present-moment awareness and acceptance. Assessment, 15(2), 204–223. https://doi.org/10.1177/1073191107311467.
Carlson, L. E., & Brown, K. W. (2005). Validation of the mindful attention awareness scale in a cancer population. Journal of Psychosomatic Research, 58(1), 29–33. https://doi.org/10.1016/j.jpsychores.2004.04.366.
Chadwick, P., Hember, M., Symes, J., Peters, E., Kuipers, E., & Dagnan, D. (2008). Responding mindfully to unpleasant thoughts and images: Reliability and validity of the Southampton mindfulness questionnaire (SMQ). British Journal of Clinical Psychology, 47(4), 451–455. https://doi.org/10.1348/014466508X314891.
Corr, P. J., & Cooper, A. J. (2016). The Reinforcement Sensitivity Theory of Personality Questionnaire (RST-PQ): Development and validation. Psychological Assessment, 28(11), 1427–1440. https://doi.org/10.1037/pas0000273.
De Raad, B., Barelds, D. P. H., Timmerman, M. E., De Roover, K., Mlačić, B., & Church, A. T. (2014). Towards a pan-cultural personality structure: Input from 11 psycholexical studies. European Journal of Personality, 28(5), 497–510. https://doi.org/10.1002/per.1953.
De Raad, B., & Van Oudenhoven, J. P. (2008). Factors of values in the Dutch language and their relationship to factors of personality. European Journal of Personality, 22(2), 81–108. https://doi.org/10.1002/per.667.
De Raad, B., & Van Oudenhoven, J. P. (2011). A psycholexical study of virtues in the Dutch language, and relations between virtues and personality. European Journal of Personality, 25(1), 43–52. https://doi.org/10.1002/per.777.
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75. https://doi.org/10.1207/s15327752jpa4901_13.
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D., Oishi, S., & Biswas-Diener, R. (2010). New well-being measures: Short scales to assess flourishing and positive and negative feelings. Social Indicators Research, 97(2), 143–156. https://doi.org/10.1007/s11205-009-9493-y.
Feldman, G., Hayes, A., Kumar, S., Greeson, J., & Laurenceau, J.-P. (2007). Mindfulness and emotion regulation: The development and initial validation of the Cognitive and Affective Mindfulness Scale-Revised (CAMS-R). Journal of Psychopathology and Behavioral Assessment, 29(3), 177–190. https://doi.org/10.1007/s10862-006-9035-8.
Glorfeld, L. W. (1995). An improvement on Horn’s parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55(3), 377–393. https://doi.org/10.1177/0013164495055003002.
Goldberg, L. R. (2006). Doing it all bass-ackwards: The development of hierarchical factor structures from the top down. Journal of Research in Personality, 40(4), 347–358. https://doi.org/10.1016/j.jrp.2006.01.001.
Gu, J., Strauss, C., Crane, C., Barnhofer, T., Karl, A., Cavanagh, K., & Kuyken, W. (2016). Examining the factor structure of the 39-item and 15-item versions of the Five Facet Mindfulness Questionnaire before and after mindfulness-based cognitive therapy for people with recurrent depression. Psychological Assessment, 28(7), 791–802. https://doi.org/10.1037/pas0000263.
Higgins, J., & Eden, R. (2018). Emerging understandings of mindfulness through experiential awareness. Learning, 4(1), 102–111. https://doi.org/10.1080/23735082.2018.1428144.
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Kabat-Zinn, J. (1994). Wherever you go, there you are: Mindfulness meditation in everyday life. New York: Hyperion.
Kucinskas, J. (2014). The unobtrusive tactics of religious movements. Sociology of Religion, 75(4), 537–550. https://doi.org/10.1093/socrel/sru055.
Kucinskas, J. (2018). The mindful elite : mobilizing from the inside out. New York: Oxford University Press.
Li, C.-H. H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. https://doi.org/10.3758/s13428-015-0619-7.
Lilja, J. L., Lundh, L.-G., Josefsson, T., & Falkenström, F. (2013). Observing as an essential facet of mindfulness: A comparison of FFMQ patterns in meditating and non-meditating individuals. Mindfulness, 4(3), 203–212. https://doi.org/10.1007/s12671-012-0111-8.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. https://doi.org/10.1037/1082-989X.1.2.130.
Magnusson, D. (1992). Back to the phenomena: Theory, methods, and statistics in psychological research. European Journal of Personality, 6(1), 1–14. https://doi.org/10.1002/per.2410060102.
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320–341. https://doi.org/10.1207/s15328007sem1103_2.
Maydeu-Olivares, A. (2017). Maximum likelihood estimation of structural equation models for continuous data: Standard errors and goodness of fit. Structural Equation Modeling: A Multidisciplinary Journal, 24(3), 383–394. https://doi.org/10.1080/10705511.2016.1269606.
McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144.
Mein Smith, P. (2011). A concise history of New Zealand. Cambridge University Press. https://doi.org/10.1017/CBO9781139196574.
Paulhus, D. L., & Reid, D. B. (1991). Enhancement and denial in socially desirable responding. Journal of Personality and Social Psychology, 60(2), 307–317. https://doi.org/10.1037/0022-3514.60.2.307.
Pearson, M. R., Lawless, A. K., Brown, D. B., & Bravo, A. J. (2015). Mindfulness and emotional outcomes: Identifying subgroups of college students using latent profile analysis. Personality and Individual Differences, 76, 33–38. https://doi.org/10.1016/j.paid.2014.11.009.
Peters, G.-J. Y. (2018). {userfriendlyscience}: Quantitative analysis made accessible. https://doi.org/10.17605/osf.io/txequ
Pirson, M. A., Langer, E., Zilcha, ·Sigal, & Zilcha, S. (2018). Enabling a socio-cognitive perspective of mindfulness: The development and validation of the Langer mindfulness scale. Journal of Adult Development, 25(3), 168–185. https://doi.org/10.1007/s10804-018-9282-4
Pirson, M. A., Langer, E. J., Bodner, T., & Zilcha, S. (2012). The development and validation of the Langer mindfulness scale - Enabling a socio-cognitive perspective of mindfulness in organizational contexts. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2158921.
Revelle, W. (2018). psych: Procedures for psychological, psychometric, and personality research. Evanston, Illinois. Retrieved from https://cran.r-project.org/package=psych
Sauer, S., Walach, H., Schmidt, S., Hinterberger, T., Lynch, S., Büssing, A., & Kohls, N. (2013). Assessment of mindfulness: Review on state of the art. Mindfulness, 4(1), 3–17. https://doi.org/10.1007/s12671-012-0122-5.
Schwartz, S. H., Cieciuch, J., Vecchione, M., Davidov, E., Fischer, R., Beierlein, C., et al. (2012). Refining the theory of basic individual values. Journal of Personality and Social Psychology, 103(4), 663–688. https://doi.org/10.1037/a0029393.
Siegling, A. B., & Petrides, K. V. (2014). Measures of trait mindfulness: Convergent validity, shared dimensionality, and linkages to the five-factor model. Frontiers in Psychology, 5, 1164. https://doi.org/10.3389/fpsyg.2014.01164.
Siegling, A. B., & Petrides, K. V. (2016). Zeroing in on mindfulness facets: Similarities, validity, and dimensionality across three independent measures. PLOS ONE, 11(4), e0153073. https://doi.org/10.1371/journal.pone.0153073.
Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., et al. (2018). Many analysts, one data set: Making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science, 1(3), 337–356. https://doi.org/10.1177/2515245917747646.
Soto, C. J., & John, O. P. (2017). The next Big Five Inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of Personality and Social Psychology, 113(1), 117–143. https://doi.org/10.1037/pspp0000096.
Tellis, G. J. (2017). Interesting and impactful research: on phenomena, theory, and writing. Journal of the Academy of Marketing Science, 45(1), 1–6. https://doi.org/10.1007/s11747-016-0499-0.
Trizano-Hermosilla, I., & Alvarado, J. M. (2016). Best alternatives to Cronbach’s alpha reliability in realistic conditions: congeneric and asymmetrical measurements. Frontiers in Psychology, 7, 769. https://doi.org/10.3389/fpsyg.2016.00769.
Van Dam, N. T., Hobkirk, A. L., Danoff-Burg, S., & Earleywine, M. (2012). Mind your words: Positive and negative items create method effects on the five facet mindfulness questionnaire. Assessment, 19(2), 198–204. https://doi.org/10.1177/1073191112438743.
Walach, H., Buchheld, N., Buttenmüller, V., Kleinknecht, N., & Schmidt, S. (2006). Measuring mindfulness—the Freiburg Mindfulness Inventory (FMI). Personality and Individual Differences, 40(8), 1543–1555. https://doi.org/10.1016/J.PAID.2005.11.025.
Wheaton, B., Muthen, B., Alwin, D. F., & Summers, G. F. (1977). Assessing reliability and stability in panel models. Sociological Methodology, 8, 84. https://doi.org/10.2307/270754.
Williams, M. J., Dalgleish, T., Karl, A., & Kuyken, W. (2014). Examining the factor structures of the Five Facet Mindfulness Questionnaire and the Self-Compassion Scale. Psychological Assessment, 26(2), 407–418. https://doi.org/10.1037/a0035566.
Acknowledgements
Not applicable
Funding
This research was not supported by any external funding source.
The current study did not receive any funding.
Author information
Authors and Affiliations
Contributions
JK conceptualized the study and analyzed the data; JK and RF jointly wrote the manuscript. The final version was approved by all authors.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The authors declare that they have no conflict of interest. Participants took part in the current research for course credit as part of an Introduction to Psychology course. Ethical approval was given by the School of Psychology Human Ethics Committee under delegated authority of Victoria University of Wellington’s Human Ethics Committee.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Additional file 1:.
Supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Karl, J.A., Fischer, R. Revisiting the five-facet structure of mindfulness. Meas Instrum Soc Sci 2, 7 (2020). https://doi.org/10.1186/s42409-020-00014-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s42409-020-00014-3