Psychological Flexibility for University Students: Scale Development Employing Exploratory and Confirmatory Factor Analyses
Nazish Idrees Chaudhary
University of Management and Technology, Lahore, Pakistan
Dr. Muhammad Rafiq
University of Management and Technology, Lahore, Pakistan
The objective of the study was to develop and validate an instrument to measure psychological flexibility in university students. There has been a lack of relevant existing tools that provides the expressions from the local context of Pakistani culture among the study population. The data was collected from a private university in Lahore Pakistan. A pool of 43 items was generated with the help of 73 undergraduate students. The items were administered to (N=538) students, males (28%), and females (72%) with the mean age of 21.5 years, (SD=3.64). The responses were equally divided to perform exploratory factor analysis and confirmatory factor analysis. The results arrived at a five-factor solution of 42 items and a three-factor solution of 29 items. Among the two competing solutions, the three-factor model of 29 items was chosen as the final scale based on confirmatory factor analysis results which measures (a) compassion and moral values, (b) social adjustment, and (c) self-management in university students belong to the fields of natural, social or management sciences. The scale is named the "Psychological Flexibility Scale for University students (PFS-US)". This suggests that the tool would provide future directions for advancement in this area of assessment and prevention of mental health in university students.
Keywords: psychological flexibility; university students; exploratory factor analysis; confirmatory factor analysis
Exploration of the psychological flexibility structure as an independent factor has been caught significant attention in the last few years (Jenkins et al., 2019 ;Seidler et al., 2020). Many studies have performed trials to investigate the effectiveness in the management of emotional pain and stress (Wynne et al., 2019; Yuen et al., 2019) as a resilience factor (Gentili et al., 2019). To overcome the daily life stressors at an early age in youth, psychological flexibility may serve as a prerequisite for university students to prevent the development of chronic psychological symptoms in later life. High psychological flexibility predicts improved mental health (Turley et al., 2019) and boosts the effectiveness of the targeted intervention for behavior modification (Stockton et al., 2019). It may also anticipate better social relationships in university students (Zahra et al., 2020). Poor interpersonal relationships might result in addictive behaviors for example substance abuse (Buzdar et al., 2019) and emotional difficulties. Psychological flexibility may serve as one of the preventative factors (Baugh et al., 2019; Benoy et al., 2019). In short, psychological flexibility is a skill to achieve for the enhancement of health outcomes, personal growth, social interaction, and stress management (Hegarty et al., 2019). There is a need to develop a culturally appropriate (Ong et al., 2019) tool for intervention planning and monitoring of the results through the indigenous measuring tool for an individual's ability to *Correspondence concerning this article should be addressed to Ms. Nazish Idress Chaudhary, School of Professional Psychology, University of Management and Technology, Lahore, Pakistan. Email: nazishidreeschaudhary@yahoo.com adjust own thoughts, emotions, and actions based on the present situation (Benjamin et al., 2020).
Psychological flexibility is related to the self-management of distressful thoughts, emotions, and actions (Almarzooqi et al., 2017). The most well-known model of psychological flexibility has been advocating its efficacy in the promotion of mental health since proposed in the 1990s as a therapeutic intervention called acceptance and commitment therapy (Hayes et al., 2019). The approach to study this construct has claimed that psychological flexibility plays a buffering role in the development of mental illnesses. This improves the quality of life, reduces the impairment through mediating and moderating effects between the correlates of mental health and illnesses (Leonidou et al., 2019). The concept of psychological flexibility has been used in the assessment tools validated for the western population (Benoy et al., 2019 ;Ong et al., 2019) namely Psychological Flexibility Questionnaire (PFQ), Open and Engaged Questionnaire, Action and Acceptance Questionnaire II (AAQ-II) by Bond et al. (2011) that has been linked with the six dimensions discussed in the model including mindfulness, experiential avoidance, self as context, value-based committed action, etc. (Benoy et al., 2019; Timmers et al., 2019).
The literature review for the psychological flexibility leads to the understanding of the construct in terms of the “person by situation approach” in which cognitive and emotional reappraisal demands the adaptability of human behavior based on a present situation (Kobylińska & Kusev, 2019). It refers to managing and regulating the expression of psychological functioning in human beings that reflects in the activities. Negative and unpleasant thoughts or emotions have been associated with psychosomatic symptoms (Boykin et al., 2019), mood disruptions, anxiety, depression, and several other psychopathologies even psychological flexibility also has been shown that there is a potential to mediate the impact of psychedelic drugs on mental health and functioning (Davis et al., 2020). The trials containing the control group have been demonstrated that an increase in the tendency to manage own thoughts, emotions, and actions may exhibit different outcomes due to the influence of one's cultural, social, and environmental factors (Kioskli et al., 2019; Thompson et al., 2020).
The cross-cultural differences may be caused by genetic dispositions, external stimuli, and personal life experiences. Such differences in the expression and manifestation of psychological flexibility implied (Ramaci et al., 2019) for the addition of responses from Asian context in the emerging evidence for the application of the construct in a specific context as compared to the universal utility of the available scales (Timmers et al., 2019). As Pakistan has concerned, minimal literature about psychological flexibility has been contributed. In Pakistan, the researchers have been used the scales validated for the western population and the outcome of the studies (Ong et al., 2019) may fail to reveal the true expressions and manifestations of psychological flexibility due to the unique nature of culturally driven responses from the individuals belonging to a particular setting (Drake et al., 2019). It has also been strongly recommended that the measurement tool for psychological flexibility must be validated across cultures and specific populations (Ong et al., 2019). This area has been neglected in university students as well (Sutcliffe et al., 2019).
The challenge is to provide clinical and non-clinical professionals with an indigenous assessment tool to measure psychological flexibility (Richardson & Jost, 2019). There is a gap in the utility of psychological flexibility culturally specific interventions to train for the self- management of stress and related mental health issues specifically in young adults (McAteer & Gillanders, 2019). Issues including low self-esteem, suicidal ideation, and difficulty in interpersonal relationships (Bibi et al., 2020) have been reported in the recent literature since the last decade as a result of psychological inflexibility in adults (Roush et al., 2019). The university students suffer from similar psychiatric problems along with poor academic performance, aggression, and hostility due to the lack of psychological flexibility (Berkout et al., 2019). Inflexibility in behavior leads to depression, quality of life, and an unproductive attitude towards the recovery of mental health conditions (Kim & Lee, 2019).
RationaleThe exploration of the nature of psychological flexibility (Barney et al., 2019) in the context of Pakistani culture is unaddressed (Lei et al., 2016). This will supply the demand for the development of indigenous psychological flexibility measuring tools (Žuljević et al., 2020) in more diverse contexts and specific evidence-based prevention intervention studies to plan suitable programs for university students in the future (Reilly et al., 2018). The characteristics of psychological flexibility have been explored in this study to develop and validate an indigenous scale for university students in Lahore, Pakistan.
Knowledge HoardingIn the light of the overall purpose for the study, the process included several phases (Carpenter, 2018) i.e. phenomenology and expert validation, reliability and validity check for the instrument development, exploratory and confirmatory factor analysis, instrument finalization. Throughout the process, guidelines provided for scale development by (DeVellis, 2012) were implemented that included the following eight steps:
Mtehod
Research DesignThis study was a mixed-methods research design. The data was collected in both qualitative and quantitative forms and the responses were noted to assess the psychological flexibility with the help of valid and reliable questionnaires.
SampleThe participants (N=538) who showed agreement and voluntarily responded to the protocols were recruited as the sample for the testing. Twenty percent of the sample was attained after two weeks of interval for the test-retest reliability.
Assessment Measures
Psychological Flexibility Scale for University Students (PFS-US)This is the newly developed indigenous tool for measuring psychological flexibility in university students. The scale contained 43 expressions reported by the university students based on their experiences. The given instructions were “A list of statements is given. Considering how true each of the statements is for you, choose the relevant option for each of the statements to indicate your response!”. The scoring options included (1) never, (2), sometimes, (3) often, (4) always. High scores represented high psychological flexibility. The scores were further divided into three categories of low, moderate, and high with the cutoff scores range of 29-58, 59-87, and 88-116 respectively. The same strategy was utilized to calculate each of the factor scores. The scores range for factor 1 (low=14-28, moderate=29-42, high=43-56), factor 2 (low=11-22, moderate=23-33, high=34-44), and factor 3 (low=4-8, moderate=9-12, high=13-16) are planned accordingly based on the model of psychological flexibility.
Action and Acceptance Questionnaire (AAQ-II)This questionnaire was developed, validated, and revised as a multidimensional tool that measures both psychological flexibility and inflexibility (Bond et al., 2011; Ong et al., 2019). The scale was administered on the current study population to establish discriminant validity. It is a self-report measure of one factor containing seven items total that assessed based on the response options comprised of scores from 1-7 were (1) never true, (2), very seldom true, (3) seldom true, (4) sometimes true, (5) frequently true, (6), almost always true, (7) always true. The higher scores represent psychological inflexibility and lower scores show psychological flexibility. This means the higher the scores the, higher the inflexibility and vice versa. In this study, the measure is used to correlate the higher scores on action and acceptance questionnaire II that represents higher psychological inflexibility with the higher scores of indigenous psychological flexibility. As a result, a negative correlation shows the difference between the scales. The instructions were “Below is a list of statements. Please rate how true each of the statements is for you by using the scale below to fill in your choice”. The questionnaire has sound psychometric properties with accessibility and has been used commonly in many previous studies for similar purposes.
ProcedureInstitutional ethical committees approved this study; ethical considerations were followed where necessary. Officially the permission was taken from the institutes for data collection via signature on letter formally. The university authority permitted to collect data for the present study. The aim was briefed and it was assured that confidentiality and anonymity would be maintained. The participants were approached; informed consent was obtained from them verbally and the research purpose was briefed to them as well. They were informed that they have the right to withdraw from the study anytime and in that case, their shared information will be discarded immediately otherwise used for research purposes only.
Phase IThe operationalization of the construct was carried out with the literature review and definitions used in the previous models. Using a definition, an open-ended question was devised to explore the phenomenology and elicit the responses from 73 university students with at least 12 years of formal education completion, both male and female aged between 16-29 about the characteristics of psychologically flexible individuals in phase I of item pool generation. The overlapping and ambiguous items were removed from the initially collated 55 items. Then a list of the final 43 items extracted through qualitative content analysis, a phenomenological approach was shared with the experts along with the operational definition.
Phase IIIn phase II of expert validation and pilot testing, five mental health experts with a minimum of 2 years of experience in student counseling including clinical psychologists were approached based on the convenience sampling non-probability method. The items were converted into a four-point Likert scale where 1 denoted "Not at all relevant/clear", 2 indicated " somewhat relevant/clear", 3 indicated "very much relevant/clear" and 4 denoted "completely relevant/clear". The experts were asked to rate the items to the extent it reflects the variable based on their professional experience with the development population. They empirically reviewed the responses reported by the participants for relevancy and clarity. All the items with the acceptable item-level content validity index (I-CVI) of more than 0.5-1.0 and acceptable level of scale content validity index (S-CVI), attained through 80% agreement by all the experts on each item was used for pilot testing with five university students to check whether it is reader- friendly. No item was excluded following the rating of expert validation; in this way, the face and content validity of the scale was achieved successfully. In pilot testing total administration time was an average of 10 minutes, no difficulty was reported in the understanding of instructions and scale items. Finally, the scale of 43 items was converted into a self-report measure for university students with language appropriateness for the specific culture in the English version based on the education level (Psychological Flexibility Scale for University Students PFS-US).
Phase IIINext, in phase III for the establishment of psychometric properties, the reader’s friendly version of the items was used to collect data from (N=538) students from a private university in Lahore, males (28%) and females (72%) with a mean age (M=21.5, SD=3.64). Those students who have completed their 12 years of formal education currently enrolled in undergraduate degrees took part excluding those who participated in phases II and I. There were university students from natural sciences (38%), social sciences (39%), and management sciences (23%).
Results
Chronbach’s Alpha Coefficient ReliabilityFor the construction of the PFS-US scale, an assessment of its reliability was analyzed. PFS-US had a significantly high inter-item correlation (α= .919) of the 43 items in the scale.
Split Half ReliabilityThe split-half reliability of the 29 finalized items was calculated with the odd and even method in which the items were divided into two halves containing 14 and 15 items. Between the two halves of the scale, the internal consistency of PFS-US was found .875 (p<0.001) and .798 (p<0.001) respectively. This presented a high correlation between the two halves of the scale items that was r= .801 (p<0.001).
Discriminant ValidityTo establish construct validity, another scale to measure psychological inflexibility was administered to the participants. Results, r= -.174 (p<.05) highlighted that the two measures are negatively weakly related to each other. The psychological flexibility scale has a negative weak correlation with another scale that measures psychological inflexibility.
Test-retest ReliabilityTwo weeks of test-retest reliability of the scale was derived on approximately 20% of the participants showing r= 0.975 (n=116, p<.001).
Reliability of the Factor SolutionsChronbach’s alpha of the 5 factors solution of the PFS-US scale is (α= .70) and for 3 factors is (α= .895). There is a significantly high correlation between the factors of the scale.
Exploratory Factor AnalysisThe factor analysis was carried out to determine the factor structure of the PFS-US. The principal Component Analysis extraction method for parallel analysis was used. Varimax rotation of eigenvalues identified the underlying factors of the 43 items. The outcome highlighted the number of factors to retain in a factor analysis through the Monte Carlo simulation method. Kaiser-Meyer Olkin Measure of Sample Adequacy (KEMO) was found to be .912 and Bartlett's Test Approx. Chi-Square was 6550.29 (p<0.001) indicated that the distribution of data is appropriate for the factor analysis. To establish the dimensions of PFS-US, all the possible variances are quickly and accurately calculated among various aspects. Then the initial eigenvalues of the components explained the factor loadings with ten, five, and three-factor solutions. After the satisfactory analysis was carried out, a five-factor solution was retained for the 42 items that provided a clear structure with about 24% variance of the data given below (Table.1). In this way, only one item was excluded.
Table 1
An alternative three-factor structure with less dubious and overlapped themes was also considered with a 26% variance as shown (in Table.2). However, following the results of CFA confirmed and verified the latent variables, 14 items were removed from the final scale.
Table2Confirmatory Factor Analysis
CFA was conducted to test the EFA results derived from the multidimensional construct of psychological flexibility. It is composed of five and three factors. A new data set was collected other than used for EFA of 269 undergraduate university students to analyze data in SPSS and AMOS v. 25. The same measures were administered and findings were examined.
A best-fit model (as shown in Figure 1) was found for Psychological Flexibility Scale for University Students (PFS-US) with the use of this statistical analysis technique that verifies the factor structure of a set of observed variables. The analysis allows the researcher to test the hypothesis that a relationship between observed variables and their underlying latent constructs exists. The researcher uses knowledge of the theory, empirical research, or both, that postulates the relationship pattern a priori and then tests the hypothesis statistically {Chyung, 2017 #636}. The purpose of using this method is to test for factorial invariance using Structural Equation Modeling (SEM), providing a comprehensive approach to evaluate differences between samples of participants, beginning from a confirmatory baseline model and subsequently adding constraints at the different measurement model (Iliceto & Fino, 2015).
Figure 1Note:
Fourteen observed variables were excluded during this process.
It contains a powerful blueprint that identifies the factor structure or what we think it is. Some points to consider are as follows-Considering a research hypothesis being testing and sufficient sample size (e.g., 5-20 cases per parameter estimate), validating measurement instruments, Multivariate normality, and parameter identification (André et al., 2020).
Figure 2
The ratio of each parameter estimate to its standard error is distributed as a z statistic and is significant at the level of 0.05 if its value exceeds 1.96 and at 0.01, its value exceeds 2.56. The model summary of this test for PFS-US is given below (as shown in Table 3).
Table 3
CFA is based on linear statistical models. Statistical tests associated are valid if certain assumptions are met assuming a normal distribution. It also incorporates measured variables and latent constructs. Results from these models indicated adequate fit (Mazzurco et al., 2020) for each of the factors (e.g., CFI > .931, TFI > .920) and all factor loadings are significant.
Discussion
The study was intended to develop and validate the indigenous psychological flexibility scale for university students, which would identify the culture-specific patterns of reaction in different situations using psychological flexibility. An open-ended approach through a response scale was used to explore the related expressions. Along with the PFS-US, the action and acceptance questionnaire II (Bond et al., 2011) was used. Exploratory factor analysis produced two-factor solutions with five and three factors. The confirmatory factor analysis led to the exclusion of a total of 14 items from the initial scale. Each of the factors in PFS-US was labeled based on the common emergent themes of the items within a factor. They retained 29 items that were assigned to their respective factors excluding the items that were not retained based on the test criteria. As an outcome, a scale with remaining items coherent with the EFA's three-factor solution with high reliability and validity was finalized.
It has been observed that psychological flexibility is functionally related to the different dimensions including compassion, moral values, social adjustment, and self-management. Some variations existed between cultures in the manifestation and expressions of psychological flexibility. From culture to culture, the differences between individualistic (Grégoire et al., 2020; Lucas et al., 2020) and collectivistic context supported the responses given by the development population for the scale. The students during university years of life go through certain biological changes and experience psychological distress (Morton et al., 2020) due to a variety of reasons i.e. social pressure, peer comparison, academic workload, career planning, identity formation, and so on. Such problems invite cognitive, behavioral (Upton, 2020), and emotional distress. The level of psychological flexibility affects stress management leading to the worsening of self-harming and fatal consequences (Kirtley, 2020).
Psychological flexibility is necessary to manage stress and to prevent the development of serious mental illness (Marais et al., 2020). They experience challenges frequently and face the transitions for successful adjustment in different unpredictable situations (Peltz et al., 2020). For the assessment of their capacity to deal with the constant challenges, an indigenous scale was important to develop and test considering the cross-cultural differences (Koppenborg, 2020). The three factors were attained through EFA namely compassion and moral values, social adjustment, and self-management. The final factors are interpreted as follows:
Factor 1: Compassion and Moral ValuesThis factor contains 14 items. The items indicate acts of appreciation, forgiveness, respectfulness, guidance, and helpful attitude. The examples of the items in factor 1 are "faithful in social relationships", "care about the health of others", "motivated", and "Believe in spending quality time with others", and so on. The factor items have a resemblance with the values and committed action concept of the western psychological flexibility model (Fonseca et al., 2020; Miller & Orsillo, 2020). The items reflect the human nature of altruism in individuals which may be a hallmark of a collectivistic culture where providing social support and holding onto unlimited faith is expected and preferred for healthy functioning, success, and well-being (Akbar & Woods, 2020).
Factor 2: Social AdjustmentThis factor contains 11 items. The items reveal effective communication, positive thinking, acceptance, focus on the present moment, and assertiveness. The examples of the items reflected in this factor are "listen attentively", "confident", "clarity about life purpose", and "able to handle any kind of conditions in life", and so on. The factor items are similar to the self-as context concept of the western psychological flexibility model (Zucchelli et al., 2020). The items of this factor and the literature suggest that human beings tend to interact in a socially satisfying manner when individuals are good at adjusting to the constant change in circumstances on a daily basis (Tariq & Adil, 2020).
Factor 3: Self-ManagementThis factor contains 4 items. The items indicate situational behavior changes, self-awareness, and patience. The examples are “analyzing thoughts” and “observing emotions”, etc., so the items correlate with the present moment concept of the western psychological flexibility model (Ryan et al., 2020; Trindade et al., 2020). The items in this dimension show cultural variations. Self-control may change over time, observing their thoughts and emotions is accompanied by acknowledging others and context-based actions in the scale from collectivistic culture. This expresses that concepts are personal and do not universally rely on theories. In the specific culture of Pakistan, individuals mostly care about others than themselves even if not encouraged and regardless of the social support they seek (Shujja et al., 2020; Morton et al., 2020).
The first, second, and third factors bear resemblance to some aspects of the psychological flexibility model proposed in Western populations. However, a couple of factors within the indigenous scale appear to be unique and potentially irrelevant to Western contexts, but are vital for understanding psychological flexibility in specific populations, particularly those in Eastern countries. For instance, while the concept of living in the present moment and acceptance (as proposed by Ryan et al., 2020) aligns somewhat with factor 3 (self-management) in the newly developed indigenous Eastern scale, the values of commitment and self-as-context (as suggested by Luoma et al., 2020) are slightly related to factors 1 (compassion and moral value) and 2 (social adjustment). Notably, the dimension of cognitive defusion (Zucchelli et al., 2020) present in the Western scale is entirely absent in the specific context of Pakistan. This highlights the importance of considering cultural nuances and contextual differences when examining psychological constructs like flexibility.
Limitations, Recommendations, and SuggestionsThe study was time-sensitive and limited to represent data from one setting. This recommended that psychological flexibility tools have importance for future research. Another recommendation is that the variable must be explored for advancement in counseling or clinical settings. This suggests that instruments be tested for a variety of purposes in the specific culture among diverse units of the population.
ImplicationsThe findings suggested that the indigenous scale has the implication that fulfills the gap of the need for a culturally appropriate tool that measures psychological flexibility. The application includes use in future research and institutions specifically dealing with the university population.
ConclusionIn the present study, a reliable and valid tool development was attempted to measure psychological flexibility in the local university students. Cultural-specific experiences were collated within this population. The results provided a final scale of 29 items with an acceptable level of psychometric properties. The goal of developing a scale with cultural implications for university students is achieved.
References
Akbar, S., & Woods, K. (2020). Understanding Pakistani parents’ experience of having a child with special educational needs and disability (SEND) in England. European Journal of Special Needs Education, 35(5), 663–678. https://doi.org/10.1080/08856257.2020.1748428
Almarzooqi, S., Chilcot, J., & McCracken, L. M. (2017). The role of psychological flexibility in migraine headache impact and depression. Journal of Contextual Behavioral Science, 6(2), 239-243. https://doi.org/10.1016/j.jcbs.2017.04.004
André, S., Maulana, R., Helms-Lorenz, M., Telli, S., Chun, S., Fernández-García, C.-M., de Jager, T., Irnidayanti, Y., Inda-Caro, M., Lee, O., Safrina, R., Coetzee, T., & Jeon, M. (2020). Student Perceptions in Measuring Teaching Behavior Across Six Countries: A Multi-Group Confirmatory Factor Analysis Approach to Measurement Invariance. Frontiers in Psychology, 11, 273–285. https://doi.org/10.3389/fpsyg.2020.00273
Baugh, L. M., Cox, D. W., Young, R. A., & Kealy, D. (2019). Partner trust and childhood emotional maltreatment: The mediating and moderating roles of maladaptive schemas and psychological flexibility. Journal of Contextual Behavioral Science, 12, 66–73. https://doi.org/10.1016/j.jcbs.2019.02.001
Benjamin, J. Z., Harbeck-Weber, C., Ale, C., & Sim, L. (2020). Becoming flexible: Increase in parent psychological flexibility uniquely predicts better well-being following participation in a pediatric interdisciplinary pain rehabilitation program. Journal of Contextual Behavioral Science, 15, 181–188. https://doi.org/10.1016/j.jcbs.2020.01.003
Benoy, C., Knitter, B., Knellwolf, L., Doering, S., Klotsche, J., & Gloster, A. T. (2019). Assessing psychological flexibility: Validation of the open and engaged state questionnaire. Journal of Contextual Behavioral Science, 12, 253-260. https://doi.org/10.1016/j.jcbs.2018.08.005
Benoy, C., Knitter, B., Schumann, I., Bader, K., Walter, M., & Gloster, A. T. (2019). Treatment sensitivity: Its importance in the measurement of psychological flexibility. Journal of Contextual Behavioral Science, 13, 121-125. https://doi.org/10.1016/j.jcbs.2019.07.005
Berkout, O. V., Tinsley, D., & Flynn, M. K. (2019). A review of anger, hostility, and aggression from an ACT perspective. Journal of Contextual Behavioral Science, 11, 34-43. https://doi.org/10.1016/j.jcbs.2018.12.001
Bibi, A., Saleem, A., Khalid, M. A., & Shafique, N. (2020). Emotional Intelligence and Aggression among University Students of Pakistan: A Correlational Study. Journal of Aggression, Maltreatment & Trauma, 29(10), 1189–1203. https://doi.org/10.1080/10926771.2019.1709592
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., . . . Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire–II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676-688. https://doi.org/10.1016/j.beth.2011.03.007
Boykin, D. M., Anyanwu, J., Calvin, K., & Orcutt, H. K. (2020). The moderating effect of psychological flexibility on event centrality in determining trauma outcomes. Psychological Trauma: Theory, Research, Practice, and Policy, 12(2), 193–199. https://doi.org/10.1037/tra0000490
Buzdar, M. A., Nadeem, M., Fatima, T., & Naoreen, B. (2019). Effects of Religious Orientations on the Prevalence of Social Media Disorder Among Muslim University Students in Pakistan. Journal of Religion and Health, 59(6), 3247–3256. https://doi.org/10.1007/s10943-019-00915-6