Correlation Between Binary and Continuous Variables in R

How to calculate correlation between two variables in R

Renesh Bedre 5 minute read

Correlation between two variables   in R

What is Correlation?

  • Correlation is a statistical method to measure the relationship between the two quantitative variables in terms of correlation coefficient ( r ).
  • The correlation coefficient ( r ) measures the strength and direction of (linear) relationship between the two quantitative variables. r can range from +1 (perfect positive correlation) to -1 (perfect negative correlation).
  • The positive values of r indicate the positive relationship and vice versa. The higher the absolute value of r , the stronger is the correlation. If the value of r is 0, it indicates that there is no relationship between the two variables.

Correlation types

Interpretation of correlation coefficient ( r )

The below table suggests the interpretation of r at different absolute values. These cut-off are arbitrary and should be used judiciously while interpreting the dataset.

absolute values of r Interpretation
0.90 - 1.00 Very high correlation
0.70 - 0.90 High correlation
0.50 - 0.70 Moderate correlation
0.30 - 0.50 Low correlation
0 - 0.30 Negligible or weak correlation

Note: In interpretation, correlation can be positive or negative based on the sign of r

Types of correlation coefficients ( r )

There are three main types of correlation coefficients including, Pearson's product-moment correlation coefficient, Spearman's rank-order (Spearman's rho) correlation coefficient, and Kendall's Tau correlation coefficient.

Most of the times correlation coefficients is referred to Pearson's r unless specified.

Note: The appropriate usage of different types of correlation coefficients largely depends on underlying data types, sample size, linear or non-linear relationships between the two variables, and their distributions.

Pearson's product-moment correlation coefficient

Pearson's correlation coefficient (r) is a commonly used method for measuring the relationship between the two variables. Measurement of both variables should be on a continuous scale and they should have a normal distribution. There should be no extreme outlier in the dataset.

Pearson's correlation coefficient (r) may inflate type I error rate if data is markedly non-normally distributed and has an extreme outlier.

Pearson's correlation coefficient (r) more useful when there is linear relationship between the two variables.

Note: If the relationship is not linear and both variables significantly deviate from a normal distribution, it is better to use rank-based correlation coefficients (Spearman's or Kendall's r). The alternate way is to perform data transformations (e.g. logarithmic, square root, etc.,) before calculating Pearson's r.

Suppose, we have x and y variables, the Pearson's correlation coefficient (r) is calcualted as,

Pearson's correlation formula

Calculate Pearson's correlation coefficient in R for students height and weight data,

                              # load dataset                                library                (                tidyverse                )                df                <-                read                .                csv                (                "https://reneshbedre.github.io/assets/posts/reg/height.csv"                )                # view first two rows                                head                (                df                ,                2                )                Height                Weight                1                1.36                52                2                1.47                50                          

Check assumptions of normality for both height and weight variables using Shapiro-Wilk test,

                              shapiro                .                test                (                df                $                Height                )                $                p                [                1                ]                0.977633                shapiro                .                test                (                df                $                Weight                )                $                p                [                1                ]                0.9423351                          

As the p > 0.05 for both height and weight variables, we fail to reject null hypothesis and conclude that both variables are approximately normally distributed. We can use Pearson's method for finding the correlation coefficient.

Calculate Pearson's correlation coefficient (r),

                              # calculate Pearson's correlation coefficient                                cor                .                test                (                df                $                Height                ,                df                $                Weight                ,                method                =                "pearson"                )                # output                                Pearsons                product                -                moment                correlation                data                :                df                $                Height                and                df                $                Weight                t                =                2.5132                ,                df                =                9                ,                p                -                value                =                0.03313                alternative                hypothesis                :                true                correlation                is                not                equal                to                0                95                percent                confidence                interval                :                0.06881088                0.89664256                sample                estimates                :                cor                0.6421781                # plot                                library                (                ggstatsplot                )                ggscatterstats                (                data                =                df                ,                x                =                Height                ,                y                =                Weight                )                          

Pearson correlation

The Pearson's r between height and weight is 0.64 (height and weight of students are moderately correlated). As the p < 0.05, the correlation is statistically significant.

Spearman's rank-order (Spearman's rho) correlation coefficient

Spearman's correlation coefficient is appropriate when one or both of the variables are ordinal or continuous. It is a non-parametric method and is based on the rank instead of the actual values of the variables.

Spearman's correlation coefficient is robust to extreme outliers. When the data is not normally distributed, Spearman's correlation coefficient has more power than Pearson's correlation coefficient.

Spearman's correlation coefficient is more useful when there is nonlinear or monotonic relationship between the two variables.

If sample size is large, Spearman's correlation coefficient is preferred over Kendall's correlation coefficient.

Suppose, we have x and y variables, the Spearman's rank-order correlation coefficient for no tied rank is calculated as,

Spearman's  correlation formula for   no tied rank

Calculate Spearman's rank-order correlation coefficient in R,

                              # We will use the same dataset as used for Pearson's correlation coefficient                                cor                .                test                (                df                $                Height                ,                df                $                Weight                ,                method                =                "spearman"                )                # output                                Spearmans                rank                correlation                rho                data                :                df                $                Height                and                df                $                Weight                S                =                81.685                ,                p                -                value                =                0.03827                alternative                hypothesis                :                true                rho                is                not                equal                to                0                sample                estimates                :                rho                0.6287032                # plot                                ggscatterstats                (                data                =                df                ,                x                =                Height                ,                y                =                Weight                ,                type                =                "nonparametric"                )                          

Spearman's rank correlation

The Spearman's rank-order correlation coefficient between height and weight is 0.62 (height and weight of students are moderately correlated). As the p < 0.05, the correlation is statistically significant.

Kendall's Tau (Kendall rank) correlation coefficient

Kendall's Tau (τ) is a non-parametric rank-based method for calculating the correlation between two variables (ordinal or continuous).

Kendall's Tau is more useful when there is a nonlinear or monotonic relationship between the two variables.

Kendall's Tau correlation formula

Where concor = number of concordant pairs; and discor = number of discordant pairs

Calculate Kendall's Tau correlation coefficient in R,

                              # We will use the same dataset as used for Pearson's correlation coefficient                                cor                .                test                (                df                $                Height                ,                df                $                Weight                ,                method                =                "kendall"                )                # output                                Kendalls                rank                correlation                tau                data                :                df                $                Height                and                df                $                Weight                z                =                1.8741                ,                p                -                value                =                0.06092                alternative                hypothesis                :                true                tau                is                not                equal                to                0                sample                estimates                :                tau                0.4403855                          

The Kendall's Tau correlation coefficient between height and weight is 0.44. As the p > 0.05, the correlation is not statistically significant.

Enhance your skills with statistical courses using R

  • Statistics with R Specialization
  • Data Science: Foundations using R Specialization
  • Data Analysis with R Specialization
  • R Programming
  • Getting Started with Rstudio
  • Durbin-Watson (DW) test (with R code)

References

  1. Bishara AJ, Hittner JB. Testing the significance of a correlation with nonnormal data: comparison of Pearson, Spearman, transformation, and resampling approaches. Psychological methods. 2012 Sep;17(3):399.
  2. Puth MT, Neuhäuser M, Ruxton GD. Effective use of Spearman's and Kendall's correlation coefficients for association between two measured traits. Animal Behaviour. 2015 Apr 1;102:77-84.
  3. Mukaka MM. A guide to appropriate use of correlation coefficient in medical research. Malawi medical journal. 2012;24(3):69-71.
  4. Gust L, D'journo XB. The use of correlation functions in thoracic surgery research. Journal of thoracic disease. 2015 Mar;7(3):E11.
  5. Simple Linear Regression: Finding the equation of the line of best fit

If you have any questions, comments, corrections, or recommendations, please email me at reneshbe@gmail.com

If you enhanced your knowledge and practical skills from this article, consider supporting me on

Buy Me A Coffee

This work is licensed under a Creative Commons Attribution 4.0 International License

Some of the links on this page may be affiliate links, which means we may get an affiliate commission on a valid purchase. The retailer will pay the commission at no additional cost to you.

jacksonconand.blogspot.com

Source: https://www.reneshbedre.com/blog/correlation-analysis-r.html

0 Response to "Correlation Between Binary and Continuous Variables in R"

Post a Comment

Iklan Atas Artikel

Iklan Tengah Artikel 1

Iklan Tengah Artikel 2

Iklan Bawah Artikel