In-class worksheet 5
Feb 5, 2019
1. Tidy data
Is the iris dataset tidy? Explain why or why not.
head(iris)## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1 5.1 3.5 1.4 0.2 setosa
## 2 4.9 3.0 1.4 0.2 setosa
## 3 4.7 3.2 1.3 0.2 setosa
## 4 4.6 3.1 1.5 0.2 setosa
## 5 5.0 3.6 1.4 0.2 setosa
## 6 5.4 3.9 1.7 0.4 setosaIt is tidy. The dataset contains five variables: sepal length, sepal width, petal length, petal width, and species name. All of these variables correspond to one column each, and each row in the data set corresponds to one observational unit (flower).
Is the HairEyeColor dataset tidy? Explain why or why not.
HairEyeColor## , , Sex = Male
##
## Eye
## Hair Brown Blue Hazel Green
## Black 32 11 10 3
## Brown 53 50 25 15
## Red 10 10 7 7
## Blond 3 30 5 8
##
## , , Sex = Female
##
## Eye
## Hair Brown Blue Hazel Green
## Black 36 9 5 2
## Brown 66 34 29 14
## Red 16 7 7 7
## Blond 4 64 5 8It is not. Columns correspond to different values of eye color. In a tidy data set, there would be one column listing eye colors and one listing hair colors, with values brown, blue, hazel, green (for eye color) and black, brown, red, blong (for hair color). Also, the two tables should be combined, and sex should be stored in an additional column.
2. Selecting rows and columns
All subsequent code will be based on the dplyr library, which is part of the tidyverse. So we first have to load this library:
library(tidyverse)Now, using the dplyr function filter(), pick all the rows in the iris dataset that pertain to species setosa, and store them in a new table called iris_setosa.
iris_setosa <- filter(iris, Species == "setosa")
head(iris_setosa)## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1 5.1 3.5 1.4 0.2 setosa
## 2 4.9 3.0 1.4 0.2 setosa
## 3 4.7 3.2 1.3 0.2 setosa
## 4 4.6 3.1 1.5 0.2 setosa
## 5 5.0 3.6 1.4 0.2 setosa
## 6 5.4 3.9 1.7 0.4 setosaPick all the rows in the iris dataset where species virginica has a sepal length > 7.
filter(iris, Sepal.Length > 7 & Species == "virginica")## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1 7.1 3.0 5.9 2.1 virginica
## 2 7.6 3.0 6.6 2.1 virginica
## 3 7.3 2.9 6.3 1.8 virginica
## 4 7.2 3.6 6.1 2.5 virginica
## 5 7.7 3.8 6.7 2.2 virginica
## 6 7.7 2.6 6.9 2.3 virginica
## 7 7.7 2.8 6.7 2.0 virginica
## 8 7.2 3.2 6.0 1.8 virginica
## 9 7.2 3.0 5.8 1.6 virginica
## 10 7.4 2.8 6.1 1.9 virginica
## 11 7.9 3.8 6.4 2.0 virginica
## 12 7.7 3.0 6.1 2.3 virginicaAre there any cases in the iris dataset for which the ratio of sepal length to sepal width exceeds the ratio of petal length to petal width? Use filter() to find out.
filter(iris, Sepal.Length/Sepal.Width > Petal.Length/Petal.Width)## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1 6.9 3.1 5.1 2.3 virginicaThere is exactly one such observation, for species virginica.
Create a pared-down table which contains only data for species setosa and which only has the columns Sepal.Length and Sepal.Width. Store the result in a table called iris_pared.
# first extract all data for species setosa
iris_setosa <- filter(iris, Species == "setosa")
# now select sepal length and width
iris_pared <- select(iris_setosa, Sepal.Length, Sepal.Width)
head(iris_pared)## Sepal.Length Sepal.Width
## 1 5.1 3.5
## 2 4.9 3.0
## 3 4.7 3.2
## 4 4.6 3.1
## 5 5.0 3.6
## 6 5.4 3.93. Creating new data, arranging
Using the function mutate(), create a new data column that holds the ratio of sepal length to sepal width. Store the resulting table in a variable called iris_ratio.
iris_ratio <- mutate(iris, sepal_length_to_width = Sepal.Length/Sepal.Width)
head(iris_ratio)## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1 5.1 3.5 1.4 0.2 setosa
## 2 4.9 3.0 1.4 0.2 setosa
## 3 4.7 3.2 1.3 0.2 setosa
## 4 4.6 3.1 1.5 0.2 setosa
## 5 5.0 3.6 1.4 0.2 setosa
## 6 5.4 3.9 1.7 0.4 setosa
## sepal_length_to_width
## 1 1.457143
## 2 1.633333
## 3 1.468750
## 4 1.483871
## 5 1.388889
## 6 1.384615Order the iris_ratio table by species name and by increasing values of sepal length-to-width ratio.
iris_ratio_ordered <- arrange(iris_ratio, Species, sepal_length_to_width)
head(iris_ratio_ordered)## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1 5.2 4.1 1.5 0.1 setosa
## 2 4.6 3.6 1.0 0.2 setosa
## 3 5.7 4.4 1.5 0.4 setosa
## 4 5.5 4.2 1.4 0.2 setosa
## 5 5.1 3.8 1.5 0.3 setosa
## 6 5.1 3.8 1.9 0.4 setosa
## sepal_length_to_width
## 1 1.268293
## 2 1.277778
## 3 1.295455
## 4 1.309524
## 5 1.342105
## 6 1.3421054. Grouping and summarizing
Calculate the mean and standard deviation of the sepal lengths for each species. Do this by first creating a table grouped by species, which you call iris_grouped. Then run summarize() on that table.
iris_grouped <- group_by(iris, Species)
head(iris_grouped)## # A tibble: 6 x 5
## # Groups: Species [3]
## Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## <dbl> <dbl> <dbl> <dbl> <fct>
## 1 5.1 3.5 1.4 0.2 setosa
## 2 4.9 3 1.4 0.2 setosa
## 3 4.7 3.2 1.3 0.2 setosa
## 4 4.6 3.1 1.5 0.2 setosa
## 5 5 3.6 1.4 0.2 setosa
## 6 5.4 3.9 1.7 0.4 setosasummarize(
iris_grouped,
mean_sepal_length = mean(Sepal.Length),
sd_sepal_length = sd(Sepal.Length)
)## # A tibble: 3 x 3
## Species mean_sepal_length sd_sepal_length
## <fct> <dbl> <dbl>
## 1 setosa 5.01 0.352
## 2 versicolor 5.94 0.516
## 3 virginica 6.59 0.636Use the function n() to count the number of observations for each species.
summarize(iris_grouped, count = n())## # A tibble: 3 x 2
## Species count
## <fct> <int>
## 1 setosa 50
## 2 versicolor 50
## 3 virginica 50For each species, calculate the percentage of cases with sepal length > 5.5.
summarize(
iris_grouped,
percent = sum(Sepal.Length > 5.5)/n()
)## # A tibble: 3 x 2
## Species percent
## <fct> <dbl>
## 1 setosa 0.06
## 2 versicolor 0.78
## 3 virginica 0.985. If this was easy
Take the iris_ratio data set you have created and plot the distribution of sepal length-to-width ratios for the three species.
# ggplot2 is part of tidyverse, so we don't need to load it separately
theme_set(theme_bw(base_size = 12)) # change the ggplot2 theme
ggplot(iris_ratio, aes(x = sepal_length_to_width, fill = Species)) +
geom_density(alpha = 0.3)
Now plot sepal length-to-width ratios vs. sepal lengths. Does it look like there is a relationship between the length-to-width ratios and the lengths? Does it matter whether you consider each species individually or all together? How could you find out?
ggplot(iris_ratio, aes(x = Sepal.Length, y = sepal_length_to_width, color = Species)) +
geom_point()
There seems to be an overall trend of increasing length-to-width ratio with increasing length, but it seems that within each species there is little correlation between these values. We can check this by running a correlation analysis for each species:
# Setosa
setosa_ratio <- filter(iris_ratio, Species == "setosa")
cor.test(setosa_ratio$Sepal.Length, setosa_ratio$sepal_length_to_width)##
## Pearson's product-moment correlation
##
## data: setosa_ratio$Sepal.Length and setosa_ratio$sepal_length_to_width
## t = -1.1218, df = 48, p-value = 0.2675
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.4195161 0.1240336
## sample estimates:
## cor
## -0.1598322# Versicolor
versicolor_ratio <- filter(iris_ratio, Species == "versicolor")
cor.test(versicolor_ratio$Sepal.Length, versicolor_ratio$sepal_length_to_width)##
## Pearson's product-moment correlation
##
## data: versicolor_ratio$Sepal.Length and versicolor_ratio$sepal_length_to_width
## t = 1.7522, df = 48, p-value = 0.08613
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.03559303 0.49008499
## sample estimates:
## cor
## 0.2451838# Virginica
virginica_ratio <- filter(iris_ratio, Species == "virginica")
cor.test(virginica_ratio$Sepal.Length, virginica_ratio$sepal_length_to_width)##
## Pearson's product-moment correlation
##
## data: virginica_ratio$Sepal.Length and virginica_ratio$sepal_length_to_width
## t = 3.5015, df = 48, p-value = 0.001011
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.1975161 0.6480484
## sample estimates:
## cor
## 0.4510651Virginica shows a significant correlation between sepal length and length-to-width ratio, the other two species do not.