class: center, middle, inverse, title-slide # ETC1010: Data Modelling and Computing ## Lecture 4B: Advanced topics in data visualisation ### Dr. Nicholas Tierney & Professor Di Cook ### EBS, Monash U. ### 2019-08-23 --- class: bg-blue center middle .vvhuge.white[ While the song is playing... ] .vhuge.white[ Draw a mental model / concept map of last lectures content on joins. ] --- # recap .vhuge[ - Joins - venn diagrams - feedback ] --- # Joins with a person and a coat, by [Leight Tami](https://twitter.com/leigh_tami18/status/1021471889309487105/photo/1) <img src="images/joins_using_coat.jpg" width="100%" style="display: block; margin: auto;" /> --- # Upcoming Due Dates .vhuge[ - Assignment 2: Thursday 5th September, 5pm - Stay tuned on ED for the upcoming dates ] --- class: bg-main1 # Making effective data plots .huge[ 1. Principles / science of data visualisation 2. Features of graphics ] --- class: bg-main1 # Principles / science of data visualisation .huge[ - Palettes and colour blindness - change blindness - using proximity - hierarchy of mappings ] --- class: bg-main1 # Features of graphics .huge[ - Layering statistical summaries - Themes - adding interactivity ] --- class: bg-main5 # Palettes and colour blindness .huge[ There are three main types of colour palette: - Qualitative: categorical variables - Sequential: low to high numeric values - Diverging: negative to positive values ] --- # Qualitative: categorical variables <img src="lecture-4b-slides_files/figure-html/print-qual-pal-1.png" width="100%" style="display: block; margin: auto;" /> --- # Sequential: low to high numeric values <img src="lecture-4b-slides_files/figure-html/print-seq-pal-1.png" width="100%" style="display: block; margin: auto;" /> --- # Diverging: negative to positive values <img src="lecture-4b-slides_files/figure-html/print-div-pal-1.png" width="100%" style="display: block; margin: auto;" /> --- class: bg-main1 # Example: TB data ``` ## # A tibble: 157,820 x 5 ## country year count gender age ## <chr> <dbl> <dbl> <chr> <chr> ## 1 Afghanistan 1980 NA m 04 ## 2 Afghanistan 1981 NA m 04 ## 3 Afghanistan 1982 NA m 04 ## 4 Afghanistan 1983 NA m 04 ## 5 Afghanistan 1984 NA m 04 ## 6 Afghanistan 1985 NA m 04 ## 7 Afghanistan 1986 NA m 04 ## 8 Afghanistan 1987 NA m 04 ## 9 Afghanistan 1988 NA m 04 ## 10 Afghanistan 1989 NA m 04 ## # … with 157,810 more rows ``` --- class: bg-main1 # Example: TB data - adding relative change from 2002 - 2012 ``` ## # A tibble: 219 x 4 ## country `2002` `2012` reldif ## <chr> <dbl> <dbl> <dbl> ## 1 Afghanistan 6509 13907 1.14 ## 2 Albania 225 185 -0.178 ## 3 Algeria 8246 7510 -0.0893 ## 4 American Samoa 1 0 -1 ## 5 Andorra 2 2 0 ## 6 Angola 17988 22106 0.229 ## 7 Anguilla 0 0 0 ## 8 Antigua and Barbuda 4 1 -0.75 ## 9 Argentina 5383 4787 -0.111 ## 10 Armenia 511 316 -0.382 ## # … with 209 more rows ``` --- class: bg-main1 # Example: Sequential colour with default palette ```r ggplot(tb_map) + geom_polygon(aes(x = long, y = lat, group = group, fill = reldif)) + theme_map() ``` <img src="lecture-4b-slides_files/figure-html/map-default-1.png" width="80%" style="display: block; margin: auto;" /> --- class: bg-main1 # Example: (improved) sequential colour with default palette ```r library(viridis) ggplot(tb_map) + geom_polygon(aes(x = long, y = lat, group = group, fill = reldif)) + theme_map() + scale_fill_viridis(na.value = "white") ``` <img src="lecture-4b-slides_files/figure-html/viridis-plot-1.png" width="80%" style="display: block; margin: auto;" /> --- class: bg-main1 # Example: Diverging colour with better palette ```r ggplot(tb_map) + geom_polygon(aes(x = long, y = lat, group = group, fill = reldif)) + theme_map() + scale_fill_distiller(palette = "PRGn", na.value = "white", limits = c(-7, 7)) ``` <img src="lecture-4b-slides_files/figure-html/map-distiller-1.png" width="80%" style="display: block; margin: auto;" /> --- # summary on colour palettes .huge[ - Different ways to map colour to values: - Qualitative: categorical variables - Sequential: low to high numeric values - Diverging: negative to positive values ] --- class: bg-main1 # Colour blindness .huge[ - About 8% of men (about 1 in 12), and 0.5% women (about 1 in 200) population have difficulty distinguishing between red and green. - Several colour blind tested palettes: RColorbrewer has an associated web site [colorbrewer.org](http://colorbrewer2.org) where the palettes are labelled. See also `viridis`, and `scico`. ] --- class: bg-main1 # Plot of two coloured points: Normal Mode <img src="lecture-4b-slides_files/figure-html/colour-blind-1.png" width="100%" style="display: block; margin: auto;" /> --- class: bg-main1 # Plot of two coloured points: dicromat mode <img src="lecture-4b-slides_files/figure-html/colour-blind-2-1.png" width="100%" style="display: block; margin: auto;" /> --- class: bg-main1 <img src="lecture-4b-slides_files/figure-html/colourblindr-show-1.png" width="80%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r p2 <- p + scale_colour_brewer(palette = "Dark2") p2 ``` <img src="lecture-4b-slides_files/figure-html/colourblindr-brewer-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 <img src="lecture-4b-slides_files/figure-html/cb-grid-1.png" width="80%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r p3 <- p + scale_colour_viridis_d() p3 ``` <img src="lecture-4b-slides_files/figure-html/colourblindr-viridis-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 <img src="lecture-4b-slides_files/figure-html/cb-grid-viridis-1.png" width="80%" style="display: block; margin: auto;" /> --- class: bg-main1 # Summary colour blindness .huge[ - Apply colourblind-friendly colourscales - `+ scale_colour_viridis()` - `+ scale_colour_brewer(pallete = "Dark2")` - `scico` R package ] --- class: bg-main1 # Pre-attentiveness: Find the odd one out? <img src="lecture-4b-slides_files/figure-html/pre-attentiveness-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 # Pre-attentiveness: Find the odd one out? <img src="lecture-4b-slides_files/figure-html/pre-attentive-easier-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 # Using proximity in your plots .vhuge[ Basic rule: place the groups that you want to compare close to each other ] --- class: bg-main1 .vhuge[ Which plot answers which question? - "Is the incidence similar for males and females in 2012 across age groups?" - "Is the incidence similar for age groups in 2012, across gender?" ] --- class: bg-main1 ## ...incidence similar for: (males and females) or (age groups, across gender) ?" <img src="lecture-4b-slides_files/figure-html/print-many-tb-1.png" width="100%" style="display: block; margin: auto;" /><img src="lecture-4b-slides_files/figure-html/print-many-tb-2.png" width="100%" style="display: block; margin: auto;" /> ??? Here are two different arrangements of the tb data. To answer the question "Is the incidence similar for males and females in 2012 across age groups?" the first arrangement is better. It puts males and females right beside each other, so the relative heights of the bars can be seen quickly. The answer to the question would be "No, the numbers were similar in youth, but males are more affected with increasing age." The second arrangement puts the focus on age groups, and is better to answer the question "Is the incidence similar for age groups in 2012, across gender?" To which the answer would be "No, among females, the incidence is higher at early ages. For males, the incidence is much more uniform across age groups." --- class: bg-main1 # "Is the incidence similar for males and females in 2012 across age groups?" <img src="lecture-4b-slides_files/figure-html/gg-fill-gender-print-1.png" width="100%" style="display: block; margin: auto;" /> .vlarge[ - Males & females next to each other: relative heights of bars is seen quickly. - Auestion answer: "No, the numbers were similar in youth, but males are more affected with increasing age." ] --- class: bg-main1 # "Is the incidence similar for age groups in 2012, across gender?" <img src="lecture-4b-slides_files/figure-html/gg-fill-age-print-1.png" width="100%" style="display: block; margin: auto;" /> .vlarge[ - Puts the focus on age groups - Answer to the question: "No, among females, the incidence is higher at early ages. For males, the incidence is much more uniform across age groups." ] --- # Proximity wrap up .huge[ - Facetting of plots, and proximity are related to change blindness, an area of study in cognitive psychology. - There are a series of fabulous videos illustrating the effects of making a visual break, on how the mind processes it by Daniel Simons lab. - Here's one example: [The door study](https://www.youtube.com/watch?v=FWSxSQsspiQ) ] --- # Layering .huge[ - *Statistical summaries:* It is common to layer plots, particularly by adding statistical summaries, like a model fit, or means and standard deviations. The purpose is to show the **trend** in relation to the **variation**. - *Maps:* Commonly maps provide the framework for data collected spatially. One layer for the map, and another for the data. ] --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y1)) + geom_point() ``` <img src="lecture-4b-slides_files/figure-html/point-1-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y1)) + geom_point() + geom_smooth(method = "lm", se = FALSE) ``` <img src="lecture-4b-slides_files/figure-html/point-2-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y1)) + geom_point() + geom_smooth(method = "lm") ``` <img src="lecture-4b-slides_files/figure-html/point-3-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y2)) + geom_point() ``` <img src="lecture-4b-slides_files/figure-html/point-4-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y2)) + geom_point() + geom_smooth(method = "lm", se = FALSE) ``` <img src="lecture-4b-slides_files/figure-html/point-5-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y2)) + geom_point() + geom_smooth(se = FALSE) ``` <img src="lecture-4b-slides_files/figure-html/point-6-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r ggplot(df, aes(x = x, y = y2)) + geom_point() + geom_smooth(se = FALSE, span = 0.05) ``` <img src="lecture-4b-slides_files/figure-html/point-7-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 ```r p1 <- ggplot(df, aes(x = x, y = y2)) + geom_point() + geom_smooth(se = FALSE, span = 0.2) p1 ``` <img src="lecture-4b-slides_files/figure-html/point-8-1.png" width="60%" style="display: block; margin: auto;" /> --- class: bg-main1 # Interactivity with magic plotly ```r library(plotly) ggplotly(p1) ```
--- # Themes: Add some style to your plot .left-code[ ```r p <- ggplot(mtcars) + geom_point(aes(x = wt, y = mpg, colour = factor(gear))) + facet_wrap(~am) p ``` ] .right-plot[ <img src="lecture-4b-slides_files/figure-html/mtcars-out-1.png" width="100%" style="display: block; margin: auto;" /> ] --- # Theme: theme_minimal .left-code[ ```r p + theme_minimal() ``` ] .right-plot[ <img src="lecture-4b-slides_files/figure-html/mtcars-minimal-out-1.png" width="100%" style="display: block; margin: auto;" /> ] --- # Theme: ggthemes `theme_few()` .left-code[ ```r p + theme_few() + scale_colour_few() ``` ] .right-plot[ <img src="lecture-4b-slides_files/figure-html/mtcars-theme-few-out-1.png" width="100%" style="display: block; margin: auto;" /> ] --- # Theme: ggthemes `theme_excel()` 🤒 .left-code[ ```r p + theme_excel() + scale_colour_excel() ``` ] .right-plot[ <img src="lecture-4b-slides_files/figure-html/mtcars-theme-excel-out-1.png" width="100%" style="display: block; margin: auto;" /> ] --- # Theme: for fun .left-code[ ```r library(wesanderson) p + scale_colour_manual( values = wes_palette("Royal1") ) ``` ] .right-plot[ <img src="lecture-4b-slides_files/figure-html/theme-wes-out-1.png" width="100%" style="display: block; margin: auto;" /> ] --- class: bg-main1 # Summary: themes .huge[ - The `ggthemes` package has many different styles for the plots. - Other packages such as `xkcd`, `skittles`, `wesanderson`, `beyonce`, `ochre`, .... ] --- # Hierarchy of mappings .vlarge[ 1. Position - common scale (BEST): axis system 2. Position - nonaligned scale: boxes in a side-by-side boxplot 3. Length, direction, angle: pie charts, regression lines, wind maps 4. Area: bubble charts 5. Volume, curvature: 3D plots 6. Shading, color (WORST): maps, points coloured by numeric variable - [Di's crowd-sourcing expt](http://visiphilia.org/2016/08/03/CM-hierarchy) - Nice explanation by [Peter Aldous](http://paldhous.github.io/ucb/2016/dataviz/week2.html) - [General plotting advice and a book from Naomi Robbins](https://www.forbes.com/sites/naomirobbins/#2b1e20082a6a) ] --- # Your Turn: .huge[ - lab quiz open (requires answering questions from Lab exercise) - go to rstudio.cloud and check out exercise 4-B - If you want to use R / Rstudio on your laptop: - Install R + Rstudio (see ) - open R - type the following: ```r # install.packages("usethis") library(usethis) use_course("dmac.netlify.com/lectures/lecture4b/exercise/exercise-4b.zip") ``` ] --- # Resources .huge[ - Kieran Healy [Data Visualization](http://socviz.co/index.html) - Winston Chang (2012) [Cookbook for R](graphics cookbook) - Antony Unwin (2014) [Graphical Data Analysis](http://www.gradaanwr.net) - Naomi Robbins (2013) [Creating More Effective Charts](http://www.nbr-graphs.com) ] --- # Share and share alike <a rel="license" href="http://creativecommons.org/licenses/by/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by/4.0/88x31.png" /></a><br />This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>. ??? ## Variable types and mapping | Type of variable | How to map | Common errors | |:-----------------|:----------------------------|:--------------| | Categorical, qualitative | Category + count/proportion displayed, often as an area plot or with a small number of categories mapped to colour or symbol | Not including 0 on the count/proportion axis. Not ordering categories. | | Quantitative | Position along an axis | Displaying as a bar, especially when showing mean values. Mapping to colour. | | Date/Time | Time-ordered axis, different temporal resolutions to study long term trend, or seasonal patterns. Lines typically connect measurements to indicate temporal dependence | Time order corrupted | | Space | Conventional projections of the sphere, map aspect ratio| Wrong aspect ratio | # Coordinate systems - *Cartesian, polar:* most plots are made in Cartesian coordinates. Just a few are in polar coordinates, primarily the pie chart. Polar coordinates use radius and angle to describe position in 2D space. Occasionally measurements like wind (direction and speed) make sense to be plotted in polar coordinates. - *fixed, equal:* When variables are made on scales that should be comparable, it may be important to reflect this in the axes limits and page space that the plot takes. (This is different from `theme(aspect.ratio=1)` which sets the physical size of the plot to be the same, or in some ratio.) - *map:* Maps come in conventional formats, most often with a specific aspect ratio of vertical to horizontal axes, that depends on latitude. - *flip:* Useful for generating a plot with a categorical variable on the x axis and then flipping it sideways to look at. ```r df <- tibble(x = runif(100), y = runif(100) * 10) ggplot(df, aes(x = x, y = y)) + geom_point() + coord_fixed() ``` <img src="lecture-4b-slides_files/figure-html/coord-system-1.png" width="100%" style="display: block; margin: auto;" /> ```r ggplot(df, aes(x = x, y = y)) + geom_point() + coord_equal() ``` <img src="lecture-4b-slides_files/figure-html/coord-system-2.png" width="100%" style="display: block; margin: auto;" /> ```r ggplot(df, aes(x = x, y = y)) + geom_point() + coord_fixed(ratio = 0.2) ``` <img src="lecture-4b-slides_files/figure-html/coord-system-3.png" width="100%" style="display: block; margin: auto;" /> ```r ggplot(df, aes(x = x, y = y)) + geom_point() + theme(aspect.ratio = 1) ``` <img src="lecture-4b-slides_files/figure-html/coord-system-4.png" width="100%" style="display: block; margin: auto;" /> ## Adding interactivity to plots Interaction on a plot can help de-clutter it, by making labels only show on mouse over. Occasionally it can be useful to zoom into parts of the plot. Often it is useful to change the aspect ratio. The `plotly` package makes it easy to add interaction to ggplots. ```r library(plotly) p <- passengers %>% filter(type_of_flight == "INTL") %>% spread(key = bound, value = amount) %>% ggplot() + geom_point(aes(x = IN, y = OUT, label = airport)) + facet_wrap(~Year, ncol = 8) + coord_equal() + scale_x_continuous("Incoming passengers (mil)", breaks = seq(0, 8000000, 2000000), labels = seq(0, 8, 2)) + scale_y_continuous("Outgoing passengers (mil)", breaks = seq(0, 8000000, 2000000), labels = seq(0, 8, 2)) ggplotly(p) ```