Lightning Talk - Music and TuneR

Leilani Hoang

Plantasia

Music to make plants happy!

Plantasia (1976) by Mother Earth’s

Plants can sing!

Plants communicate with one another

Plants get stressed?

This one is very dehydrated

PlantSounds Dataset

  • Tel Aviv University
  • Stressed plants: Tomatoes and Tobacco
    • Dehydrated and cut
  • Recorded the sounds

Music Package

Purpose: a tool to teach music theory

  • Builds chords, scales, and chord progressions
  • Map them on a Piano
  • Play them back
  • Generate the waveform

Build Scale

library(music)

buildScale('G5', 'major', plot = TRUE)
   G5 major scale

  |  | | | |  |  | | | | | |  |  | | | |  |  | | | | | |  |  | 
  |  | | | |  |  | | | | | |  |  | | | |  |  | | | | | |  |  | 
  |   |   |   |   |   |   |   |   |   |   |   |   |   |   |   |
  | C | D | E | F | G | A | B | C | D | E | F | G | A | B | C |

  Notes: G5 A5 B5 C6 D6 E6 F#6 G6

Form waveform

library(music)

wave <- freq2wave(note2freq(buildChord("C4", "minor")),
                  duration = .05,
                  attack.time = 4,
                  inner.release.time = 5,
                  plot = TRUE)

TuneR Package

Purpose: to analyze music and speech

  • handles WAV files
  • Identifies primary features of sound
  • Estimate frequencies
  • Plot the waveform

Sound Analysis

library(tuneR)

f <- "Vignettes/TestSounds/Sound.wav"

wav <- readWave(f)
print(wav)

WaveMC Object
    Number of Samples:      2000
    Duration (seconds):     0.05
    Samplingrate (Hertz):   44100
    Number of channels:     3
    PCM (integer format):   TRUE
    Bit (8/16/24/32/64):    16

Application

  • TuneR to analyze the soudwaves -Music to turn those soundwaves into notes [put the code here -> currently debugging and figuring out process]

Results

[discuss here]

Resources

  • Khait, Itzhak; Lewin-Epstein, Ohad; Sharon, Raz et al. (2023). Recorded plant sounds from: Sounds emitted by plants under stress are airborne and informative [Dataset]. Dryad. https://doi.org/10.5061/dryad.jwstqjqf7