Next Word Prediction NLP, What would Conan say?

Brian Liswell
2-9-2021

Capstone Project Presentation

Try out the app at: https://bliswell.shinyapps.io/good_guess/

SwiftKey dataset:

  • Blogs 15% used
  • News 15% used
  • Twitter 15% used

  • 100% of Conan O'Brien Joke Set (dry wit, surreal humor, etc.)

Conan jokes pulled from: https://github.com/brendansudol/conan-jokes-data

https://en.wikipedia.org/wiki/Conan_O%27Brien

Method...

  • Cleared out non-ascii and punctuation
  • Left in curse words
  • Created 2,3, and 4-grams
  • Used Markov chain and Backoff method
  • Pulled out stop-words, but put some back to get what seem to be normal language word prediction.

Try out the app at: https://bliswell.shinyapps.io/good_guess/

Shiny App Startup

Lookup tables need to be loaded when App starts. It will take a moment.

plot of chunk unnamed-chunk-1

Try out the app at: https://bliswell.shinyapps.io/good_guess/

Shiny App Usage

When its loaded the buttons will be populated and a title given. Simply type in the box and the buttons will be automatically populated. Press the button to add the button-word to your sentence.
Try out the app at: https://bliswell.shinyapps.io/good_guess/ plot of chunk unnamed-chunk-2