NextWordPredictor

Puxin Xu
April 17, 2016

Introduction

The main goal of this capstone project is to build a shiny application that is able to predict the next word.

This exercise was divided into seven sub tasks like data cleansing, exploratory analysis, the creation of a predictive model and more.

All text data that is used to create a frequency dictionary and thus to predict the next words comes from a corpus called HC Corpora.

All text mining and natural language processing was done with the usage of a variety of well-known R packages.

The Applied algorithms & Models

After creating a data sample from the HC Corpora data, this sample was cleaned by conversion to lowercase, removing punctuation, links, white space, numbers and all kinds of special characters. This data sample was then tokenized into so-called n-grams.

In the fields of computational linguistics and probability, an n-gram is a contiguous sequence of n items from a given sequence of text or speech. (Source)

Instruction of Application

As the picture, the interface of the application is simple.

There are two steps to predict a word:

  • 1. input the text of which you want to predict the next word
  • 2. quick click the submit button.

Additional Information