Capstone Text Prediction Milestone Report

Starting with the English text files, this report summarizes initial data exploration up to building a rudimentary text predictive function based on one-word or two-word input.

Exploratory Analysis

A basic summary of the combined English text:

Loading required package: NLP
[1] "blogs:"
[1] "wordcount: 37334131"
[1] "linecount: 899288"
[1] "news:"
[1] "wordcount: 2643969"
[1] "linecount: 77259"
[1] "twitter posts:"
[1] "wordcount: 30373543"
[1] "linecount: 2360148"
[1] "total English text word frequencies:"
[1] "#tokens: 1,814,182"
[1] "#words: 55,133,383"
[1] "word freq quartiles:"
     Min.   1st Qu.    Median      Mean   3rd Qu.      Max. 
      1.0       1.0       1.0      30.4       2.0 2914382.0 
435 top tokens cover 50% of all words, 38,384--90%, 150,076--95%, 1,262,849--99%[1] ""
    the     and     for     you    that    with 
2914382 1566087  763523  751637  674735  469552 
            鸡蛋糕. 黄色(黃色)[huángsè]         ヾ(@°▽°@)ノ      ヾ(≧∇≦*)ゝthis         ヽ(゜q。)ノ                 ーf) 
                  1                   1                   1                   1                   1                   1 

Both the numeric summaries and the histogram show a severely skewed distribution: a small clump of high-frequency tokens followed by a lengthy tail of low-frequency tokens, including a great deal of unique appearances that won’t be much help for text prediction. The same pattern recurs for unfiltered text, filtered text, and various n-grams; the histogram above essentially applies to all other textual collections with only differences of scale.

Performing the same word frequency analysis with basic filtering–lowercasing, removing punctuation and numbers, and omitting tokens that appear less than 10 times yields a more manageable collection of similar shape:

TF_filtered <-termFreq(c(text_news, text_blogs, text_twit),
                       list(
                               tolower = T,
                               removePunctuation = T,
                               removeNumbers = T,
                               bounds = list(local = c(10, Inf))
                       ))
TF_filtered <- TF_filtered[order(TF_filtered, decreasing = T)]
inspect_tf(TF_filtered)
[1] "#tokens: 84,092"
[1] "#words: 52,338,680"
[1] "word freq quartiles:"
     Min.   1st Qu.    Median      Mean   3rd Qu.      Max. 
     10.0      16.0      32.0     622.4     109.0 2933447.0 
240 top tokens cover 50% of all words, 7,592--90%, 16,226--95%, 49,270--99%[1] ""
    the     and     you     for    that    with 
2933447 1586703  843317  773712  717239  478593 
🏀🏀🏀  💙💙 💜💜💜  💰💰  😃👍  😳😳 
 10  10  10  10  10  10 

the unique token count dropped from 1.8M to 84K, but the vast majority of word-instances are still concentrated in the top frequency. Raising the bar to 100 appearances yields 22K tokens, but the total word count hardly budges. The emoticon sequences point to a need for further filtering.

Ngram Frequencies

library(ngram)
text_en <- multiread(path_text_en)
Warning: incomplete final line found on 'C:\Users\Anton\Documents\Drive\extra studies\R\datasciencecoursera\capstone\Coursera-SwiftKey\final\en_US/en_US.news.txt'Warning: line 167155 appears to contain an embedded nulWarning: line 268547 appears to contain an embedded nulWarning: line 1274086 appears to contain an embedded nulWarning: line 1759032 appears to contain an embedded nul

Even using the ngram package, designed to be a lot faster than rweka, getting the full bigram & trigram tables took forever–and taught me the advantages of saving R objects to disk rather than re-calculating from scratch every session.

all_en_bigram_table <- readRDS(paste0(path, "\\all_en_bigram_table.rds"))
all_en_trigram_table <- readRDS(paste0(path, "\\all_en_trigram_table.rds"))

inspect_pt <- function(pt) {
        print(paste("#grams:", comma(length(pt$freq))))
        print(paste("#instances:", comma(sum(pt$freq))))
        print("gram freq quartiles:")
        print(summary(pt$freq))
        words_to_50 <- 0
        words_to_90 <- 0
        words_to_95 <- 0
        words_to_99 <- 0
        i <- 0
        s <- 0
        words <- sum(pt$freq)
        print(head(pt$freq))
        print(tail(pt$freq))
        while(words_to_99 == 0){
                i <- i + 1
                s <- s + pt$freq[i]
                if(words_to_50==0 & s > words * .5){
                        words_to_50 <- comma(i)
                }
                if(words_to_90==0 & s > words * .9){
                        words_to_90 <- comma(i)
                }
                if(words_to_95==0 & s > words * .95){
                        words_to_95 <- comma(i)
                }
                if(words_to_99==0 & s > words * .99){
                        words_to_99 <- comma(i)
                }
        }
        cat(paste0(words_to_50," top grams cover 50% of all grams instances, ",
                    words_to_90, "--90%, ", words_to_95, "--95%, ", 
                    words_to_99, "--99%"))
        print("")
        print(head(pt$ngrams))
        print(tail(pt$ngrams))
}

print("bigrams stats:")
[1] "bigrams stats:"
inspect_pt(all_en_bigram_table)
[1] "#grams: 11,775,133"
[1] "#instances: 68,746,365"
[1] "gram freq quartiles:"
     Min.   1st Qu.    Median      Mean   3rd Qu.      Max. 
     1.00      1.00      1.00      5.84      2.00 258306.00 
[1] 258306 246509 137589 136193 129543 118489
[1] 1 1 1 1 1 1
37,932 top grams cover 50% of all grams instances, 4,900,497--90%, 8,337,815--95%, 11,087,670--99%[1] ""
[1] "of the "  "in the "  "for the " "to the "  "on the "  "to be "  
[1] "casting friends "      "recent designation "   "jaye penned "          "writing adrienne "     "response israel "      "hootenannies hippies "
print("trigrams stats:")
[1] "trigrams stats:"
inspect_pt(all_en_trigram_table)
[1] "#grams: 36,475,393"
[1] "#instances: 68,746,364"
[1] "gram freq quartiles:"
     Min.   1st Qu.    Median      Mean   3rd Qu.      Max. 
    1.000     1.000     1.000     1.885     1.000 23707.000 
[1] 23707 21049 19333 13217 13171 12709
[1] 1 1 1 1 1 1
3,810,834 top grams cover 50% of all grams instances, 29,600,757--90%, 33,038,075--95%, 35,787,930--99%[1] ""
[1] "thanks for the " "one of the "     "a lot of "       "to be a "        "i want to "      "going to be "   
[1] "businesses peggy is " "him there appeal "    "patriots laughed at " "yourself a green "    "today judi dench "    "answer to two "      

Like the wordcounts, the ngrams distributions are heavily right-skewed, with most of the instances concentrated in a small portion of high-frequency tokens and an extremely long tail of 1-frequency ngrams, suggesting an obvious efficiency gain in dropping most of that tail with little prediction power loss.

Modeling & Implementation Notes

Though the assignment suggests Markov chains, I plan to go far simpler with plain lookup tables: instead of calculating all the probabilities for possible next word instances, just write down the top 3 (could do just the top 1 even), and retrieve them as needed. For language detection, I will use the franc package, since it’s the first one I found that allows to pre-select languages for detection. It should be easy to put together a Shiny interface: text input box, button for loading the text from the text box to identify language, count words, and select the appropriate lookup table, then calculate and display the predicted next word options.

LS0tDQp0aXRsZTogIk1pbGVzdG9uZSByZXBvcnQiDQpvdXRwdXQ6IGh0bWxfbm90ZWJvb2sNCi0tLQ0KDQojIENhcHN0b25lIFRleHQgUHJlZGljdGlvbiBNaWxlc3RvbmUgUmVwb3J0DQoNClN0YXJ0aW5nIHdpdGggdGhlIEVuZ2xpc2ggdGV4dCBmaWxlcywgdGhpcyByZXBvcnQgc3VtbWFyaXplcyBpbml0aWFsIGRhdGEgZXhwbG9yYXRpb24gdXAgdG8gYnVpbGRpbmcgYSBydWRpbWVudGFyeSB0ZXh0IHByZWRpY3RpdmUgZnVuY3Rpb24gYmFzZWQgb24gb25lLXdvcmQgb3IgdHdvLXdvcmQgaW5wdXQuDQoNCiMjIEV4cGxvcmF0b3J5IEFuYWx5c2lzDQoNCmBgYHtyIGluY2x1ZGU9RkFMU0V9DQpybShsaXN0PWxzKCkpDQpwYXRoX3RleHRfZW4gPC0gciIoQzpcVXNlcnNcQW50b25cRG9jdW1lbnRzXERyaXZlXGV4dHJhIHN0dWRpZXNcUlxkYXRhc2NpZW5jZWNvdXJzZXJhXGNhcHN0b25lXENvdXJzZXJhLVN3aWZ0S2V5XGZpbmFsXGVuX1VTKSINCnBhdGggPC0gciIoQzpcVXNlcnNcQW50b25cRG9jdW1lbnRzXERyaXZlXGV4dHJhIHN0dWRpZXNcUlxkYXRhc2NpZW5jZWNvdXJzZXJhXGNhcHN0b25lXENvdXJzZXJhLVN3aWZ0S2V5XGZpbmFsKSINCnRleHRfYmxvZ3MgPC0gcmVhZExpbmVzKHBhc3RlMChwYXRoX3RleHRfZW4sIlxcZW5fVVMuYmxvZ3MudHh0IikpDQp0ZXh0X25ld3MgPC0gcmVhZExpbmVzKHBhc3RlMChwYXRoX3RleHRfZW4sIlxcZW5fVVMubmV3cy50eHQiKSkNCnRleHRfdHdpdCA8LSByZWFkTGluZXMocGFzdGUwKHBhdGhfdGV4dF9lbiwiXFxlbl9VUy50d2l0dGVyLnR4dCIpKQ0KYGBgDQoNCkEgYmFzaWMgc3VtbWFyeSBvZiB0aGUgY29tYmluZWQgRW5nbGlzaCB0ZXh0Og0KDQpgYGB7ciBlY2hvPUZBTFNFfQ0KbGlicmFyeSh0bSkNCmxpYnJhcnkoc2NhbGVzKQ0KDQppbnNwZWN0X3RleHQgPC0gZnVuY3Rpb24odGV4dCl7DQogICAgICAgIHByaW50KHBhc3RlKCJ3b3JkY291bnQ6Iiwgc3VtKGxlbmd0aHMoc3Ryc3BsaXQodGV4dCwgJyAnKSkpKSkNCiAgICAgICAgcHJpbnQocGFzdGUoImxpbmVjb3VudDoiLCBzdW0obGVuZ3RocyhzdHJzcGxpdCh0ZXh0LCAnXG4nKSkpKSkNCn0NCg0KaW5zcGVjdF90ZiA8LSBmdW5jdGlvbih0Zikgew0KICAgICAgICBwcmludChwYXN0ZSgiI3Rva2VuczoiLCBjb21tYShsZW5ndGgodGYpKSkpDQogICAgICAgIHByaW50KHBhc3RlKCIjd29yZHM6IiwgY29tbWEoc3VtKHRmKSkpKQ0KICAgICAgICBwcmludCgid29yZCBmcmVxIHF1YXJ0aWxlczoiKQ0KICAgICAgICBwcmludChzdW1tYXJ5KHRmKSkNCiAgICAgICAgd29yZHNfdG9fNTAgPC0gMA0KICAgICAgICB3b3Jkc190b185MCA8LSAwDQogICAgICAgIHdvcmRzX3RvXzk1IDwtIDANCiAgICAgICAgd29yZHNfdG9fOTkgPC0gMA0KICAgICAgICBpIDwtIDANCiAgICAgICAgcyA8LSAwDQogICAgICAgIHdvcmRzIDwtIHN1bSh0ZikNCiAgICAgICAgd2hpbGUod29yZHNfdG9fOTkgPT0gMCl7DQogICAgICAgICAgICAgICAgaSA8LSBpICsgMQ0KICAgICAgICAgICAgICAgIHMgPC0gcyArIHRmW2ldDQogICAgICAgICAgICAgICAgaWYod29yZHNfdG9fNTA9PTAgJiBzID4gd29yZHMgKiAuNSl7DQogICAgICAgICAgICAgICAgICAgICAgICB3b3Jkc190b181MCA8LSBjb21tYShpKQ0KICAgICAgICAgICAgICAgIH0NCiAgICAgICAgICAgICAgICBpZih3b3Jkc190b185MD09MCAmIHMgPiB3b3JkcyAqIC45KXsNCiAgICAgICAgICAgICAgICAgICAgICAgIHdvcmRzX3RvXzkwIDwtIGNvbW1hKGkpDQogICAgICAgICAgICAgICAgfQ0KICAgICAgICAgICAgICAgIGlmKHdvcmRzX3RvXzk1PT0wICYgcyA+IHdvcmRzICogLjk1KXsNCiAgICAgICAgICAgICAgICAgICAgICAgIHdvcmRzX3RvXzk1IDwtIGNvbW1hKGkpDQogICAgICAgICAgICAgICAgfQ0KICAgICAgICAgICAgICAgIGlmKHdvcmRzX3RvXzk5PT0wICYgcyA+IHdvcmRzICogLjk5KXsNCiAgICAgICAgICAgICAgICAgICAgICAgIHdvcmRzX3RvXzk5IDwtIGNvbW1hKGkpDQogICAgICAgICAgICAgICAgfQ0KICAgICAgICB9DQogICAgICAgIGNhdChwYXN0ZTAod29yZHNfdG9fNTAsIiB0b3AgdG9rZW5zIGNvdmVyIDUwJSBvZiBhbGwgd29yZHMsICIsDQogICAgICAgICAgICAgICAgICAgIHdvcmRzX3RvXzkwLCAiLS05MCUsICIsIHdvcmRzX3RvXzk1LCAiLS05NSUsICIsIA0KICAgICAgICAgICAgICAgICAgICB3b3Jkc190b185OSwgIi0tOTklIikpDQogICAgICAgIHByaW50KCIiKQ0KICAgICAgICBwcmludChoZWFkKHRmKSkNCiAgICAgICAgcHJpbnQodGFpbCh0ZikpDQp9DQoNCnByaW50KCJibG9nczoiKQ0KaW5zcGVjdF90ZXh0KHRleHRfYmxvZ3MpDQpwcmludCgibmV3czoiKQ0KaW5zcGVjdF90ZXh0KHRleHRfbmV3cykNCnByaW50KCJ0d2l0dGVyIHBvc3RzOiIpDQppbnNwZWN0X3RleHQodGV4dF90d2l0KQ0KDQpwcmludCgidG90YWwgRW5nbGlzaCB0ZXh0IHdvcmQgZnJlcXVlbmNpZXM6IikNClRGIDwtIHRlcm1GcmVxKGModGV4dF9uZXdzLCB0ZXh0X2Jsb2dzLCB0ZXh0X3R3aXQpKQ0KVEYgPC0gVEZbb3JkZXIoVEYsIGRlY3JlYXNpbmcgPSBUKV0NCmluc3BlY3RfdGYoVEYpDQpoaXN0KFRGKQ0KYGBgDQoNCkJvdGggdGhlIG51bWVyaWMgc3VtbWFyaWVzIGFuZCB0aGUgaGlzdG9ncmFtIHNob3cgYSBzZXZlcmVseSBza2V3ZWQgZGlzdHJpYnV0aW9uOiBhIHNtYWxsIGNsdW1wIG9mIGhpZ2gtZnJlcXVlbmN5IHRva2VucyBmb2xsb3dlZCBieSBhIGxlbmd0aHkgdGFpbCBvZiBsb3ctZnJlcXVlbmN5IHRva2VucywgaW5jbHVkaW5nIGEgZ3JlYXQgZGVhbCBvZiB1bmlxdWUgYXBwZWFyYW5jZXMgdGhhdCB3b24ndCBiZSBtdWNoIGhlbHAgZm9yIHRleHQgcHJlZGljdGlvbi4gVGhlIHNhbWUgcGF0dGVybiByZWN1cnMgZm9yIHVuZmlsdGVyZWQgdGV4dCwgZmlsdGVyZWQgdGV4dCwgYW5kIHZhcmlvdXMgbi1ncmFtczsgdGhlIGhpc3RvZ3JhbSBhYm92ZSBlc3NlbnRpYWxseSBhcHBsaWVzIHRvIGFsbCBvdGhlciB0ZXh0dWFsIGNvbGxlY3Rpb25zIHdpdGggb25seSBkaWZmZXJlbmNlcyBvZiBzY2FsZS4NCg0KUGVyZm9ybWluZyB0aGUgc2FtZSB3b3JkIGZyZXF1ZW5jeSBhbmFseXNpcyB3aXRoIGJhc2ljIGZpbHRlcmluZ+KAk2xvd2VyY2FzaW5nLCByZW1vdmluZyBwdW5jdHVhdGlvbiBhbmQgbnVtYmVycywgYW5kIG9taXR0aW5nIHRva2VucyB0aGF0IGFwcGVhciBsZXNzIHRoYW4gMTAgdGltZXMgeWllbGRzIGEgbW9yZSBtYW5hZ2VhYmxlIGNvbGxlY3Rpb24gb2Ygc2ltaWxhciBzaGFwZToNCg0KYGBge3J9DQpURl9maWx0ZXJlZCA8LXRlcm1GcmVxKGModGV4dF9uZXdzLCB0ZXh0X2Jsb2dzLCB0ZXh0X3R3aXQpLA0KICAgICAgICAgICAgICAgICAgICAgICBsaXN0KA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRvbG93ZXIgPSBULA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHJlbW92ZVB1bmN0dWF0aW9uID0gVCwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICByZW1vdmVOdW1iZXJzID0gVCwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBib3VuZHMgPSBsaXN0KGxvY2FsID0gYygxMCwgSW5mKSkNCiAgICAgICAgICAgICAgICAgICAgICAgKSkNClRGX2ZpbHRlcmVkIDwtIFRGX2ZpbHRlcmVkW29yZGVyKFRGX2ZpbHRlcmVkLCBkZWNyZWFzaW5nID0gVCldDQppbnNwZWN0X3RmKFRGX2ZpbHRlcmVkKQ0KDQpgYGANCg0KdGhlIHVuaXF1ZSB0b2tlbiBjb3VudCBkcm9wcGVkIGZyb20gMS44TSB0byA4NEssIGJ1dCB0aGUgdmFzdCBtYWpvcml0eSBvZiB3b3JkLWluc3RhbmNlcyBhcmUgc3RpbGwgY29uY2VudHJhdGVkIGluIHRoZSB0b3AgZnJlcXVlbmN5LiBSYWlzaW5nIHRoZSBiYXIgdG8gMTAwIGFwcGVhcmFuY2VzIHlpZWxkcyAyMksgdG9rZW5zLCBidXQgdGhlIHRvdGFsIHdvcmQgY291bnQgaGFyZGx5IGJ1ZGdlcy4gVGhlIGVtb3RpY29uIHNlcXVlbmNlcyBwb2ludCB0byBhIG5lZWQgZm9yIGZ1cnRoZXIgZmlsdGVyaW5nLg0KDQojIyMgTmdyYW0gRnJlcXVlbmNpZXMNCg0KYGBge3J9DQpsaWJyYXJ5KG5ncmFtKQ0KdGV4dF9lbiA8LSBtdWx0aXJlYWQocGF0aF90ZXh0X2VuKQ0KDQpgYGANCg0KRXZlbiB1c2luZyB0aGUgbmdyYW0gcGFja2FnZSwgZGVzaWduZWQgdG8gYmUgYSBsb3QgZmFzdGVyIHRoYW4gcndla2EsIGdldHRpbmcgdGhlIGZ1bGwgYmlncmFtICYgdHJpZ3JhbSB0YWJsZXMgdG9vayBmb3JldmVy4oCTYW5kIHRhdWdodCBtZSB0aGUgYWR2YW50YWdlcyBvZiBzYXZpbmcgUiBvYmplY3RzIHRvIGRpc2sgcmF0aGVyIHRoYW4gcmUtY2FsY3VsYXRpbmcgZnJvbSBzY3JhdGNoIGV2ZXJ5IHNlc3Npb24uDQoNCmBgYHtyfQ0KYWxsX2VuX2JpZ3JhbV90YWJsZSA8LSByZWFkUkRTKHBhc3RlMChwYXRoLCAiXFxhbGxfZW5fYmlncmFtX3RhYmxlLnJkcyIpKQ0KYWxsX2VuX3RyaWdyYW1fdGFibGUgPC0gcmVhZFJEUyhwYXN0ZTAocGF0aCwgIlxcYWxsX2VuX3RyaWdyYW1fdGFibGUucmRzIikpDQoNCmluc3BlY3RfcHQgPC0gZnVuY3Rpb24ocHQpIHsNCiAgICAgICAgcHJpbnQocGFzdGUoIiNncmFtczoiLCBjb21tYShsZW5ndGgocHQkZnJlcSkpKSkNCiAgICAgICAgcHJpbnQocGFzdGUoIiNpbnN0YW5jZXM6IiwgY29tbWEoc3VtKHB0JGZyZXEpKSkpDQogICAgICAgIHByaW50KCJncmFtIGZyZXEgcXVhcnRpbGVzOiIpDQogICAgICAgIHByaW50KHN1bW1hcnkocHQkZnJlcSkpDQogICAgICAgIHdvcmRzX3RvXzUwIDwtIDANCiAgICAgICAgd29yZHNfdG9fOTAgPC0gMA0KICAgICAgICB3b3Jkc190b185NSA8LSAwDQogICAgICAgIHdvcmRzX3RvXzk5IDwtIDANCiAgICAgICAgaSA8LSAwDQogICAgICAgIHMgPC0gMA0KICAgICAgICB3b3JkcyA8LSBzdW0ocHQkZnJlcSkNCiAgICAgICAgcHJpbnQoaGVhZChwdCRmcmVxKSkNCiAgICAgICAgcHJpbnQodGFpbChwdCRmcmVxKSkNCiAgICAgICAgd2hpbGUod29yZHNfdG9fOTkgPT0gMCl7DQogICAgICAgICAgICAgICAgaSA8LSBpICsgMQ0KICAgICAgICAgICAgICAgIHMgPC0gcyArIHB0JGZyZXFbaV0NCiAgICAgICAgICAgICAgICBpZih3b3Jkc190b181MD09MCAmIHMgPiB3b3JkcyAqIC41KXsNCiAgICAgICAgICAgICAgICAgICAgICAgIHdvcmRzX3RvXzUwIDwtIGNvbW1hKGkpDQogICAgICAgICAgICAgICAgfQ0KICAgICAgICAgICAgICAgIGlmKHdvcmRzX3RvXzkwPT0wICYgcyA+IHdvcmRzICogLjkpew0KICAgICAgICAgICAgICAgICAgICAgICAgd29yZHNfdG9fOTAgPC0gY29tbWEoaSkNCiAgICAgICAgICAgICAgICB9DQogICAgICAgICAgICAgICAgaWYod29yZHNfdG9fOTU9PTAgJiBzID4gd29yZHMgKiAuOTUpew0KICAgICAgICAgICAgICAgICAgICAgICAgd29yZHNfdG9fOTUgPC0gY29tbWEoaSkNCiAgICAgICAgICAgICAgICB9DQogICAgICAgICAgICAgICAgaWYod29yZHNfdG9fOTk9PTAgJiBzID4gd29yZHMgKiAuOTkpew0KICAgICAgICAgICAgICAgICAgICAgICAgd29yZHNfdG9fOTkgPC0gY29tbWEoaSkNCiAgICAgICAgICAgICAgICB9DQogICAgICAgIH0NCiAgICAgICAgY2F0KHBhc3RlMCh3b3Jkc190b181MCwiIHRvcCBncmFtcyBjb3ZlciA1MCUgb2YgYWxsIGdyYW1zIGluc3RhbmNlcywgIiwNCiAgICAgICAgICAgICAgICAgICAgd29yZHNfdG9fOTAsICItLTkwJSwgIiwgd29yZHNfdG9fOTUsICItLTk1JSwgIiwgDQogICAgICAgICAgICAgICAgICAgIHdvcmRzX3RvXzk5LCAiLS05OSUiKSkNCiAgICAgICAgcHJpbnQoIiIpDQogICAgICAgIHByaW50KGhlYWQocHQkbmdyYW1zKSkNCiAgICAgICAgcHJpbnQodGFpbChwdCRuZ3JhbXMpKQ0KfQ0KDQpwcmludCgiYmlncmFtcyBzdGF0czoiKQ0KaW5zcGVjdF9wdChhbGxfZW5fYmlncmFtX3RhYmxlKQ0KcHJpbnQoInRyaWdyYW1zIHN0YXRzOiIpDQppbnNwZWN0X3B0KGFsbF9lbl90cmlncmFtX3RhYmxlKQ0KYGBgDQoNCkxpa2UgdGhlIHdvcmRjb3VudHMsIHRoZSBuZ3JhbXMgZGlzdHJpYnV0aW9ucyBhcmUgaGVhdmlseSByaWdodC1za2V3ZWQsIHdpdGggbW9zdCBvZiB0aGUgaW5zdGFuY2VzIGNvbmNlbnRyYXRlZCBpbiBhIHNtYWxsIHBvcnRpb24gb2YgaGlnaC1mcmVxdWVuY3kgdG9rZW5zIGFuZCBhbiBleHRyZW1lbHkgbG9uZyB0YWlsIG9mIDEtZnJlcXVlbmN5IG5ncmFtcywgc3VnZ2VzdGluZyBhbiBvYnZpb3VzIGVmZmljaWVuY3kgZ2FpbiBpbiBkcm9wcGluZyBtb3N0IG9mIHRoYXQgdGFpbCB3aXRoIGxpdHRsZSBwcmVkaWN0aW9uIHBvd2VyIGxvc3MuDQoNCiMjIE1vZGVsaW5nICYgSW1wbGVtZW50YXRpb24gTm90ZXMNCg0KVGhvdWdoIHRoZSBhc3NpZ25tZW50IHN1Z2dlc3RzIE1hcmtvdiBjaGFpbnMsIEkgcGxhbiB0byBnbyBmYXIgc2ltcGxlciB3aXRoIHBsYWluIGxvb2t1cCB0YWJsZXM6IGluc3RlYWQgb2YgY2FsY3VsYXRpbmcgYWxsIHRoZSBwcm9iYWJpbGl0aWVzIGZvciBwb3NzaWJsZSBuZXh0IHdvcmQgaW5zdGFuY2VzLCBqdXN0IHdyaXRlIGRvd24gdGhlIHRvcCAzIChjb3VsZCBkbyBqdXN0IHRoZSB0b3AgMSBldmVuKSwgYW5kIHJldHJpZXZlIHRoZW0gYXMgbmVlZGVkLiBGb3IgbGFuZ3VhZ2UgZGV0ZWN0aW9uLCBJIHdpbGwgdXNlIHRoZSBmcmFuYyBwYWNrYWdlLCBzaW5jZSBpdCdzIHRoZSBmaXJzdCBvbmUgSSBmb3VuZCB0aGF0IGFsbG93cyB0byBwcmUtc2VsZWN0IGxhbmd1YWdlcyBmb3IgZGV0ZWN0aW9uLiBJdCBzaG91bGQgYmUgZWFzeSB0byBwdXQgdG9nZXRoZXIgYSBTaGlueSBpbnRlcmZhY2U6IHRleHQgaW5wdXQgYm94LCBidXR0b24gZm9yIGxvYWRpbmcgdGhlIHRleHQgZnJvbSB0aGUgdGV4dCBib3ggdG8gaWRlbnRpZnkgbGFuZ3VhZ2UsIGNvdW50IHdvcmRzLCBhbmQgc2VsZWN0IHRoZSBhcHByb3ByaWF0ZSBsb29rdXAgdGFibGUsIHRoZW4gY2FsY3VsYXRlIGFuZCBkaXNwbGF5IHRoZSBwcmVkaWN0ZWQgbmV4dCB3b3JkIG9wdGlvbnMuDQo=