NLP Candidate

# NLP Candidate
## Ryan Wesslen
### UNC Charlotte
### Sept 17, 2018

---

# Agenda

- About Me: 5 min

- My Research: 10 min

- Topic Modeling to Analyze CFPB Complaints: 30 min

- Discussion & Questions: 15 min

---

#### UNC Charlotte PhD Candidate

- Computing & Information Systems (Computer Science)

- UNC Visualization Center, Pacific Northwest National Laboratory, Data Science Initiative, Project Mosaic

#### Prior Education

- UNC-Chapel Hill (BA in Econ, 2003), NYU (MA in Econ, 2011), NCSU (MS in Fin Math, 2009)

#### BofA (2009-2014) / Hawkeye (2014-2015)

- Credit Risk and Marketing Analytics and Strategy

- GRMAP, Small Business Credit Risk, Auto/DFS Scorecard Modeling

#### Teaching & R/R Studio enthusiast

- Taught UNCC workshops ([github](https://github.com/wesslen)) in R for text, social media, data viz.

- Tentatively teaching master's Visual Analytics course for UNCC DSI in Spring 2019

---

# My Research

---

## Event Detection in Social Media

[CrystalBall](https://www.researchgate.net/profile/Isaac_Cho/publication/324598122_CrystalBall_A_Visual_Analytic_System_for_Future_Event_Discovery_and_Analysis_from_Social_Media_Data/links/5ad7bd1f458515c60f588bb8/CrystalBall-A-Visual-Analytic-System-for-Future-Event-Discovery-and-Analysis-from-Social-Media-Data.pdf) Paper

---

## Misinformation using Visual Analytics
<div align="center">
  <video width="600" height="450" controls>
    <source src="./img/verifi.mp4" type="video/mp4">
  </video>
</div>

[ICWSM](https://aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17853) Paper

---

## Explainable AI / Interpretable ML

Source: [DARPA XAI](https://www.darpa.mil/program/explainable-artificial-intelligence)

---

## Visual Interactive Labeling (CHISSL)

Paper under revision

---

## Applied Text Analyses

For more technical, see ["Computer Assisted Text Analysis"](https://arxiv.org/abs/1803.11045) paper

]

- **Management**: Corporate websites on recruitment content (["MNE"]() paper)

- **Organizational Science**: Open-ended survey on manager leadership (["TMM" paper](https://link.springer.com/article/10.1007/s10869-017-9528-3), left)

- **Social Psychology**: Twitter profiles (["Bumper sticker"](https://aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17834) paper)

- **Communications**: Charlotte Protests tweets (next slide)

- I also have text experience with research absracts, patents, news articles, emails, ...

]

---

[IC2S2 2017](https://wesslen.github.io/assets/documents/presentations/IC2S2-HotIssue-Charlotte.pdf) Charlotte Protest Presentation

---

# Text Analysis Methods

<div id="htmlwidget-4c739fe2c1502ed6b44d" style="width:672px;height:480px;" class="grViz html-widget"></div>
<script type="application/json" data-for="htmlwidget-4c739fe2c1502ed6b44d">{"x":{"diagram":"\ndigraph G {\n\nnode [fontname = Helvetica]\nA [label = \"Text Analysis\"]\nB [label = \"Qualitative\"]\nC [label = \"Machine\nLearning\"]\nD [label = \"Natural\nLanguage\nProcessing\"]\nE [label = \"Supervised\"]\nF [label = \"Unsupervised\"]\nG [label = \"Topic\nModeling\"]\n\nA->B A->C A->D C->E C->F F->G;}","config":{"engine":"dot","options":null}},"evals":[],"jsHooks":[]}</script>

---

![](./img/topic-model.png)

Source: Pablo Barbera

---

## CFPB Narrative Complaint Competitive Analysis

---

.pull-left[
Analyze 46,590 CFPB Complaints with *narratives* between **March 2015** to **August 2018** for BAC, JPM, WFC, and CITI.

Use **topic modeling** to identify prevalent themes via unsupervised approach.

Exploratory, document summarization technique needing *little assumed knowledge*.

]

---

![](./img/topic-overview.png)

---

# Example: Topic 18

<div align="center">
<img src="./img/example-topic.png" width=532 height=488>
</div>
---

# Topic 18: "Bonus, offer, points, promotion"

<div id="htmlwidget-b35102b854c500a45472" style="width:100%;height:auto;" class="datatables html-widget"></div>
<script type="application/json" data-for="htmlwidget-b35102b854c500a45472">{"x":{"filter":"none","caption":"<caption>Complaints ranked by Topic Probability for Topic 18<\/caption>","fillContainer":false,"data":[["06/11/2016","07/19/2016","09/06/2016","08/13/2016","07/12/2016","09/03/2016","07/18/2016","08/18/2016","09/13/2016","06/01/2016","06/02/2016","06/13/2016","06/09/2016","06/02/2016","06/04/2016","06/25/2016","05/23/2016","09/27/2016","07/27/2016","06/06/2016","06/05/2016","04/09/2018","06/07/2016","06/01/2016","07/16/2016","07/18/2016","06/08/2018","06/07/2016","06/29/2016","06/22/2016","08/06/2016","05/24/2016","04/30/2016","06/24/2016","08/04/2016","06/27/2016","06/29/2016","06/29/2016","08/08/2016","04/29/2016","06/16/2016","08/02/2016","08/04/2016","07/03/2016","08/03/2016","01/17/2017","08/02/2016","07/28/2016","06/08/2016","07/01/2016","06/11/2016","03/03/2017","05/09/2016","05/09/2016","05/06/2016","05/07/2016","07/26/2016","06/11/2016","06/30/2016","07/04/2016","06/16/2016","05/09/2016","05/14/2016","06/26/2016","05/23/2016","06/30/2016","05/25/2016","06/13/2016","06/13/2016","07/14/2016","06/10/2016","06/01/2016","06/21/2016","08/24/2016","07/12/2016","09/03/2016","06/15/2017","06/20/2016","07/15/2016","06/02/2016","05/31/2016","06/08/2016","07/06/2016","09/27/2016","08/08/2016","08/02/2016","06/25/2016","08/15/2016","08/24/2016","06/30/2016","02/03/2017","06/22/2016","06/20/2016","06/06/2016","07/13/2016","06/15/2016","10/21/2016","06/09/2016","06/17/2016","07/05/2016"],["CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","WFC","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","WFC","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI","CITI"],[0.977,0.976,0.967,0.963,0.962,0.961,0.96,0.96,0.958,0.954,0.952,0.952,0.952,0.952,0.949,0.945,0.942,0.941,0.941,0.939,0.939,0.937,0.936,0.935,0.934,0.933,0.933,0.931,0.931,0.93,0.927,0.926,0.925,0.924,0.924,0.924,0.923,0.922,0.922,0.921,0.921,0.918,0.918,0.918,0.917,0.916,0.915,0.915,0.915,0.914,0.914,0.913,0.912,0.912,0.912,0.911,0.91,0.907,0.907,0.906,0.906,0.905,0.904,0.902,0.901,0.901,0.9,0.899,0.898,0.898,0.898,0.898,0.897,0.897,0.896,0.896,0.896,0.895,0.895,0.894,0.894,0.893,0.893,0.893,0.893,0.893,0.893,0.892,0.89,0.89,0.89,0.889,0.889,0.889,0.888,0.887,0.886,0.886,0.886,0.885],["In     I opened a Citibank CitiGold checking account with a bonus offe ... ","In   of this year, I opened a Citigold checking account using the prom ... ","On    , 2016, I opened a Citigold checking account with a promotion co ... ","In   2016 was induced to open a Citibank CitiGold checking account wit ... ","On    , 2016, I opened a Citigold checking account with a promotion co ... ","On    , 2016, I opened a Citigold checking account with a promotion co ... ","Opened a bank account in   with Citibank during a promotional period o ... ","On    , 2016, I opened a Citigold checking account with a promotion co ... ","On    , 2016, I opened a Citigold checking account with a promotion co ... ","In    , I was induced to open a Citibank CitiGold checking account wit ... ","In   2016, I was induced to open a Citibank CitiGold checking account ... ","Last year, I opened a Citigold checking account under promotion  . Thi ... ","Opened CitiGold account in   2015 for   TYP promo. Met requirements wi ... ","In   2016, I was induced to open a Citibank CitiGold checking account ... ","I opened up a Citigold checking account with a promotion of       mile ... ","In    , 2016 I opened a Citibank CitiGold checking account with a bonu ... ","XX/XX/ , I opened a Citibank CitiGold checking account with a bonus of ... ","In  , I signed up for a Citigold account via a promotional offer (   ) ... ","We opened a Citi AAdvantage Mastercard XX/XX/ . In order to earn an ac ... ","I opened a Citigold checking account with Citi Bank using a promotiona ... ","During Citigold checking account opening, I was offered   Thank You po ... ","I opened a Wells Fargo checking account in XX/XX/ 2017 under the terms ... ","I have just received a correspondence from     ( Director, Client Rese ... ","On     2016, I was induced to open a Citibank CitiGold checking accoun ... ","On    , 2016, I opened a Citigold checking account with a promotion co ... ","I opened a Citibank Citigold Checking account in response to a promoti ... ","Citi promised me       miles for opening a new checking account, spend ... ","Received in US Mail a targeted promotional offer for a   Citibank Than ... ","I signed up for Citibank's promotional offer to open a CitiGold bank a ... ","I opened a   checking account with a promotional offer (   - receiving ... ","I signed up for a Citibank Gold account with a promotion code for   AA ... ","Citi offered a promotion that awards   Thankyou points when you open a ... ","I opened a Citbank Citigold bank account, I was to received     miles ... ","I signed up for a Citibank Citigold account with a sign up bonus offer ... ","On  / /2016 I called Citi at   and spoke to an agent at   EDT who open ... ","I opened my CitiGold checking account XX/XX/2016. I signed up for it b ... ","Upon opening a Citigold checking account with Citibank, I signed up fo ... ","On  / /2016, I opened a Citigold checking account under promotion  . I ... ","In   2016, I opened a Citigold checking account with a promotion code ... ","XX/XX/ , I opened a Citigold checking account with promotion code :  . ... ","In    , I was induced to open a Citibank CitiGold checking account wit ... ","I have not received the promised       Advantage points for meeting th ... ","On  / /2016 I called Citi at   and spoke to an agent named   at   EDT ... ","I opened a Citibank checking account in association with a   ThankYou ... ","I signed up for a Citigold checking account after receiving a promotio ... ","I signed up for a Citi   account in XX/XX/ . I was promised a {$400.00 ... ","I have not received the promised       Advantage points for meeting th ... ","I signed up for a CitiGold Checking account which promised a reward fo ... ","I opened a citigold checking account with a bonus offer of   Thank you ... ","Good Morning, On  / /16 I opened a Citigold checking account in respon ... ","Citi offered me       miles for opening a Citigold checking account an ... ","I signed up for Citibank's \" {$400.00} Checking Bonus with {$15000.00} ... ","I opened a Citigold checking account with a bonus offer of   Thank you ... ","I opened a Citigold checking account with a bonus offer of   Thank you ... ","I opened a citigold checking account with a bonus offer of   Thank you ... ","It has now been 7 days past the deadline for Citi to honor their targe ... ","I signed up for a Citigold checking account with was supposed to give ... ","I signed up for a CitiGold checking account after receiving an offer f ... ","I received an offer to apply for a Citibank CitiGold Checking Account, ... ","I opened a Citigold Checking Account under a promotional code that wou ... ","In  , I received a mailer from CitiBank to open up a Citigold Checking ... ","In    , I followed a link that was on the CitiBank website to open a n ... ","I had opened a Citigold checking account XX/XX/2016 under the promotio ... ","Last fall I opened a Citibank Citigold checking account with a promoti ... ","Citibank refuse to honor a promotional which said that they would give ... ","I recently signed up for a CitiGold account under the promotion that i ... ","I opened a citi bank gold checking account with a coupon code for ... ","I signed up for a Citigold checking account in   2015 during a     mil ... ","I signed up for a   checking account in     with a promotion for ... ","On     2016, I opened a Citigold checking account with the promotion c ... ","I signed up for a citigold checking account because of a promotion tha ... ","In    , I received a flyer in the mail from Citibank that offered me a ... ","This is about a promotion Citibank had in   of 2015 where one would ge ... ","In   I opened a CitiGold checking account with CitiBank. I confirmed i ... ","In   2016, I signed up for a Citigold account account with promotion ... ","I opened a Citigold account in XX/XX/  with an offer to earn   ThankYo ... ","I opened  a Wells Fargo  checking account on    . The deadline to open ... ","I opened a CitiGold account on  / /  under promotion  , which offered ... ","On     2016, I opened a Citigold checking account on receiving a promo ... ","I received an offer from Citi Bank. The offer stated that if I were to ... ","I applied for a Citigold bank account with Citi bank XX/XX/2015 with a ... ","In    , I was induced to open a Citibank CitiGold checking account wit ... ","I signed up for a promotional offer from Citibank. I was to get ... ","I opened a CitiGold checking account in   of 2016under the promotion c ... ","In   2016, I was induced to open a Citibank CitiGold checking account ... ","Hi, Couple of Months ago I subscribed to an offer I received from Citi ... ","On  / /2016 I applied for a Citigold Checking Account online and provi ... ","Applied for a Citibank Citigold account with promo code   (     bonus ... ","Signed up for a CitiGold Checking Account using targeted offer code  . ... ","I opened a CitiGold account with Citibank. I signed up with a promotio ... ","I opened a Citibank Account Bank Checking account with a {$400.00} bon ... ","I had applied and was approved for a CitiGold Checking Account on  / / ... ","I opened a Citigold Checking Account with a promotion for   AAdvantage ... ","I applied for a citi \" gold '' checking account and enrolled in an off ... ","I opened a CitiGold checking account on    , 2016 after receiving an o ... ","In    , I was induced to open a Citibank CitiGold checking account wit ... ","XX/XX/2015 I signed up for a Citigold account via a promotional offer ... ","I opened a Citigold checking account under the promotion   which provi ... ","I was induced to open a Citibank CitiGold checking account with a bonu ... ","On    , 2015 I applied for a Citigold Checking account and entered in ... "]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>Date<\/th>\n      <th>Bank<\/th>\n      <th>Topic Prob<\/th>\n      <th>Narrative<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"tip","pageLength":5,"initComplete":"function(settings, json) {\n$(this.api().table()).css({'font-size': '80%', 'background-color': '#fff', 'color': '#000'});\n}","columnDefs":[{"className":"dt-right","targets":2}],"order":[],"autoWidth":false,"orderClasses":false,"lengthMenu":[5,10,25,50,100]}},"evals":["options.initComplete"],"jsHooks":[]}</script>
---

![](./img/topics.png)

---

![](./img/bank-effect.png)

[Structural topic modeling]9http://www.structuraltopicmodel.com/)

---

![](./img/time-topics.png)

---

# Questions & Discussion: Thanks!

[github.com/wesslen](https://github.com/wesslen)

[wesslen.github.io](https://wesslen.github.io)

---

![Silge & Robinson, 2018](./img/tidytextmining.png)