DATA607FinalProjectTeamBanuSadia PART1
Banu Boopalan & Sadia Perveen
12/10/2019
PROJECT TEAM INFORMATION:
README : In this RMD, please see PART1 for the project. Another RMD will be submitted for PART2.
PART1 : Will contain ELA/MATH scores analysis and NYtimes API data analysis PART2 : Will contain Web scrape of Wikipedia page and neo4j data model and implementation.
Team Members: Banu Boopalan & Sadia Perveen. For our final project, we decided to work on combining our initial proposals into one RMD file. First proposal was with looking at the following dataset on assessment data on ELA and Math and combining them with FreeReducedPriceLunch.csv and performing analysis and visualization. The second proposal was to work with API data from NYtimes API and performing sentiment analysis, topic models using https://www.tidytextmining.com/. We have tried to write back data to neo4j and try to requery back into R to show querying on the text data stored from webscraping in R as nodes and relationships.
Our collaboration was over the phone and whatsapp and gotomeeting to show our ideas initially. We thought we could somehow look at Education related topics on the retrieved data from NYTIMES API on ELA and Math assessments for the NY schools but we were not able to figure this out.Possibly this may be considered as an enhancement to this code to connect the dataset analysis to Twitter data or other website source data to understand on sentiment related to ELA/MATH performance.
SADIA PERVEEN PROPOSAL: Project Proposal: Since I am currently working in the educational field I wanted to do a analysis on district SES status compared to their yearly test scores. My two data source would be from https://data.nysed.gov/downloads.php This database contains assessment data for grades 3-8 on ELA and Math at the state, county, district, and school level broken down by various subgroups.This is where I have data on test scores for ELA and MAT for NY schools and districts. The question I am looking to answer is if schools with higher SES status have higher ELA and MAT scores. First I would need to combine data from both of my sources. Second I would need to conduct a analysis and see if the difference is significant. Third I would need to display my results in a visualization form that is easy to understand.
BANU BOOPALAN PROPOSAL: https://rpubs.com/BanuB/551009.
ALL DATA SOURCES:
ANALYIS 1 :
https://raw.githubusercontent.com/sadia-perveen/DATA-607-Final-Project/master/Free%20Reduced%20Price%20Lunch.csv" ELA MATH.csv
ANALYSIS 2:
Topic of interest #MeToo. Reviewed most popular shared NYtimes on Twitter and Facebook. Then looked at previous timeframe of 2018 and 2017 October and November month at the height of movement to see the topics in these datasets. Even though data was there, there wasn’t a significant number of articles in Archive during 2018 and 2017 month of October and November that were related to Metoo movement. Primary topics found were related to President Trump. The API was significant amount of data retrieved even with a page count of 5-8. A max of pages can be 100 when using JSON API call. So, the analysis was performed only on the NYTIMES Des_Facet description of articles summary text that was pulled back on these fields. We are not sure if there would have been a better way to scrape direct NYTIMES articles directly (as I heard that NYTIMES articles cannot be scraped directly or a comparison news agency API would be BBC and Al Jazeera API to pull articles back on this topic). Topic model used LDA to get topics. Tried to run a cluster dendogram but had issues with this.
Conclusions. Running the LDA model once took a long time so I had to quit the session, also my R session crashed multiple times when I tried to run the RMD file. Might need to understand the LDA model better to figure out how to run it. Running bigram and unigram token analysis to discover the vertices to report on igraph was great to visualize.
First API call and dataset - all articles shared in current month https://api.nytimes.com/svc/mostpopular/v2/shared/30/twitter.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG https://api.nytimes.com/svc/mostpopular/v2/shared/30/facebook.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG
Second API call and dataset - Here I tried to run for year 2019, 2018 and 2017 looking at 10, 11, 12 the month to see frequency of #metoo on des_Facet field of returned page. Renamed these 2 datasets and saved to Rdata so I can reload it at times to save from calling the API over and over. https://api.nytimes.com/svc/archive/v1/2018/11.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG https://api.nytimes.com/svc/archive/v1/2017/12.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG
PART 2: SUBMITTED AS PART OF A SEPARATE RMD DOCUMENT and LINK DUE TO SIZE
Scrape Wikipedia using XPATH - 1 webpage to bring in headline and paragraph data into a data set and sentiment analysis on the data. “https://en.wikipedia.org/wiki/Me_Too_movement”
Store Dataset from Wikiscrape back to neo4j database using RNeo4j driver. We are trying to understand how to store text data from R by connecting to RNeo4j How to retrieve the data stored in neo4j back and report in R
ANALYIS 1 WORKFLOW SECTION
Connect to ELAMATH and SESST dataets, read in and report findings
I uploaded my data into github and now I will load the data from Github and CSV file.
SESST <- readr::read_csv("https://raw.githubusercontent.com/sadia-perveen/DATA-607-Final-Project/master/Free%20Reduced%20Price%20Lunch.csv")
ELAMATH <- readr::read_csv("C:\\Users\\syeds\\Desktop\\Sadia\\Data 607 Final Project\\ELA MATH.csv")After getting my data I need to clean my data so that I only have the information needed to complete the analysis for district SES status compared to their yearly test scores.
#install.packages("tidyverse",repos = "http://cran.us.r-project.org")
#library(tidyverse)
# first I am removing all subgroups from the ELAMATH data set.
ELAMATH <- dplyr::filter(ELAMATH, SUBGROUP_NAME == "All Students")
ELAMATH
#Removing extra rows
ELAMATH <- ELAMATH[,c('NAME', 'ITEM_SUBJECT_AREA', 'ITEM_DESC','MEAN_SCALE_SCORE')]
ELAMATH <- dplyr::arrange(ELAMATH , NAME)
# Now we are going to only keep district data.
ELAMATH <- dplyr::slice(ELAMATH, 17252:17635)
# Since we have many grades we can further break it down and only look at grade 3 ELA.
ELAMATHGRD3 <- dplyr::filter(ELAMATH, ITEM_DESC == "Grade 3 ELA")
ELAMATHGRD3 <- ELAMATHGRD3[,c('NAME', 'ITEM_DESC', 'MEAN_SCALE_SCORE')]
ELAMATHGRD3
#Now we can clean up our SES data.
#Removing extra rows
SESST <- SESST[,c('ENTITY_NAME', 'YEAR', 'PER_REDUCED_LUNCH')]
SESST <- dplyr::arrange(SESST, ENTITY_NAME)
# Now we are going to only keep district data.
SESST <- dplyr::slice(SESST, 9016:9111)
# Since the ELA/MATH scores are for 2017 year we will only keep that for SES.
SESST <- dplyr::filter(SESST, YEAR == "2017")
colnames(SESST)[1] <- "NAME"Now that we have both of our data sets cleaned we can merge them together.
DATA <- dplyr::inner_join(ELAMATHGRD3, SESST, by = "NAME")
DATA
# defining my variables as numeric to perform the analysis.
DATA$MEAN_SCALE_SCORE <- as.numeric(DATA$MEAN_SCALE_SCORE)
DATA$PER_REDUCED_LUNCH <- as.numeric(DATA$PER_REDUCED_LUNCH)Now we have all of our data in one dataset needed for the analysis.
First we can look at some general information.
names(DATA)
str(DATA)
summary(DATA)Here we are using ggplot to make a bar graph on the percent of reduced lunch per district (LOW SES status) and mean ELA scores.
ggplot(DATA, aes(x=PER_REDUCED_LUNCH)) + geom_bar()
ggplot(DATA, aes(x=MEAN_SCALE_SCORE)) + geom_bar()
Here I am using qplot (something I have not used before) to get a general trend of my data.
qplot(x = MEAN_SCALE_SCORE, y = PER_REDUCED_LUNCH, data = DATA, geom = "point")
Making the Histogram of the two variables of interest.
hist(DATA$MEAN_SCALE_SCORE)
hist(DATA$PER_REDUCED_LUNCH)
To see the relationship between our two variables we can plot both of them and get the correlation coefficient.
plot(DATA$MEAN_SCALE_SCORE, DATA$PER_REDUCED_LUNCH)
cor(DATA$MEAN_SCALE_SCORE, DATA$PER_REDUCED_LUNCH)The correlation coefficient is 0.5788396. We see a positive linear relationship therefore we can hypothesize that their may be significant relationship between the two variables such that as the Mean scale score increases the Percentage of students with reduced lunches increases as well. From this analysis we see that my assumption was incorrect. This actually shows the opposite trend.
Now we can look into the p-value to determine if the difference in significant.My NULL hypothesis is that there is no statistical significance between the two variables.
WE can see the linear line below and the statistical analysis.
m1 <- lm(PER_REDUCED_LUNCH ~ MEAN_SCALE_SCORE, data = DATA)
plot(DATA$PER_REDUCED_LUNCH ~ DATA$MEAN_SCALE_SCORE)
abline(m1)
summary(m1)-Our p value is 0.000519 which is below .05 therefore we have strong evidence against the null hypothesis. To conclude we can say that their is a statistical significance between the two variables.My Analysis was very limited as it only included a small dataset.
ANALYSIS 2 SECTION
Connect to NYTimes API MostPOPULAR
Connect to NYtimes API and collect data through NYTIMES MostPopular API, type Viewed in 1 day and Shared on Facebook and Twitter in the last 30 days
#Mostpopular article
#most viewed 1 day
myurl1 <- "https://api.nytimes.com/svc/mostpopular/v2/viewed/1.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG"
myresponse1 <- fromJSON(myurl1)
#str(myresponse1)
df1 <- myresponse1$results
myresponse1$results %>% kable() %>% kable_styling() %>% scroll_box(width = "910px", height = "400px")| url | adx_keywords | column | section | byline | type | title | abstract | published_date | source | id | asset_id | views | des_facet | org_facet | per_facet | geo_facet | media | uri |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| https://www.nytimes.com/2019/12/10/nyregion/jersey-city-shooter.html | Jersey City (NJ);Jersey City, NJ, Shooting (December 10, 2019);Attacks on Police | NA | New York | By MICHAEL GOLD, NICK CORASANITI and WILLIAM K. RASHBAUM | Article | Jersey City Shooting Updates: 6 Killed, Including an Officer | Two shooters opened fire on Tuesday afternoon at a kosher market. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 1 | c(“JERSEY CITY, NJ, SHOOTING (DECEMBER 10, 2019)”, “ATTACKS ON POLICE”) | JERSEY CITY (NJ) |
list(type = “image”, subtype = “photo”, caption = “Police officers took cover from gunfire on Tuesday afternoon as they responded to reports of an active shooter in Jersey City, N.J.”, copyright = “Bryan Anselm for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/10/nyregion/10njshooting03-promo/10njshooting03-promo-thumbStandard-v2.jpg”, “https://static01.nyt.com/images/2019/12/10/nyregion/10njshooting03-promo/10njshooting03-promo-mediumThreeByTwo210-v7.jpg”, “https://static01.nyt.com/images/2019/12/10/nyregion/10njshooting03-promo/10njshooting03-promo-mediumThreeByTwo440-v7.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/bd39e034-c937-5382-839e-20ffb63c36f9 | ||
| https://www.nytimes.com/2019/12/11/nyregion/jersey-city-shooting.html | Murders, Attempted Murders and Homicides;Jersey City (NJ);Fulop, Steven M;Jersey City, NJ, Shooting (December 10, 2019) | NA | New York | By MICHAEL GOLD and ALI WATKINS | Article | Jersey City Shooting: Suspect Linked to Black Hebrew Israelite Group | The Black Hebrew Israelites have been labeled a hate group. The suspect wrote anti-Semitic and anti-police posts, an official said. | 2019-12-11 | The New York Times | 1e+14 | 1e+14 | 2 | c(“MURDERS, ATTEMPTED MURDERS AND HOMICIDES”, “JERSEY CITY, NJ, SHOOTING (DECEMBER 10, 2019)”) | FULOP, STEVEN M | JERSEY CITY (NJ) |
list(type = “image”, subtype = “photo”, caption = “The aftermath of a gunfight at a kosher market in Jersey City, N.J.”, copyright = “Bryan Anselm for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/11/nyregion/11njshooting-livebriefing1-promo/11njshooting-livebriefing1-promo-thumbStandard-v2.jpg”, “https://static01.nyt.com/images/2019/12/11/nyregion/11njshooting-livebriefing1-promo/11njshooting-livebriefing1-promo-mediumThreeByTwo210-v3.jpg”, “https://static01.nyt.com/images/2019/12/11/nyregion/11njshooting-livebriefing1-promo/11njshooting-livebriefing1-promo-mediumThreeByTwo440-v3.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/8d0df5c6-216a-5929-9316-04323bdbbc91 | |
| https://www.nytimes.com/2019/12/10/us/politics/trump-antisemitism-executive-order.html | Colleges and Universities;Anti-Semitism;Boycott, Divestment and Sanctions (BDS);Freedom of Speech and Expression;Executive Orders and Memorandums;Trump, Donald J;United States Politics and Government | NA | U.S. | By PETER BAKER and MAGGIE HABERMAN | Article | Trump Targets Anti-Semitism and Israeli Boycotts on College Campuses | The president’s order would allow the government to withhold money from campuses deemed to be biased, but critics see it as an attack on free speech. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 3 | c(“COLLEGES AND UNIVERSITIES”, “ANTI-SEMITISM”, “UNITED STATES POLITICS AND GOVERNMENT”) | c(“BOYCOTT, DIVESTMENT AND SANCTIONS (BDS)”, “FREEDOM OF SPEECH AND EXPRESSION”, “EXECUTIVE ORDERS AND MEMORANDUMS”) | TRUMP, DONALD J |
list(type = “image”, subtype = “photo”, caption = “President Trump at the Israeli American Council National Summit last week in Hollywood, Fla.”, copyright = “T.J. Kirkpatrick for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/10/us/politics/10dc-antisemitism/10dc-antisemitism-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/10/us/politics/10dc-antisemitism/merlin_165601212_a636373d-f6e2-4b86-a094-07b2889c6872-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/10/us/politics/10dc-antisemitism/merlin_165601212_a636373d-f6e2-4b86-a094-07b2889c6872-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/29272eb1-acfe-58d3-bd6c-87685e25913a | |
| https://www.nytimes.com/interactive/2019/12/10/us/politics/articles-impeachment-document-pdf.html | Trump-Ukraine Whistle-Blower Complaint and Impeachment Inquiry;Impeachment;House Committee on the Judiciary;Trump, Donald J;Ukraine | U.S. | By THE NEW YORK TIMES | Interactive | Read the Articles of Impeachment Against President Trump | House Democrats released two articles of impeachment charging President Trump with abuse of power and obstruction of Congress. See them with context and analysis by The Times’s chief White House correspondent. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 4 | c(“TRUMP-UKRAINE WHISTLE-BLOWER COMPLAINT AND IMPEACHMENT INQUIRY”, “IMPEACHMENT”) | HOUSE COMMITTEE ON THE JUDICIARY | TRUMP, DONALD J | UKRAINE |
list(type = “image”, subtype = “photo”, caption = "“, copyright =” “, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/10/reader-center/10impeach-tear/10impeach-tear-thumbStandard-v2.png“,”https://static01.nyt.com/images/2019/12/10/reader-center/10impeach-tear/10impeach-tear-mediumThreeByTwo210-v2.png“,”https://static01.nyt.com/images/2019/12/10/reader-center/10impeach-tear/10impeach-tear-mediumThreeByTwo440-v2.png“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://interactive/d58d0e14-2731-5ef1-918a-7712f29da7ce | |
| https://www.nytimes.com/2019/12/10/opinion/trump-impeachment.html | Trump, Donald J;Impeachment;Presidential Election of 2020;United States Politics and Government;Trump-Ukraine Whistle-Blower Complaint and Impeachment Inquiry;Democratic Party;Republican Party;House of Representatives;Senate | NA | Opinion | By THOMAS L. FRIEDMAN | Article | Impeach Trump. Save America. | It is the only thing to do if our country’s democracy is to survive. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 5 | PRESIDENTIAL ELECTION OF 2020 | c(“IMPEACHMENT”, “UNITED STATES POLITICS AND GOVERNMENT”, “TRUMP-UKRAINE WHISTLE-BLOWER COMPLAINT AND IMPEACHMENT INQUIRY”, “DEMOCRATIC PARTY”, “REPUBLICAN PARTY”, “HOUSE OF REPRESENTATIVES”, “SENATE”) | TRUMP, DONALD J |
list(type = “image”, subtype = “photo”, caption = “President Trump spoke to reporters before boarding Marine One last month.”, copyright = “Pete Marovich for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/10/opinion/10friedmanWeb/10friedmanWeb-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/10/opinion/10friedmanWeb/10friedmanWeb-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/10/opinion/10friedmanWeb/10friedmanWeb-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/09e47c83-c38a-5b9d-b924-f43809fe2cc8 | |
| https://www.nytimes.com/2019/12/09/arts/television/vanna-white-wheel-of-fortune.html | Wheel of Fortune (TV Program);Television;White, Vanna;Sajak, Pat | NA | Arts | By MAYA SALAM | Article | Vanna White Takes a Spin as ‘Wheel of Fortune’ Host After 37 Years | After Pat Sajak had emergency surgery, the show’s famous letter-turner took her first turn leading the show, for three weeks of episodes that start airing on Monday. | 2019-12-09 | The New York Times | 1e+14 | 1e+14 | 6 | TELEVISION | c(“WHITE, VANNA”, “SAJAK, PAT”) |
list(type = “image”, subtype = “photo”, caption = “Vanna White had only one practice run before stepping in to host “Wheel of Fortune.”“, copyright =”Carol Kaelson“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/10/arts/09vannawhite1/09vannawhite1-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/10/arts/09vannawhite1/09vannawhite1-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/10/arts/09vannawhite1/09vannawhite1-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/65c52f62-8b0c-5079-997d-8415c36abf3d | ||
| https://www.nytimes.com/2019/12/08/nyregion/auschwitz-love-story.html | Holocaust and the Nazi Era;Concentration Camps;Jews and Judaism;Auschwitz Concentration Camp;Europe;Manhattan (NYC);World War II (1939-45);War Crimes, Genocide and Crimes Against Humanity;Wisnia, David;Tichauer, Helen (1918-2018);Dating and Relationships | NA | New York | By KEREN BLANKFELD | Article | Lovers in Auschwitz, Reunited 72 Years Later. He Had One Question. | Was she the reason he was alive today? | 2019-12-08 | The New York Times | 1e+14 | 1e+14 | 7 | c(“HOLOCAUST AND THE NAZI ERA”, “DATING AND RELATIONSHIPS”) | c(“CONCENTRATION CAMPS”, “JEWS AND JUDAISM”, “AUSCHWITZ CONCENTRATION CAMP”, “WORLD WAR II (1939-45)”, “WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”) | c(“WISNIA, DAVID”, “TICHAUER, HELEN (1918-2018)”) | c(“EUROPE”, “MANHATTAN (NYC)”) |
list(type = “image”, subtype = “photo”, caption = “David Wisnia at his home in Pennsylvania.”, copyright = “Danna Singer for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-mediumThreeByTwo210-v3.jpg”, “https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-mediumThreeByTwo440-v3.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/8edf8c46-8166-5577-992e-2f4cd9cd081c |
| https://www.nytimes.com/2019/12/10/us/politics/trump-impeachment-articles.html | Trump, Donald J;Impeachment;Democratic Party;House of Representatives;Trump-Ukraine Whistle-Blower Complaint and Impeachment Inquiry;Ethics and Official Misconduct;Constitution (US);United States Politics and Government;Senate;Republican Party | NA | U.S. | By NICHOLAS FANDOS | Article | Trump ‘Ignored and Injured’ the National Interest, Democrats Charge in Impeachment Articles | Democratic leaders unveiled articles of impeachment charging President Trump with abuse of power and obstruction of Congress. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 8 | c(“TRUMP-UKRAINE WHISTLE-BLOWER COMPLAINT AND IMPEACHMENT INQUIRY”, “UNITED STATES POLITICS AND GOVERNMENT”) | c(“IMPEACHMENT”, “DEMOCRATIC PARTY”, “HOUSE OF REPRESENTATIVES”, “ETHICS AND OFFICIAL MISCONDUCT”, “CONSTITUTION (US)”, “SENATE”, “REPUBLICAN PARTY”) | TRUMP, DONALD J |
list(type = “image”, subtype = “photo”, caption = “The House Judiciary Committee, led by Representative Jerrold Nadler, reviewed the articles of impeachment against President Trump before announcing them publicly on Tuesday morning.”, copyright = “Erin Schaff/The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/10/us/politics/10dc-impeach1-sub/10dc-impeach1-sub-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/10/us/politics/10dc-impeach1-sub/10dc-impeach1-sub-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/10/us/politics/10dc-impeach1-sub/10dc-impeach1-sub-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/e93f1766-6dee-5353-84dd-2508a06630a9 | |
| https://www.nytimes.com/2019/12/11/business/jpmorgan-banking-racism.html | JPMorgan Chase & Company;National Football League;Discrimination;Banking and Financial Institutions;Race and Ethnicity;Football | NA | Business | By EMILY FLITTER | Article | This Is What Racism Sounds Like in the Banking Industry | A JPMorgan employee and a customer secretly recorded their conversations with bank employees. | 2019-12-11 | The New York Times | 1e+14 | 1e+14 | 9 | c(“DISCRIMINATION”, “BANKING AND FINANCIAL INSTITUTIONS”, “RACE AND ETHNICITY”) | c(“JPMORGAN CHASE & COMPANY”, “NATIONAL FOOTBALL LEAGUE”, “FOOTBALL”) |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Ash Ponders for The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/11/business/11jpmorgan-02/11jpmorgan-02-thumbStandard-v2.jpg“,”https://static01.nyt.com/images/2019/12/11/business/11jpmorgan-02/11jpmorgan-02-mediumThreeByTwo210-v3.jpg“,”https://static01.nyt.com/images/2019/12/11/business/11jpmorgan-02/11jpmorgan-02-mediumThreeByTwo440-v3.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/e2490f23-530c-5abe-a40a-4ba87e60920a | ||
| https://www.nytimes.com/2019/12/10/upshot/irs-letter-health-insurance-fine-study.html | Health Insurance and Managed Care;Patient Protection and Affordable Care Act (2010);Research;Deaths (Fatalities) | NA | The Upshot | By SARAH KLIFF | Article | The I.R.S. Sent a Letter to 3.9 Million People. It Saved Some of Their Lives. | The study was an accident. The results show the positive effects of health insurance. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 10 | HEALTH INSURANCE AND MANAGED CARE | c(“PATIENT PROTECTION AND AFFORDABLE CARE ACT (2010)”, “RESEARCH”, “DEATHS (FATALITIES)”) |
list(type = “image”, subtype = “photo”, caption = “At a rally in July to support the Affordable Care Act, demonstrators displayed images of Americans who could be hurt if the law were struck down.”, copyright = “Jonathan Ernst/Reuters”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/09/upshot/09up-aca1/09up-aca1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/09/upshot/09up-aca1/09up-aca1-mediumThreeByTwo210-v2.jpg”, “https://static01.nyt.com/images/2019/12/09/upshot/09up-aca1/09up-aca1-mediumThreeByTwo440-v2.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/4c8c1f5d-5af3-5e68-bee7-86b978be9b38 | ||
| https://www.nytimes.com/2019/12/10/us/pigeons-cowboy-hats-las-vegas.html | Pigeons;Hats and Caps;Las Vegas (Nev);Animal Behavior;Animal Abuse, Rights and Welfare | NA | U.S. | By CHRISTINE HAUSER | Article | Someone Is Putting Cowboy Hats on Pigeons in Las Vegas | No one knows why. A rodeo was in town but denied any connection. The Las Vegas police said it “does not appear to be a police matter at this time.” | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 11 | c(“PIGEONS”, “HATS AND CAPS”, “ANIMAL BEHAVIOR”) | ANIMAL ABUSE, RIGHTS AND WELFARE | LAS VEGAS (NEV) |
list(type = “image”, subtype = “photo”, caption = ““They look like happy pigeons to me,” said Charles Walcott, a Cornell University ornithologist. “It is hard to know, of course, because they will not talk to us.”“, copyright =”Robert Lee, via Storyful“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/10/multimedia/10xp-pigeons-dip/10xp-pigeons-dip-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/10/multimedia/10xp-pigeons-dip/10xp-pigeons-dip-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/10/multimedia/10xp-pigeons-dip/10xp-pigeons-dip-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/38cd6fce-0c36-5317-b763-d34f7271a6c9 | |
| https://www.nytimes.com/2019/12/09/world/asia/india-muslims-citizenship-narendra-modi.html | Citizenship and Naturalization;India;Muslims and Islam;Modi, Narendra;Immigration and Emigration;Freedom of Religion;Hinduism;Discrimination;Bharatiya Janata Party;Indian National Congress;Shah, Amit (1964- );Assam State (India);Law and Legislation | NA | World | By JEFFREY GETTLEMAN and SUHASINI RAJ | Article | India Steps Toward Making Naturalization Harder for Muslims | A bill establishing a religious test for immigrants has passed the lower house of Parliament, a major step for Prime Minister Narendra Modi’s Hindu-nationalist agenda. | 2019-12-09 | The New York Times | 1e+14 | 1e+14 | 12 | c(“CITIZENSHIP AND NATURALIZATION”, “LAW AND LEGISLATION”) | c(“MUSLIMS AND ISLAM”, “IMMIGRATION AND EMIGRATION”, “FREEDOM OF RELIGION”, “HINDUISM”, “DISCRIMINATION”, “BHARATIYA JANATA PARTY”, “INDIAN NATIONAL CONGRESS”) | c(“MODI, NARENDRA”, “SHAH, AMIT (1964- )”) | c(“INDIA”, “ASSAM STATE (INDIA)”) |
list(type = “image”, subtype = “photo”, caption = “Muslims praying at a mosque in Tonk, India. Muslim Indians see a new citizenship bill as a step by the government to make them second-class citizens.”, copyright = “Smita Sharma for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/09/world/09india-citizenship-1sub/09india-citizenship-1sub-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/09/world/09india-citizenship-1sub/09india-citizenship-1sub-mediumThreeByTwo210-v2.jpg”, “https://static01.nyt.com/images/2019/12/09/world/09india-citizenship-1sub/09india-citizenship-1sub-mediumThreeByTwo440-v2.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/269fc9ee-9069-5faf-bb75-55e4b0551c85 |
| https://www.nytimes.com/2019/12/10/us/politics/pete-buttigieg-mckinsey-clients.html | Buttigieg, Pete (1982- );McKinsey & Co;Presidential Election of 2020;Democratic Party | NA | U.S. | By REID J. EPSTEIN and STEPHANIE SAUL | Article | How Pete Buttigieg Spent His McKinsey Days: Blue Cross, Best Buy, U.S. Agencies | The list is the latest in a series of disclosures his campaign has made after it was criticized for lacking transparency. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 13 | PRESIDENTIAL ELECTION OF 2020 | c(“MCKINSEY & CO”, “DEMOCRATIC PARTY”) | BUTTIGIEG, PETE (1982- ) |
list(type = “image”, subtype = “photo”, caption = “Mayor Pete Buttigieg worked for McKinsey for nearly three years after college.”, copyright = “David Degner for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/10/us/politics/00buttigieg-clients/00buttigieg-clients-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/10/us/politics/00buttigieg-clients/00buttigieg-clients-mediumThreeByTwo210-v2.jpg”, “https://static01.nyt.com/images/2019/12/10/us/politics/00buttigieg-clients/00buttigieg-clients-mediumThreeByTwo440-v2.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/e56e9fe5-4ddd-59bf-97cd-b9e8d4d06547 | |
| https://www.nytimes.com/2019/12/11/us/harvey-weinstein-settlement.html | Weinstein, Harvey;Suits and Litigation (Civil);Sex Crimes;Sexual Harassment;Weinstein Co | NA | U.S. | By MEGAN TWOHEY and JODI KANTOR | Article | Weinstein and His Accusers Reach Tentative $25 Million Deal | A proposed settlement would end nearly every lawsuit filed by the Hollywood producer’s alleged victims, without his having to admit wrongdoing or pay anything to the women. | 2019-12-11 | The New York Times | 1e+14 | 1e+14 | 14 | SEXUAL HARASSMENT | c(“SUITS AND LITIGATION (CIVIL)”, “SEX CRIMES”, “WEINSTEIN CO”) | WEINSTEIN, HARVEY |
list(type = “image”, subtype = “photo”, caption = “Harvey Weinstein arriving at court in Manhattan last year.”, copyright = “Jeenah Moon for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/02/multimedia/00settle/00settle-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/02/multimedia/00settle/00settle-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/02/multimedia/00settle/00settle-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/1424d5f5-3d32-50e4-8636-78c10384070d | |
| https://www.nytimes.com/2019/12/10/nyregion/rudy-giuliani-divorce-settlement.html | Giuliani, Rudolph W;Divorce, Separations and Annulments;New York City;Nathan, Judith | NA | New York | By SARAH MASLIN NIR | Article | Giulianis Settle Ugly Divorce Case, Avoiding a Public Trial | Pretrial proceedings revealed the couple’s $230,000 monthly spending, which enabled $12,000 splurges for cigars and $7,000 for fountain pens. | 2019-12-10 | The New York Times | 1e+14 | 1e+14 | 15 | DIVORCE, SEPARATIONS AND ANNULMENTS | c(“GIULIANI, RUDOLPH W”, “NATHAN, JUDITH”) | NEW YORK CITY |
list(type = “image”, subtype = “photo”, caption = “Rudolph Giuliani, the former mayor of New York, and Judith Giuliani, at Yankee Stadium in 2009.”, copyright = “Jim McIsaac/Getty Images”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/10/nyregion/10giuliani01/10giuliani01-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/10/nyregion/10giuliani01/merlin_27786162_f315d865-2956-485e-95c8-4894eeb1e36d-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/10/nyregion/10giuliani01/merlin_27786162_f315d865-2956-485e-95c8-4894eeb1e36d-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/4559ea98-3fd0-5723-bdb6-8de3c28ab9cf | |
| https://www.nytimes.com/2019/12/09/theater/beetlejuice-broadway-evicted.html | Theater;Beetlejuice (Play);Winter Garden Theater (Manhattan, NY);Warner Brothers;Shubert Organization;The Music Man (Play);Rudin, Scott | NA | Theater | By MICHAEL PAULSON | Article | Despite Turnaround, ‘Beetlejuice’ Being Forced Out of Theater | The $21 million musical will be hoping for a new home after the Shubert Organization made way for Hugh Jackman and ‘The Music Man.’ | 2019-12-09 | The New York Times | 1e+14 | 1e+14 | 16 | THEATER | c(“WINTER GARDEN THEATER (MANHATTAN, NY)”, “WARNER BROTHERS”, “SHUBERT ORGANIZATION”) | RUDIN, SCOTT |
list(type = “image”, subtype = “photo”, caption = “Alex Brightman and Sophia Anne Caruso in the musical “Beetlejuice.”“, copyright =”Sara Krulwich/The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/09/arts/09beetle2/09beetle2-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/09/arts/09beetle2/09beetle2-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/09/arts/09beetle2/09beetle2-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/756b606e-9ad9-57c2-9763-d8963e818590 | |
| https://www.nytimes.com/2019/12/07/us/dna-bone-marrow-transplant-crime-lab.html | Forensic Science;Genetics and Heredity;Bone Marrow;DNA (Deoxyribonucleic Acid);Transplants;Crime and Criminals | NA | U.S. | By HEATHER MURPHY | Article | When a DNA Test Says You’re a Younger Man, Who Lives 5,000 Miles Away | After a bone marrow transplant, a man with leukemia found that his donor’s DNA traveled to unexpected parts of his body. A crime lab is now studying the case. | 2019-12-07 | The New York Times | 1e+14 | 1e+14 | 17 | c(“FORENSIC SCIENCE”, “GENETICS AND HEREDITY”, “BONE MARROW”, “DNA (DEOXYRIBONUCLEIC ACID)”, “CRIME AND CRIMINALS”) | TRANSPLANTS |
list(type = “image”, subtype = “photo”, caption = “Chris Long agreed to serve as a guinea pig for his colleagues’ experiment to help them understand how a bone marrow transplant could confuse a criminal investigation. ”, copyright = “Tiffany Brown Anderson for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/15/multimedia/00xp-chimera/00xp-chimera-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/15/multimedia/00xp-chimera/00xp-chimera-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/15/multimedia/00xp-chimera/00xp-chimera-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/606d186a-4ddf-5882-a595-c5888d76600c | ||
| https://www.nytimes.com/2019/12/09/arts/music/juice-wrld-guns-drugs.html | Rap and Hip-Hop;Juice WRLD (Rapper);Drug Abuse and Traffic | NA | Arts | By JOE COSCARELLI | Article | Before Death, Juice WRLD Flew on Jet Loaded With Drugs, Police Say | The up-and-coming artist, whose cause of death remains unknown, went into convulsions while officers in Chicago searched the private plane he arrived in. | 2019-12-09 | The New York Times | 1e+14 | 1e+14 | 18 | c(“RAP AND HIP-HOP”, “DRUG ABUSE AND TRAFFIC”) | JUICE WRLD (RAPPER) |
list(type = “image”, subtype = “photo”, caption = “The Cook County Medical Examiner’s Office said on Monday that it could not determine Juice WRLD’s cause of death until it conducted additional tests.”, copyright = “Amy Harris/Invision, via Associated Press”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/09/arts/09juice-update/09juice-update-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/09/arts/09juice-update/merlin_153787587_7fc7067c-22da-4cf1-8da9-3199f5a542d2-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/09/arts/09juice-update/merlin_153787587_7fc7067c-22da-4cf1-8da9-3199f5a542d2-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/71eedfdc-4919-5943-842f-03714053648c | ||
| https://www.nytimes.com/2019/12/09/opinion/recycling-myths.html | Recycling of Waste Materials;Waste Materials and Disposal;Environmental Protection Agency;Plastics | NA | Opinion | By TALA SCHLOSSBERG and NAYEEMA RAZA | Article | The Great Recycling Con | The greatest trick corporations ever played was making us think we could recycle their products. | 2019-12-09 | The New York Times | 1e+14 | 1e+14 | 19 | c(“RECYCLING OF WASTE MATERIALS”, “WASTE MATERIALS AND DISPOSAL”, “PLASTICS”) | ENVIRONMENTAL PROTECTION AGENCY |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/22/autossell/still1/still1-thumbStandard.png“,”https://static01.nyt.com/images/2019/11/22/autossell/still1/still1-mediumThreeByTwo210.png“,”https://static01.nyt.com/images/2019/11/22/autossell/still1/still1-mediumThreeByTwo440.png“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440" ), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/ec8df239-a54a-5998-9ce4-56aab11c2d6f | ||
| https://www.nytimes.com/2019/12/09/movies/golden-globes-nominees-list.html | Television;Movies;Golden Globes (Awards) | NA | Movies | By LAUREN MESSMAN | Article | Golden Globes 2020: Here Is the Full List of Nominations | A complete list of the nominees for the 2020 Golden Globe Awards. | 2019-12-09 | The New York Times | 1e+14 | 1e+14 | 20 | c(“TELEVISION”, “MOVIES”, “GOLDEN GLOBES (AWARDS)”) |
list(type = “image”, subtype = “photo”, caption = “Joe Pesci, left, and Robert De Niro in “The Irishman.”“, copyright =”Niko Tavernise/Netflix“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/09/arts/09GLOBES-LIST-irishman/09GLOBES-LIST-irishman-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/09/arts/09GLOBES-LIST-irishman/09GLOBES-LIST-irishman-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/09/arts/09GLOBES-LIST-irishman/09GLOBES-LIST-irishman-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/a14c8174-9757-5500-a78a-8c719bf2aab8 |
#most shared twitter 30 day
myurl3 <- "https://api.nytimes.com/svc/mostpopular/v2/shared/30/twitter.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG"
myresponse3 <- fromJSON(myurl3)
#str(myresponse3)
df3 <- myresponse3$results
myresponse3$results %>% kable() %>% kable_styling() %>% scroll_box(width = "910px", height = "400px")| url | adx_keywords | subsection | share_count | count_type | column | eta_id | section | id | asset_id | nytdsection | byline | type | title | abstract | published_date | source | updated | des_facet | org_facet | per_facet | geo_facet | media | uri |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| https://www.nytimes.com/2019/12/08/nyregion/auschwitz-love-story.html | Holocaust and the Nazi Era;Concentration Camps;Jews and Judaism;Auschwitz Concentration Camp;Europe;Manhattan (NYC);World War II (1939-45);War Crimes, Genocide and Crimes Against Humanity;Wisnia, David;Tichauer, Helen (1918-2018);Dating and Relationships | 1 | SHARED-TWITTER | NA | 0 | New York | 1e+14 | 1e+14 | new york | By KEREN BLANKFELD | Article | Lovers in Auschwitz, Reunited 72 Years Later. He Had One Question. | Was she the reason he was alive today? | 2019-12-08 | The New York Times | 2019-12-11 19:58:55 | c(“HOLOCAUST AND THE NAZI ERA”, “DATING AND RELATIONSHIPS”) | c(“CONCENTRATION CAMPS”, “JEWS AND JUDAISM”, “AUSCHWITZ CONCENTRATION CAMP”, “WORLD WAR II (1939-45)”, “WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”) | c(“WISNIA, DAVID”, “TICHAUER, HELEN (1918-2018)”) | c(“EUROPE”, “MANHATTAN (NYC)”) |
list(type = “image”, subtype = “photo”, caption = “David Wisnia at his home in Pennsylvania.”, copyright = “Danna Singer for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-mediumThreeByTwo210-v3.jpg”, “https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-mediumThreeByTwo440-v3.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/8edf8c46-8166-5577-992e-2f4cd9cd081c | |
| https://www.nytimes.com/2019/12/07/opinion/sunday/katie-hill-resignation.html | United States Politics and Government;Elections, House of Representatives;Women and Girls;House of Representatives;Democratic Party;United States;California;Hill, Katie (1987- ) | sunday review | 2 | SHARED-TWITTER | NA | 0 | Opinion | 1e+14 | 1e+14 | opinion | By KATIE HILL | Article | Katie Hill: It’s Not Over After All | I overcame the desperation I felt after stepping down from Congress, and I’m still in the fight. | 2019-12-07 | The New York Times | 2019-12-09 17:05:38 | c(“UNITED STATES POLITICS AND GOVERNMENT”, “ELECTIONS, HOUSE OF REPRESENTATIVES”, “WOMEN AND GIRLS”) | c(“HOUSE OF REPRESENTATIVES”, “DEMOCRATIC PARTY”) | HILL, KATIE (1987- ) | c(“UNITED STATES”, “CALIFORNIA”) |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Damon Winter/The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/08/opinion/08Hill/08Hill-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/08/opinion/08Hill/merlin_165012912_141192c4-7734-4f90-b842-017f5a9deab4-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/08/opinion/08Hill/merlin_165012912_141192c4-7734-4f90-b842-017f5a9deab4-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/1d5686e2-3ef5-537b-a505-8ad67b29a042 |
| https://www.nytimes.com/2019/11/13/movies/tom-hanks-mister-rogers.html | Hanks, Tom;Actors and Actresses;Movies;A Beautiful Day in the Neighborhood (Movie) | 3 | SHARED-TWITTER | NA | 0 | Movies | 1e+14 | 1e+14 | movies | By TAFFY BRODESSER-AKNER | Article | This Tom Hanks Story Will Help You Feel Less Bad | Hanks is playing Mister Rogers in a new movie and is just as nice as you think he is. Please read this article anyway. | 2019-11-13 | The New York Times | 2019-12-04 14:51:05 | MOVIES | ACTORS AND ACTRESSES | HANKS, TOM |
list(type = “image”, subtype = “photo”, caption = ““I recognized in myself a long time ago that I don’t instill fear in anybody,” Hanks said. “Now, that’s different than being nice, you know? I think I have a cache of mystery. But it’s not one of malevolence.”“, copyright =”Daniel Dorsa for The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/17/arts/17tom-hanks2-promo/17tom-hanks2-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/11/17/arts/17tom-hanks2-promo/17tom-hanks2-promo-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/11/17/arts/17tom-hanks2-promo/17tom-hanks2-promo-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/8837752f-6207-55e9-8cc3-b811091e3a86 | ||
| https://www.nytimes.com/2019/11/30/business/david-boies-pottinger-jeffrey-epstein-videos.html | Epstein, Jeffrey E (1953- );Kessler, Patrick;Boies, David;Pottinger, John Stanley;Sex Crimes;Child Abuse and Neglect;Prostitution;Human Trafficking;Video Recordings, Downloads and Streaming;#MeToo Movement;Legal Profession;High Net Worth Individuals;Extortion and Blackmail;Whistle-Blowers;Frauds and Swindling | 4 | SHARED-TWITTER | NA | 0 | Business | 1e+14 | 1e+14 | business | By JESSICA SILVER-GREENBERG, EMILY STEEL, JACOB BERNSTEIN and DAVID ENRICH | Article | Jeffrey Epstein, Blackmail and a Lucrative ‘Hot List’ | A shadowy hacker claimed to have the financier’s sex tapes. Two top lawyers wondered: What would the men in those videos pay to keep them secret? | 2019-11-30 | The New York Times | 2019-12-09 18:42:14 | c(“VIDEO RECORDINGS, DOWNLOADS AND STREAMING”, “LEGAL PROFESSION”) | c(“SEX CRIMES”, “CHILD ABUSE AND NEGLECT”, “PROSTITUTION”, “HUMAN TRAFFICKING”, “#METOO MOVEMENT”, “HIGH NET WORTH INDIVIDUALS”, “EXTORTION AND BLACKMAIL”, “WHISTLE-BLOWERS”, “FRAUDS AND SWINDLING”) | c(“EPSTEIN, JEFFREY E (1953- )”, “KESSLER, PATRICK”, “BOIES, DAVID”, “POTTINGER, JOHN STANLEY”) |
list(type = “image”, subtype = “photo”, caption = NA, copyright = “Stephanie Diani for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/01/autossell/30hotlist-promo/_Horizontal-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/01/autossell/30hotlist-promo/_Horizontal-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/01/autossell/30hotlist-promo/_Horizontal-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/488da5b2-6476-5809-9718-6691d6cc5b65 | ||
| https://www.nytimes.com/2019/11/29/us/politics/kamala-harris-2020.html | Harris, Kamala D;Presidential Election of 2020;Democratic Party;Iowa;Primaries and Caucuses;United States Politics and Government | politics | 5 | SHARED-TWITTER | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By JONATHAN MARTIN, ASTEAD W. HERNDON and ALEXANDER BURNS | Article | How Kamala Harris’s Campaign Unraveled | Ms. Harris is the only 2020 Democrat who has fallen hard out of the top tier of candidates. She has proved to be an uneven campaigner who changes her message and tactics to little effect and has a staff torn into factions. | 2019-11-29 | The New York Times | 2019-12-06 16:50:46 | PRESIDENTIAL ELECTION OF 2020 | c(“DEMOCRATIC PARTY”, “PRIMARIES AND CAUCUSES”, “UNITED STATES POLITICS AND GOVERNMENT”) | HARRIS, KAMALA D | IOWA |
list(type = “image”, subtype = “photo”, caption = “Senator Kamala Harris’s abundant political skills convinced many Democrats that she had the potential to take on President Trump.”, copyright = “Daniel Acker for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/30/us/politics/30harris-jump1-alt/29harris1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/30/us/politics/30harris-jump1-alt/merlin_162352476_24d90952-c16b-4099-8860-d097259f3c74-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/30/us/politics/30harris-jump1-alt/merlin_162352476_24d90952-c16b-4099-8860-d097259f3c74-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/70bf6582-a21c-5d54-8207-6db42dccfb30 |
| https://www.nytimes.com/2019/12/05/magazine/alex-jones-infowars.html | Infowars;Jones, Alex (1974- );Fringe Groups and Movements;United States Politics and Government;Radio;Islamberg (NY);Muslim Americans | 6 | SHARED-TWITTER | Feature | 0 | Magazine | 1e+14 | 1e+14 | magazine | By JOSH OWENS | Article | I Worked for Alex Jones. I Regret It. | I dropped out of film school to edit video for the conspiracy theorist because I believed in his worldview. Then I saw what it did to people. | 2019-12-05 | The New York Times | 2019-12-11 19:58:55 | c(“UNITED STATES POLITICS AND GOVERNMENT”, “MUSLIM AMERICANS”) | c(“INFOWARS”, “FRINGE GROUPS AND MOVEMENTS”, “RADIO”) | JONES, ALEX (1974- ) | ISLAMBERG (NY) |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Illustration by Eric Yahnker“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/08/magazine/08Mag-Jones-1/08Mag-Jones-1-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/08/magazine/08Mag-Jones-1/08Mag-Jones-1-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/08/magazine/08Mag-Jones-1/08Mag-Jones-1-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/bd5f4671-3587-5025-96f8-802a2a4b4463 | |
| https://www.nytimes.com/2019/11/19/magazine/mr-rogers.html | Rogers, Fred;Children and Childhood;Puppets;Culture (Arts);Opera;Mister Rogers’ Neighborhood (TV Program);Won’t You Be My Neighbor? (Movie);Television;Movies | 7 | SHARED-TWITTER | NA | 0 | Magazine | 1e+14 | 1e+14 | magazine | By JEANNE MARIE LASKAS | Article | The Mister Rogers No One Saw | Fred Rogers wasn’t just a brilliant educator and a profoundly moral person. He was an uncompromising artist. | 2019-11-19 | The New York Times | 2019-12-04 14:51:11 | c(“CHILDREN AND CHILDHOOD”, “MOVIES”) | c(“PUPPETS”, “CULTURE (ARTS)”, “OPERA”, “TELEVISION”) | ROGERS, FRED |
list(type = “image”, subtype = “photo”, caption = “Fred Rogers, 1985.”, copyright = “Jim Judkis”, approved_for_syndication = 0, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/24/magazine/24mag-rogers-image/24mag-rogers-image-thumbStandard-v4.jpg”, “https://static01.nyt.com/images/2019/11/24/magazine/24mag-rogers-image/24mag-rogers-image-mediumThreeByTwo210-v5.jpg”, “https://static01.nyt.com/images/2019/11/24/magazine/24mag-rogers-image/24mag-rogers-image-mediumThreeByTwo440-v5.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/fc20945c-97a4-54f0-a49a-31f604f4bdc8 | ||
| https://www.nytimes.com/2019/11/22/world/asia/the-jungle-prince-of-delhi.html | India;Royal Families;News and News Media;Delhi (India);Cyrus, Prince of Oudh;Pakistan;Oudh Family (Delhi, India) | asia pacific | 8 | SHARED-TWITTER | NA | 0 | World | 1e+14 | 1e+14 | world | Article | The Jungle Prince of Delhi | For 40 years, journalists chronicled the eccentric royal family of Oudh, deposed aristocrats who lived in a ruined palace in the Indian capital. It was a tragic, astonishing story. But was it true? | 2019-11-22 | The New York Times | 2019-12-09 18:42:14 | NEWS AND NEWS MEDIA | ROYAL FAMILIES | CYRUS, PRINCE OF OUDH | c(“INDIA”, “DELHI (INDIA)”, “PAKISTAN”) |
list(type = “image”, subtype = “photo”, caption = “Prince Cyrus, Princess Sakina and a servant in 1998 on the roof of the Malcha Mahal. They called their mother “Your Highness,” and when she died, they embalmed her body themselves.“, copyright =”Barry Bearak/The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/30/world/xxcyrus4/xxcyrus4-thumbStandard-v3.jpg“,”https://static01.nyt.com/images/2019/11/30/world/xxcyrus4/xxcyrus4-mediumThreeByTwo210-v2.jpg“,”https://static01.nyt.com/images/2019/11/30/world/xxcyrus4/xxcyrus4-mediumThreeByTwo440-v2.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/03990cb5-2e65-5696-a899-fe83901731ac | |
| https://www.nytimes.com/2019/11/23/us/politics/navy-discipline-edward-gallagher.html | Gallagher, Edward (1979- );Trump, Donald J;Spencer, Richard V;Green, Collin P;United States Navy;Navy Seals;War Crimes, Genocide and Crimes Against Humanity;United States Defense and Military Forces;Amnesties, Commutations and Pardons | politics | 9 | SHARED-TWITTER | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By MAGGIE HABERMAN, HELENE COOPER and DAVE PHILIPPS | Article | Navy Is Said to Proceed With Disciplinary Plans Against Edward Gallagher | Top military officials threatened to resign or be fired if their plans to remove Chief Gallagher from the SEALs were halted by President Trump, administration officials said. | 2019-11-23 | The New York Times | 2019-11-25 18:15:57 | c(“UNITED STATES DEFENSE AND MILITARY FORCES”, “AMNESTIES, COMMUTATIONS AND PARDONS”) | c(“UNITED STATES NAVY”, “NAVY SEALS”, “WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”) | c(“GALLAGHER, EDWARD (1979- )”, “TRUMP, DONALD J”, “SPENCER, RICHARD V”, “GREEN, COLLIN P”) |
list(type = “image”, subtype = “photo”, caption = “Navy Secretary Richard V. Spencer, right, and President Trump in July.”, copyright = “Doug Mills/The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/24/us/24SEAL-SUB/23dcseal-image2-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/24/us/24SEAL-SUB/24SEAL-SUB-mediumThreeByTwo210-v2.jpg”, “https://static01.nyt.com/images/2019/11/24/us/24SEAL-SUB/24SEAL-SUB-mediumThreeByTwo440-v2.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/c8211f50-0d0e-52e4-924b-8b9ab196bd95 | |
| https://www.nytimes.com/2019/11/22/opinion/colin-kaepernick-nfl.html | United States National Anthem Protests (2016- );Kaepernick, Colin;Football;National Football League;Social Media;Police Brutality, Misconduct and Shootings;Blacks;Demonstrations, Protests and Riots;Discrimination | 10 | SHARED-TWITTER | NA | 0 | Opinion | 1e+14 | 1e+14 | opinion | By TA-NEHISI COATES | Article | Ta-Nehisi Coates: The Cancellation of Colin Kaepernick | “Cancel culture” has always existed — for the powerful, at least. Now, social media has democratized it. | 2019-11-22 | The New York Times | 2019-11-25 11:30:00 | c(“UNITED STATES NATIONAL ANTHEM PROTESTS (2016- )”, “FOOTBALL”, “SOCIAL MEDIA”) | c(“NATIONAL FOOTBALL LEAGUE”, “POLICE BRUTALITY, MISCONDUCT AND SHOOTINGS”, “BLACKS”, “DEMONSTRATIONS, PROTESTS AND RIOTS”, “DISCRIMINATION”) | KAEPERNICK, COLIN |
list(type = “image”, subtype = “photo”, caption = “The former N.F.L. quarterback Colin Kaepernick at a workout for talent scouts and the media in Riverdale, Ga., on Nov. 16.”, copyright = “Elijah Nouvelage/Reuters”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/22/opinion/22Coates/22Coates-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/22/opinion/22Coates/merlin_164524689_1698f0b3-480f-4864-b5bf-aa8955d81245-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/22/opinion/22Coates/merlin_164524689_1698f0b3-480f-4864-b5bf-aa8955d81245-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/98c68028-618f-550c-9128-938b2044963e | ||
| https://www.nytimes.com/2019/11/28/opinion/trump-kevin-dowd.html | Thanksgiving Day;Trump, Donald J;Presidential Election of 2020 | 11 | SHARED-TWITTER | NA | 0 | Opinion | 1e+14 | 1e+14 | opinion | By MAUREEN DOWD | Article | Kevin Talks Turkey | My brother dishes on Trump, impeachment and the 2020 field. | 2019-11-28 | The New York Times | 2019-12-01 21:51:54 | c(“THANKSGIVING DAY”, “PRESIDENTIAL ELECTION OF 2020”) | TRUMP, DONALD J |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Gabriella Demczuk for The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/01/opinion/01Dowd--03/01Dowd--03-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/01/opinion/01Dowd--03/01Dowd--03-mediumThreeByTwo210-v2.jpg“,”https://static01.nyt.com/images/2019/12/01/opinion/01Dowd--03/01Dowd--03-mediumThreeByTwo440-v2.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/abe360d5-8eb6-5d2a-8614-700b0d195a69 | |||
| https://www.nytimes.com/2019/11/27/magazine/63-up-michael-apted.html | Children and Childhood;Television;Documentary Films and Programs;Great Britain;63 Up (Movie);Apted, Michael | 12 | SHARED-TWITTER | NA | 0 | Magazine | 1e+14 | 1e+14 | magazine | By GIDEON LEWIS-KRAUS | Article | Does Who You Are at 7 Determine Who You Are at 63? | In 1964, with “Seven Up!” Michael Apted stumbled into making what has become the most profound documentary series in the history of cinema. Fifty-five years later, the project is reaching its conclusion. | 2019-11-27 | The New York Times | 2019-12-09 18:42:33 | CHILDREN AND CHILDHOOD | c(“TELEVISION”, “DOCUMENTARY FILMS AND PROGRAMS”) | APTED, MICHAEL | GREAT BRITAIN |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/01/magazine/01MAG-APTEDPROMOSTILL/01MAG-APTEDPROMOSTILL-thumbStandard-v2.png“,”https://static01.nyt.com/images/2019/12/01/magazine/01MAG-APTEDPROMOSTILL/01MAG-APTEDPROMOSTILL-mediumThreeByTwo210-v2.png“,”https://static01.nyt.com/images/2019/12/01/magazine/01MAG-APTEDPROMOSTILL/01MAG-APTEDPROMOSTILL-mediumThreeByTwo440-v2.png" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/fd549a1d-cba8-5269-bf74-6faa71ebbfa8 | |
| https://www.nytimes.com/2019/11/15/us/politics/barack-obama-2020-dems.html | Presidential Election of 2020;Endorsements;Democratic Party;Obama, Barack;Patrick, Deval L;Warren, Elizabeth;Biden, Joseph R Jr;Bloomberg, Michael R;Abrams, Stacey Y;Buttigieg, Pete (1982- ) | politics | 13 | SHARED-TWITTER | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By LISA LERER | Article | Obama Says Average American Doesn’t Want to ‘Tear Down System’ | Former President Barack Obama, in an address to liberal donors, warned candidates not to go too far left and sought to calm those who were concerned about the state of the Democratic primary. | 2019-11-15 | The New York Times | 2019-11-22 17:19:26 | c(“PRESIDENTIAL ELECTION OF 2020”, “ENDORSEMENTS”) | DEMOCRATIC PARTY | c(“OBAMA, BARACK”, “PATRICK, DEVAL L”, “WARREN, ELIZABETH”, “BIDEN, JOSEPH R JR”, “BLOOMBERG, MICHAEL R”, “ABRAMS, STACEY Y”, “BUTTIGIEG, PETE (1982- )”) |
list(type = “image”, subtype = “photo”, caption = “Former President Barack Obama has mostly remained out of the public fray since leaving office.”, copyright = “Ashlee Rezin Garcia/Chicago Sun-Times, via Associated Press”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/15/us/politics/15obama-abrams/15obama-abrams-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/15/us/politics/15obama-abrams/15obama-abrams-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/15/us/politics/15obama-abrams/15obama-abrams-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/dc2dca92-7003-55a8-bb47-49c7b00625f4 | |
| https://www.nytimes.com/2019/11/24/us/politics/sarah-sanders-arkansas-governor.html | United States Politics and Government;Huckabee, Mike;Sanders, Sarah Huckabee;Trump, Donald J;Arkansas;Republican Party;Elections, Governors | politics | 14 | SHARED-TWITTER | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By ANNIE KARNI | Article | Her Battles With the Press Corps Behind Her, Sanders Plans a Political Future | President Trump’s former press secretary has returned to Arkansas a bona fide star eager to play a new role in a post-Trump Republican Party. | 2019-11-24 | The New York Times | 2019-11-26 00:04:37 | UNITED STATES POLITICS AND GOVERNMENT | c(“REPUBLICAN PARTY”, “ELECTIONS, GOVERNORS”) | c(“HUCKABEE, MIKE”, “SANDERS, SARAH HUCKABEE”, “TRUMP, DONALD J”) | ARKANSAS |
list(type = “image”, subtype = “photo”, caption = “Sarah Huckabee Sanders is considering running for governor of Arkansas.”, copyright = “Al Drago for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/25/us/politics/21DC-Sanders/21DC-Sanders-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/25/us/politics/21DC-Sanders/merlin_152969619_061703bb-53d2-429d-bd27-63ba860358ea-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/25/us/politics/21DC-Sanders/merlin_152969619_061703bb-53d2-429d-bd27-63ba860358ea-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/f3ce5ef3-1509-5f74-828f-2b501b92756a |
| https://www.nytimes.com/2019/11/18/technology/personaltech/usb-warning-juice-jacking.html | Smartphones;Cyberattacks and Hackers;Wire and Cable;Batteries;Computer Security;Juice Jacking | personal tech | 15 | SHARED-TWITTER | NA | 0 | Technology | 1e+14 | 1e+14 | technology | By AIMEE ORTIZ | Article | Stop! Don’t Charge Your Phone This Way | You might want to think twice before plugging in at an airport or on the train. | 2019-11-18 | The New York Times | 2019-11-20 19:44:44 | c(“SMARTPHONES”, “WIRE AND CABLE”, “BATTERIES”) | c(“CYBERATTACKS AND HACKERS”, “COMPUTER SECURITY”) |
list(type = “image”, subtype = “photo”, caption = ““Juice jacking” exploits the fact that somebody doesn’t have a full battery, one cybersecurity expert said.“, copyright =”Shutterstock“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/17/multimedia/17xp-USB/17xp-USB-thumbStandard-v2.jpg“,”https://static01.nyt.com/images/2019/11/17/multimedia/17xp-USB/17xp-USB-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/11/17/multimedia/17xp-USB/17xp-USB-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/2e2330ba-1fe6-5c36-acb5-9f321c375e25 | ||
| https://www.nytimes.com/2019/11/19/us/navy-seals-edward-gallagher-trident.html | United States Defense and Military Forces;War Crimes, Genocide and Crimes Against Humanity;Murders, Attempted Murders and Homicides;Awards, Decorations and Honors;Navy Seals;United States Navy;Gallagher, Edward (1979- );Portier, Jacob;Breisch, Robert;Civilian Casualties;Green, Collin P;Trump, Donald J;MacNeil, Thomas (Navy SEAL) | 16 | SHARED-TWITTER | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By DAVE PHILIPPS | Article | Navy Wants to Eject From SEALs a Sailor Cleared by Trump, Officials Say | Chief Petty Officer Edward Gallagher is expected to be formally notified of the action on Wednesday. | 2019-11-19 | The New York Times | 2019-11-22 15:46:39 | c(“UNITED STATES DEFENSE AND MILITARY FORCES”, “MURDERS, ATTEMPTED MURDERS AND HOMICIDES”, “CIVILIAN CASUALTIES”) | c(“WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”, “AWARDS, DECORATIONS AND HONORS”, “NAVY SEALS”, “UNITED STATES NAVY”) | c(“GALLAGHER, EDWARD (1979- )”, “PORTIER, JACOB”, “BREISCH, ROBERT”, “GREEN, COLLIN P”, “TRUMP, DONALD J”, “MACNEIL, THOMAS (NAVY SEAL)”) |
list(type = “image”, subtype = “photo”, caption = “Chief Petty Officer Edward Gallagher, center, left a military court in San Diego in July with his wife, Andrea Gallagher.”, copyright = “Gregory Bull/Associated Press”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/01/us/00SEAL/00SEAL-thumbStandard-v2.jpg”, “https://static01.nyt.com/images/2019/11/01/us/00SEAL/merlin_157383096_eaaa6a64-12df-4223-9b3a-c9577dc6d4a8-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/01/us/00SEAL/merlin_157383096_eaaa6a64-12df-4223-9b3a-c9577dc6d4a8-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/e5e9955b-191e-5a7e-8d38-b5d9ce61206b | ||
| https://www.nytimes.com/2019/11/12/well/for-the-teen-who-no-longer-wants-a-period.html | Menstruation;Premenstrual Syndrome (PMS);Birth Control and Family Planning;Women and Girls | 17 | SHARED-TWITTER | you asked | 0 | Well | 1e+14 | 1e+14 | well | By JEN GUNTER | Article | For the Teen Who No Longer Wants a Period … | A reader asks how best to advise her child who wants to stop getting a monthly period. | 2019-11-12 | The New York Times | 2019-11-25 17:29:47 | c(“MENSTRUATION”, “PREMENSTRUAL SYNDROME (PMS)”, “BIRTH CONTROL AND FAMILY PLANNING”) | WOMEN AND GIRLS |
list(type = “image”, subtype = “photo”, caption = “Managing a monthly period can be bothersome, especially in adolescence when an unpredictable menstrual cycle is commonplace.”, copyright = “Isabel Pavia/Getty Images”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/07/multimedia/07ask-teens/07ask-teens-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/07/multimedia/07ask-teens/07ask-teens-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/12/07/multimedia/07ask-teens/07ask-teens-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/09561691-7f6f-5d46-8539-7cb35254f582 | |||
| https://www.nytimes.com/2019/12/07/style/its-karentown.html | Generation X;Names, Personal;Education (K-12);Women and Girls;Colleges and Universities;your-feed-selfcare;Karen | 18 | SHARED-TWITTER | Rites of Passage | 0 | Style | 1e+14 | 1e+14 | style | By SARAH MILLER | Article | My So-Karen Life | I know Karens are hard. As a member of Gen X, I grew up surrounded by them. | 2019-12-07 | The New York Times | 2019-12-09 22:12:21 | c(“GENERATION X”, “NAMES, PERSONAL”, “EDUCATION (K-12)”, “WOMEN AND GIRLS”, “YOUR-FEED-SELFCARE”) | COLLEGES AND UNIVERSITIES |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Illustration by Saehan Park“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/05/fashion/05rites-karens-1/05rites-karens-1-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/05/fashion/05rites-karens-1/05rites-karens-1-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/05/fashion/05rites-karens-1/05rites-karens-1-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/cf6d81cb-e9f9-565b-a549-a8429444fc88 | |||
| https://www.nytimes.com/2019/11/22/us/politics/ukraine-russia-interference.html | Russia;Ukraine;Republican Party;Hill, Fiona (1965- );Russian Interference in 2016 US Elections and Ties to Trump Associates;Trump-Ukraine Whistle-Blower Complaint and Impeachment Inquiry;Presidential Election of 2020;Rumors and Misinformation;Classified Information and State Secrets;Impeachment;Trump, Donald J;House Committee on Intelligence | politics | 19 | SHARED-TWITTER | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By JULIAN E. BARNES and MATTHEW ROSENBERG | Article | Charges of Ukrainian Meddling? A Russian Operation, U.S. Intelligence Says | Moscow has run a yearslong operation to blame Ukraine for its own 2016 election interference. Republicans have used similar talking points to defend President Trump in impeachment proceedings. | 2019-11-22 | The New York Times | 2019-11-26 11:56:56 | c(“RUSSIAN INTERFERENCE IN 2016 US ELECTIONS AND TIES TO TRUMP ASSOCIATES”, “PRESIDENTIAL ELECTION OF 2020”) | c(“REPUBLICAN PARTY”, “TRUMP-UKRAINE WHISTLE-BLOWER COMPLAINT AND IMPEACHMENT INQUIRY”, “RUMORS AND MISINFORMATION”, “CLASSIFIED INFORMATION AND STATE SECRETS”, “IMPEACHMENT”, “HOUSE COMMITTEE ON INTELLIGENCE”) | c(“HILL, FIONA (1965- )”, “TRUMP, DONALD J”) | c(“RUSSIA”, “UKRAINE”) |
list(type = “image”, subtype = “photo”, caption = “President Vladmir V. Putin of Russia has been pushing false theories of Ukrainian interference since early 2017, according to American officials.”, copyright = “Alexei Druzhinin/Sputnik, via Reuters”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/21/us/politics/21dc-intel1/21dc-intel1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/21/us/politics/21dc-intel1/21dc-intel1-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/21/us/politics/21dc-intel1/21dc-intel1-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/f5396d66-c0c5-59fb-8482-acc9e6d05a4b |
| https://www.nytimes.com/2019/11/26/upshot/democratic-trump-voters-2020.html | Presidential Election of 2020;Midterm Elections (2018);Presidential Election of 2016;Voting and Voters;Trump, Donald J;Polls and Public Opinion | 20 | SHARED-TWITTER | NA | 0 | The Upshot | 1e+14 | 1e+14 | the upshot | By NATE COHN and CLAIRE CAIN MILLER | Article | They Voted Democratic. Now They Support Trump. | Two-thirds of battleground state voters who chose Trump in 2016 but selected Democrats in the midterms say they will return to the president next year. | 2019-11-26 | The New York Times | 2019-11-27 05:20:01 | c(“PRESIDENTIAL ELECTION OF 2020”, “MIDTERM ELECTIONS (2018)”, “PRESIDENTIAL ELECTION OF 2016”, “POLLS AND PUBLIC OPINION”) | VOTING AND VOTERS | TRUMP, DONALD J |
list(type = “image”, subtype = “photo”, caption = “Michelle Bassaro, a Trump supporter, in her apartment in Nanty Glo, Pa. She said she voted for the Democrat in her district in the midterm election to balance the administration’s power.”, copyright = “Ross Mantle for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/22/upshot/00up-switch/00up-switch-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/22/upshot/00up-switch/00up-switch-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/22/upshot/00up-switch/00up-switch-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/40a30c59-6536-59fa-beae-d733e2ecce11 |
#most shared facebook 30 day
myurl4 <- "https://api.nytimes.com/svc/mostpopular/v2/shared/30/facebook.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG"
myresponse4 <- fromJSON(myurl4)
#str(myresponse4)
df4 <- myresponse4$results
myresponse4$results %>% kable() %>% kable_styling() %>% scroll_box(width = "910px", height = "400px")| url | adx_keywords | subsection | share_count | count_type | column | eta_id | section | id | asset_id | nytdsection | byline | type | title | abstract | published_date | source | updated | des_facet | org_facet | per_facet | geo_facet | media | uri |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| https://www.nytimes.com/2019/07/31/us/politics/trump-navy-seal-war-crimes.html | United States Defense and Military Forces;United States Politics and Government;Awards, Decorations and Honors;War Crimes, Genocide and Crimes Against Humanity;United States Navy;Gallagher, Edward (1979- );Trump, Donald J | politics | 1 | SHARED-FACEBOOK | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By PETER BAKER | Article | Trump Orders Navy to Strip Medals From Prosecutors in War Crimes Trial | President Trump lashed out at military lawyers who tried the case of Edward Gallagher, a Navy SEAL who was acquitted of killing a captured teenage Islamic State fighter. | 2019-07-31 | The New York Times | 2019-08-01 04:31:17 | c(“UNITED STATES DEFENSE AND MILITARY FORCES”, “UNITED STATES POLITICS AND GOVERNMENT”, “AWARDS, DECORATIONS AND HONORS”) | c(“WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”, “UNITED STATES NAVY”) | c(“GALLAGHER, EDWARD (1979- )”, “TRUMP, DONALD J”) |
list(type = “image”, subtype = “photo”, caption = “Eddie Gallagher celebrated after he was acquitted of murder charges earlier this month.”, copyright = “Sandy Huffaker/Getty Images”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/07/31/us/politics/31dc-seal/31dc-seal-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/07/31/us/politics/31dc-seal/merlin_157385310_473731a0-2415-4008-b145-7f9039642593-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/07/31/us/politics/31dc-seal/merlin_157385310_473731a0-2415-4008-b145-7f9039642593-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/2e9a16af-efc3-55b1-a6da-48de735ae783 | |
| https://www.nytimes.com/2019/11/27/nyregion/hull-o-farm-catskills.html | Agriculture and Farming;Hull-O Farms (Durham, NY);Catskills (NYS Area);Family Business;Pensions and Retirement Plans | 2 | SHARED-FACEBOOK | NA | 0 | New York | 1e+14 | 1e+14 | new york | By COREY KILGANNON | Article | After 240 Years and 7 Generations, Forced to Sell the Family Farm | The aging owners of a Catskills farm say it “has to close so we can survive.” | 2019-11-27 | The New York Times | 2019-12-04 15:11:59 | AGRICULTURE AND FARMING | c(“HULL-O FARMS (DURHAM, NY)”, “FAMILY BUSINESS”, “PENSIONS AND RETIREMENT PLANS”) | CATSKILLS (NYS AREA) |
list(type = “image”, subtype = “photo”, caption = “Seven generations of Frank Hull’s family have lived and been buried on their farm in Durham, N.Y.”, copyright = “Sara Naomi Lewkowicz for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/28/nyregion/28NYFARM-A1/26nyfarm1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/28/nyregion/28NYFARM-A1/26nyfarm1-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/28/nyregion/28NYFARM-A1/26nyfarm1-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/713ed717-5920-5223-a5fa-c7d43b0b4ea1 | ||
| https://www.nytimes.com/2019/12/07/us/dna-bone-marrow-transplant-crime-lab.html | Forensic Science;Genetics and Heredity;Bone Marrow;DNA (Deoxyribonucleic Acid);Transplants;Crime and Criminals | 3 | SHARED-FACEBOOK | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By HEATHER MURPHY | Article | When a DNA Test Says You’re a Younger Man, Who Lives 5,000 Miles Away | After a bone marrow transplant, a man with leukemia found that his donor’s DNA traveled to unexpected parts of his body. A crime lab is now studying the case. | 2019-12-07 | The New York Times | 2019-12-10 05:48:44 | c(“FORENSIC SCIENCE”, “GENETICS AND HEREDITY”, “BONE MARROW”, “DNA (DEOXYRIBONUCLEIC ACID)”, “CRIME AND CRIMINALS”) | TRANSPLANTS |
list(type = “image”, subtype = “photo”, caption = “Chris Long agreed to serve as a guinea pig for his colleagues’ experiment to help them understand how a bone marrow transplant could confuse a criminal investigation. ”, copyright = “Tiffany Brown Anderson for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/15/multimedia/00xp-chimera/00xp-chimera-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/15/multimedia/00xp-chimera/00xp-chimera-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/15/multimedia/00xp-chimera/00xp-chimera-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/606d186a-4ddf-5882-a595-c5888d76600c | |||
| https://www.nytimes.com/2019/09/24/dining/family-meals-around-the-world.html | weeknight cooking;Cooking and Cookbooks;Families and Family Life;Bangkok (Thailand);Gurgaon (India);Rome (Italy);Riyadh (Saudi Arabia);Port-au-Prince (Haiti);Israel;Paris (France);Kwazulu-Natal Province (South Africa);Australia;Lima (Peru);Amsterdam (Netherlands);Texas;Lagos (Nigeria);Monterrey (Mexico);Moscow (Russia);Tokyo (Japan);Istanbul (Turkey);Sao Paulo (Brazil) | 4 | SHARED-FACEBOOK | NA | 0 | Food | 1e+14 | 1e+14 | food | By SARA BONISTEEL, KIM GOUGENHEIM and LISA DALSIMER | Article | Weeknight Dinner Around the World | We asked 18 families to show us what they have for dinner on a typical weeknight. | 2019-09-24 | The New York Times | 2019-09-25 15:01:50 | c(“COOKING AND COOKBOOKS”, “FAMILIES AND FAMILY LIFE”) | c(“BANGKOK (THAILAND)”, “GURGAON (INDIA)”, “ROME (ITALY)”, “RIYADH (SAUDI ARABIA)”, “PORT-AU-PRINCE (HAITI)”, “ISRAEL”, “PARIS (FRANCE)”, “KWAZULU-NATAL PROVINCE (SOUTH AFRICA)”, “AUSTRALIA”, “LIMA (PERU)”, “AMSTERDAM (NETHERLANDS)”, “TEXAS”, “LAGOS (NIGERIA)”, “MONTERREY (MEXICO)”, “MOSCOW (RUSSIA)”, “TOKYO (JAPAN)”, “ISTANBUL (TURKEY)”, “SAO PAULO (BRAZIL)”) |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Andrew Esiebo for The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/09/25/dining/24World29/24World29-thumbStandard-v2.jpg“,”https://static01.nyt.com/images/2019/09/25/dining/24World29/24World29-mediumThreeByTwo210-v2.jpg“,”https://static01.nyt.com/images/2019/09/25/dining/24World29/24World29-mediumThreeByTwo440-v2.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/f006b552-5087-5f73-b28f-faa5187c375c | |||
| https://www.nytimes.com/2019/10/18/style/deborah-copaken-modern-love-catherine-keener.html | Marriages;Love (Emotion);Dating and Relationships;Television;Hinge (Mobile App);Modern Love (TV Program);your-feed-selfcare | 5 | SHARED-FACEBOOK | Modern Love | 0 | Style | 1e+14 | 1e+14 | style | By DANIEL JONES | Article | What She Learned From the One Who Got Away | Thirty years ago, Deborah Copaken thought her boyfriend had stood her up. The real story was more complicated. So she used it as a cautionary tale to help reunite another couple. | 2019-10-18 | The New York Times | 2019-10-26 23:50:13 | c(“MARRIAGES”, “LOVE (EMOTION)”, “YOUR-FEED-SELFCARE”) | c(“DATING AND RELATIONSHIPS”, “TELEVISION”, “HINGE (MOBILE APP)”) |
list(type = “image”, subtype = “photo”, caption = “Deborah Copaken at home in Brooklyn, N.Y.”, copyright = “Vincent Tullo for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/10/20/fashion/18LOVE-JOURNALIST1/18LOVE-JOURNALIST1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/10/20/fashion/18LOVE-JOURNALIST1/18LOVE-JOURNALIST1-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/10/20/fashion/18LOVE-JOURNALIST1/18LOVE-JOURNALIST1-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/048420a9-4717-5348-8f43-f74df545c5ee | |||
| https://www.nytimes.com/2019/11/07/opinion/nike-running-mary-cain.html | Cain, Mary (1996- );NIKE Inc;Women and Girls;Weight;Running;Track and Field;Salazar, Alberto;Doping (Sports);Coaches and Managers;#MeToo Movement;Oregon;your-feed-opinionvideo | 6 | SHARED-FACEBOOK | NA | 0 | Opinion | 1e+14 | 1e+14 | opinion | By MARY CAIN | Article | I Was the Fastest Girl in America, Until I Joined Nike | Mary Cain’s male coaches were convinced she had to get “thinner, and thinner, and thinner.” Then her body started breaking down. | 2019-11-07 | The New York Times | 2019-11-09 02:41:14 | c(“WOMEN AND GIRLS”, “RUNNING”, “TRACK AND FIELD”, “DOPING (SPORTS)”, “COACHES AND MANAGERS”, “#METOO MOVEMENT”, “YOUR-FEED-OPINIONVIDEO”) | c(“NIKE INC”, “WEIGHT”) | c(“CAIN, MARY (1996- )”, “SALAZAR, ALBERTO”) | OREGON |
list(type = “image”, subtype = “photo”, caption = “Mary Cain’s male coaches were convinced she had to get “thinner, and thinner, and thinner.”“, copyright =”The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/09/autossell/06op-mary-cain/06op-mary-cain-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/11/09/autossell/06op-mary-cain/06op-mary-cain-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/11/09/autossell/06op-mary-cain/06op-mary-cain-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/08fe6653-b47f-549a-a484-c76219d10244 | |
| https://www.nytimes.com/2019/12/08/nyregion/auschwitz-love-story.html | Holocaust and the Nazi Era;Concentration Camps;Jews and Judaism;Auschwitz Concentration Camp;Europe;Manhattan (NYC);World War II (1939-45);War Crimes, Genocide and Crimes Against Humanity;Wisnia, David;Tichauer, Helen (1918-2018);Dating and Relationships | 7 | SHARED-FACEBOOK | NA | 0 | New York | 1e+14 | 1e+14 | new york | By KEREN BLANKFELD | Article | Lovers in Auschwitz, Reunited 72 Years Later. He Had One Question. | Was she the reason he was alive today? | 2019-12-08 | The New York Times | 2019-12-11 19:58:55 | c(“HOLOCAUST AND THE NAZI ERA”, “DATING AND RELATIONSHIPS”) | c(“CONCENTRATION CAMPS”, “JEWS AND JUDAISM”, “AUSCHWITZ CONCENTRATION CAMP”, “WORLD WAR II (1939-45)”, “WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”) | c(“WISNIA, DAVID”, “TICHAUER, HELEN (1918-2018)”) | c(“EUROPE”, “MANHATTAN (NYC)”) |
list(type = “image”, subtype = “photo”, caption = “David Wisnia at his home in Pennsylvania.”, copyright = “Danna Singer for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-mediumThreeByTwo210-v3.jpg”, “https://static01.nyt.com/images/2019/12/08/nyregion/08aushchwitz-lovers1/08aushchwitz-lovers1-mediumThreeByTwo440-v3.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/8edf8c46-8166-5577-992e-2f4cd9cd081c | |
| https://www.nytimes.com/2019/12/06/nyregion/nyc-police-subway-racial-profiling.html | Tsachas, Constantin;Racial Profiling;Police Department (NYC);Discrimination;Suits and Litigation (Civil);Police;Race and Ethnicity;Blacks;Subways;Hispanic-Americans;Chinese-Americans;Asian-Americans;Brooklyn (NYC);Bratton, William J | 8 | SHARED-FACEBOOK | NA | 0 | New York | 1e+14 | 1e+14 | new york | By JOSEPH GOLDSTEIN and ASHLEY SOUTHALL | Article | ‘I Got Tired of Hunting Black and Hispanic People’ | Multiple police officers in Brooklyn say they were told by a commander that white and Asian people should be left alone. | 2019-12-06 | The New York Times | 2019-12-09 15:04:25 | c(“RACIAL PROFILING”, “DISCRIMINATION”, “POLICE”, “RACE AND ETHNICITY”, “ASIAN-AMERICANS”) | c(“POLICE DEPARTMENT (NYC)”, “SUITS AND LITIGATION (CIVIL)”, “BLACKS”, “SUBWAYS”, “HISPANIC-AMERICANS”, “CHINESE-AMERICANS”) | c(“TSACHAS, CONSTANTIN”, “BRATTON, WILLIAM J”) | BROOKLYN (NYC) |
list(type = “image”, subtype = “photo”, caption = “Lt. Edwin Raymond and other officers who policed the subway in Brooklyn are suing the Police Department for discrimination.”, copyright = “Celeste Sloman for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/12/07/nyregion/07subwaycops1-print/06subwaycops-thumbStandard-v2.jpg”, “https://static01.nyt.com/images/2019/12/07/nyregion/07subwaycops1-print/06subwaycops-mediumThreeByTwo210-v2.jpg”, “https://static01.nyt.com/images/2019/12/07/nyregion/07subwaycops1-print/06subwaycops-mediumThreeByTwo440-v2.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/6f8a409b-9191-5a1f-b65a-c287f67c2f7b | |
| https://www.nytimes.com/aponline/2019/11/25/health/ap-af-med-africa-polio.html | 9 | SHARED-FACEBOOK | NA | 0 | Health | 1e+14 | 1e+14 | health | By THE ASSOCIATED PRESS | Article | More Polio Cases Now Caused by Vaccine Than by Wild Virus | Four African countries have reported new cases of polio linked to the oral vaccine, as global health numbers show there are now more children being paralyzed by viruses originating in vaccines than in the wild. | 2019-11-25 | AP | 2019-11-28 00:41:10 | nyt://article/878679d7-6e5d-5812-8f7c-2a2da67a3f94 | |||||||
| https://www.nytimes.com/2019/11/23/us/politics/navy-discipline-edward-gallagher.html | Gallagher, Edward (1979- );Trump, Donald J;Spencer, Richard V;Green, Collin P;United States Navy;Navy Seals;War Crimes, Genocide and Crimes Against Humanity;United States Defense and Military Forces;Amnesties, Commutations and Pardons | politics | 10 | SHARED-FACEBOOK | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By MAGGIE HABERMAN, HELENE COOPER and DAVE PHILIPPS | Article | Navy Is Said to Proceed With Disciplinary Plans Against Edward Gallagher | Top military officials threatened to resign or be fired if their plans to remove Chief Gallagher from the SEALs were halted by President Trump, administration officials said. | 2019-11-23 | The New York Times | 2019-11-25 18:15:57 | c(“UNITED STATES DEFENSE AND MILITARY FORCES”, “AMNESTIES, COMMUTATIONS AND PARDONS”) | c(“UNITED STATES NAVY”, “NAVY SEALS”, “WAR CRIMES, GENOCIDE AND CRIMES AGAINST HUMANITY”) | c(“GALLAGHER, EDWARD (1979- )”, “TRUMP, DONALD J”, “SPENCER, RICHARD V”, “GREEN, COLLIN P”) |
list(type = “image”, subtype = “photo”, caption = “Navy Secretary Richard V. Spencer, right, and President Trump in July.”, copyright = “Doug Mills/The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/24/us/24SEAL-SUB/23dcseal-image2-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/24/us/24SEAL-SUB/24SEAL-SUB-mediumThreeByTwo210-v2.jpg”, “https://static01.nyt.com/images/2019/11/24/us/24SEAL-SUB/24SEAL-SUB-mediumThreeByTwo440-v2.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/c8211f50-0d0e-52e4-924b-8b9ab196bd95 | |
| https://www.nytimes.com/2019/11/22/world/asia/the-jungle-prince-of-delhi.html | India;Royal Families;News and News Media;Delhi (India);Cyrus, Prince of Oudh;Pakistan;Oudh Family (Delhi, India) | asia pacific | 11 | SHARED-FACEBOOK | NA | 0 | World | 1e+14 | 1e+14 | world | Article | The Jungle Prince of Delhi | For 40 years, journalists chronicled the eccentric royal family of Oudh, deposed aristocrats who lived in a ruined palace in the Indian capital. It was a tragic, astonishing story. But was it true? | 2019-11-22 | The New York Times | 2019-12-09 18:42:14 | NEWS AND NEWS MEDIA | ROYAL FAMILIES | CYRUS, PRINCE OF OUDH | c(“INDIA”, “DELHI (INDIA)”, “PAKISTAN”) |
list(type = “image”, subtype = “photo”, caption = “Prince Cyrus, Princess Sakina and a servant in 1998 on the roof of the Malcha Mahal. They called their mother “Your Highness,” and when she died, they embalmed her body themselves.“, copyright =”Barry Bearak/The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/30/world/xxcyrus4/xxcyrus4-thumbStandard-v3.jpg“,”https://static01.nyt.com/images/2019/11/30/world/xxcyrus4/xxcyrus4-mediumThreeByTwo210-v2.jpg“,”https://static01.nyt.com/images/2019/11/30/world/xxcyrus4/xxcyrus4-mediumThreeByTwo440-v2.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/03990cb5-2e65-5696-a899-fe83901731ac | |
| https://www.nytimes.com/2019/10/24/arts/music/flea-book.html | Writing and Writers;Books and Literature;Pop and Rock Music;Red Hot Chili Peppers (Music Group);Flea;Acid for the Children: A Memoir (Book) | music | 12 | SHARED-FACEBOOK | NA | 0 | Arts | 1e+14 | 1e+14 | arts | By ALEX PAPPADEMAS | Article | Flea Had a Wild Life. Then He Joined Red Hot Chili Peppers. | In a new memoir, the bassist describes how he expanded his consciousness, found his muse and landed in a storied rock band. | 2019-10-24 | The New York Times | 2019-11-04 23:13:28 | c(“WRITING AND WRITERS”, “BOOKS AND LITERATURE”) | c(“POP AND ROCK MUSIC”, “RED HOT CHILI PEPPERS (MUSIC GROUP)”) | FLEA |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Ryan Pfluger for The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/10/27/arts/27FLEA-MEMOIR-1/27FLEA-MEMOIR-1-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/10/27/arts/27FLEA-MEMOIR-1/27FLEA-MEMOIR-1-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/10/27/arts/27FLEA-MEMOIR-1/27FLEA-MEMOIR-1-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/65ef2bb4-9056-5928-b28f-f876c6a1dbaf | |
| https://www.nytimes.com/2019/11/13/movies/tom-hanks-mister-rogers.html | Hanks, Tom;Actors and Actresses;Movies;A Beautiful Day in the Neighborhood (Movie) | 13 | SHARED-FACEBOOK | NA | 0 | Movies | 1e+14 | 1e+14 | movies | By TAFFY BRODESSER-AKNER | Article | This Tom Hanks Story Will Help You Feel Less Bad | Hanks is playing Mister Rogers in a new movie and is just as nice as you think he is. Please read this article anyway. | 2019-11-13 | The New York Times | 2019-12-04 14:51:05 | MOVIES | ACTORS AND ACTRESSES | HANKS, TOM |
list(type = “image”, subtype = “photo”, caption = ““I recognized in myself a long time ago that I don’t instill fear in anybody,” Hanks said. “Now, that’s different than being nice, you know? I think I have a cache of mystery. But it’s not one of malevolence.”“, copyright =”Daniel Dorsa for The New York Times“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/17/arts/17tom-hanks2-promo/17tom-hanks2-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/11/17/arts/17tom-hanks2-promo/17tom-hanks2-promo-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/11/17/arts/17tom-hanks2-promo/17tom-hanks2-promo-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/8837752f-6207-55e9-8cc3-b811091e3a86 | ||
| https://www.nytimes.com/2019/11/23/us/justice-ruth-bader-ginsburg-hospitalized.html | Pancreatic Cancer;Supreme Court (US);Ginsburg, Ruth Bader;Trump, Donald J | 14 | SHARED-FACEBOOK | NA | 0 | U.S. | 1e+14 | 1e+14 | u.s. | By ADAM LIPTAK | Article | Justice Ruth Bader Ginsburg Hospitalized | The justice was admitted after experiencing chills and a fever and expects to be released as early as Sunday morning, a Supreme Court spokeswoman said. | 2019-11-23 | The New York Times | 2019-11-24 16:45:21 | c(“PANCREATIC CANCER”, “SUPREME COURT (US)”) | c(“GINSBURG, RUTH BADER”, “TRUMP, DONALD J”) |
list(type = “image”, subtype = “photo”, caption = “Justice Ruth Bader Ginsburg is the senior member of the court’s four-member liberal wing.”, copyright = “T.J. Kirkpatrick for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/24/us/23dc-Ginsburg-print/merlin_163592514_14f1a38f-6190-4d1e-9a4c-996327bb485d-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/24/us/23dc-Ginsburg-print/merlin_163592514_14f1a38f-6190-4d1e-9a4c-996327bb485d-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/24/us/23dc-Ginsburg-print/merlin_163592514_14f1a38f-6190-4d1e-9a4c-996327bb485d-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/00b78444-48b4-5f48-9295-9ad0a8b4831f | |||
| https://www.nytimes.com/2019/11/21/business/tesla-cybertruck-pickup-truck.html | Musk, Elon;Tesla Motors Inc;Sports Utility Vehicles and Light Trucks;Electric and Hybrid Vehicles;Automobiles;cybertruck | 15 | SHARED-FACEBOOK | NA | 0 | Business | 1e+14 | 1e+14 | business | By KAREN ZRAICK, NEAL E. BOUDETTE and DANIEL VICTOR | Article | Tesla’s Electric ‘Cybertruck’ Is Unveiled. It’s Pointy. | Elon Musk’s car company presented its long-awaited pickup truck, but it didn’t quite go as planned. (Broken windows were involved.) | 2019-11-21 | The New York Times | 2019-11-23 05:19:37 | c(“SPORTS UTILITY VEHICLES AND LIGHT TRUCKS”, “ELECTRIC AND HYBRID VEHICLES”, “AUTOMOBILES”) | TESLA MOTORS INC | MUSK, ELON |
list(type = “image”, subtype = “photo”, caption = ““When we unveil this thing, there will be some people who are like, ‘Oh, that doesn’t look like a truck; I don’t want to buy it,’” Elon Musk, Tesla’s chief executive, said in an earlier interview.“, copyright =”Ringo H.W. Chiu/Associated Press“, approved_for_syndication = 1, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/12/21/world/21xp-tesla1/21xp-tesla1-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/12/21/world/21xp-tesla1/21xp-tesla1-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/12/21/world/21xp-tesla1/21xp-tesla1-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/e5e7c911-a68a-5fdf-a783-d0072a3755a0 | ||
| https://www.nytimes.com/2019/11/19/magazine/mr-rogers.html | Rogers, Fred;Children and Childhood;Puppets;Culture (Arts);Opera;Mister Rogers’ Neighborhood (TV Program);Won’t You Be My Neighbor? (Movie);Television;Movies | 16 | SHARED-FACEBOOK | NA | 0 | Magazine | 1e+14 | 1e+14 | magazine | By JEANNE MARIE LASKAS | Article | The Mister Rogers No One Saw | Fred Rogers wasn’t just a brilliant educator and a profoundly moral person. He was an uncompromising artist. | 2019-11-19 | The New York Times | 2019-12-04 14:51:11 | c(“CHILDREN AND CHILDHOOD”, “MOVIES”) | c(“PUPPETS”, “CULTURE (ARTS)”, “OPERA”, “TELEVISION”) | ROGERS, FRED |
list(type = “image”, subtype = “photo”, caption = “Fred Rogers, 1985.”, copyright = “Jim Judkis”, approved_for_syndication = 0, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/24/magazine/24mag-rogers-image/24mag-rogers-image-thumbStandard-v4.jpg”, “https://static01.nyt.com/images/2019/11/24/magazine/24mag-rogers-image/24mag-rogers-image-mediumThreeByTwo210-v5.jpg”, “https://static01.nyt.com/images/2019/11/24/magazine/24mag-rogers-image/24mag-rogers-image-mediumThreeByTwo440-v5.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/fc20945c-97a4-54f0-a49a-31f604f4bdc8 | ||
| https://www.nytimes.com/2019/11/14/business/bodega-night-brooklyn.html | bodegas;New York City;Williamsburg (Brooklyn, NY);America’s Next Top Model (TV Program);Labor and Jobs;Convenience Stores;Drugstores | 17 | SHARED-FACEBOOK | Scratch | 0 | Business | 1e+14 | 1e+14 | business | By JULIA ROTHMAN and SHAINA FEINBERG | Article | We Spent the Night at a Bodega and Wrote It All Down | Eight hours, 322 sales, two cops, one America’s Next Top Model, and one very persistent drug dealer. | 2019-11-14 | The New York Times | 2019-11-17 21:26:08 | c(“LABOR AND JOBS”, “CONVENIENCE STORES”, “DRUGSTORES”) | c(“NEW YORK CITY”, “WILLIAMSBURG (BROOKLYN, NY)”) |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”Julia Rothman“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/14/business/14scratch-imagepromo/14scratch-imagepromo-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/11/14/business/14scratch-imagepromo/14scratch-imagepromo-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/11/14/business/14scratch-imagepromo/14scratch-imagepromo-mediumThreeByTwo440.jpg" ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/c5d578d4-5fdf-5e33-8aca-f3ac04ac2923 | |||
| https://www.nytimes.com/2019/11/19/sports/George-Morris-sexual-abuse.html | Horsemanship and Equestrian Events;Olympic Games (1960);United States Equestrian Federation;Morris, George H;Child Abuse and Neglect;Sex Crimes;Coaches and Managers | 18 | SHARED-FACEBOOK | NA | 0 | Sports | 1e+14 | 1e+14 | sports | By SARAH MASLIN NIR | Article | George Morris, Equestrian Legend, Is Permanently Barred From the Sport | Accusations of sexual abuse led to the expulsion of Mr. Morris, a former coach of the United States Olympic team. | 2019-11-19 | The New York Times | 2019-11-20 17:59:46 | c(“HORSEMANSHIP AND EQUESTRIAN EVENTS”, “OLYMPIC GAMES (1960)”, “CHILD ABUSE AND NEGLECT”) | c(“UNITED STATES EQUESTRIAN FEDERATION”, “SEX CRIMES”, “COACHES AND MANAGERS”) | MORRIS, GEORGE H |
list(type = “image”, subtype = “photo”, caption = “George Morris in 1960 after the United States won the Prince of Wales Cup at the Royal International Horse Show in London.”, copyright = “Laurence Harris/Associated Press”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/19/sports/19georgemorris/19georgemorris-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/19/sports/19georgemorris/19georgemorris-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/19/sports/19georgemorris/19georgemorris-mediumThreeByTwo440.jpg” ), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/435944a3-a163-5756-89eb-3225650698c2 | ||
| https://www.nytimes.com/2019/11/26/upshot/democratic-trump-voters-2020.html | Presidential Election of 2020;Midterm Elections (2018);Presidential Election of 2016;Voting and Voters;Trump, Donald J;Polls and Public Opinion | 19 | SHARED-FACEBOOK | NA | 0 | The Upshot | 1e+14 | 1e+14 | the upshot | By NATE COHN and CLAIRE CAIN MILLER | Article | They Voted Democratic. Now They Support Trump. | Two-thirds of battleground state voters who chose Trump in 2016 but selected Democrats in the midterms say they will return to the president next year. | 2019-11-26 | The New York Times | 2019-11-27 05:20:01 | c(“PRESIDENTIAL ELECTION OF 2020”, “MIDTERM ELECTIONS (2018)”, “PRESIDENTIAL ELECTION OF 2016”, “POLLS AND PUBLIC OPINION”) | VOTING AND VOTERS | TRUMP, DONALD J |
list(type = “image”, subtype = “photo”, caption = “Michelle Bassaro, a Trump supporter, in her apartment in Nanty Glo, Pa. She said she voted for the Democrat in her district in the midterm election to balance the administration’s power.”, copyright = “Ross Mantle for The New York Times”, approved_for_syndication = 1, media-metadata = list(list(url = c(“https://static01.nyt.com/images/2019/11/22/upshot/00up-switch/00up-switch-thumbStandard.jpg”, “https://static01.nyt.com/images/2019/11/22/upshot/00up-switch/00up-switch-mediumThreeByTwo210.jpg”, “https://static01.nyt.com/images/2019/11/22/upshot/00up-switch/00up-switch-mediumThreeByTwo440.jpg”), format = c(“Standard Thumbnail”, “mediumThreeByTwo210”, “mediumThreeByTwo440”), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/40a30c59-6536-59fa-beae-d733e2ecce11 | ||
| https://www.nytimes.com/2019/11/22/books/review/best-books.html | Books and Literature;Two Thousand Nineteen | book review | 20 | SHARED-FACEBOOK | NA | 0 | Books | 1e+14 | 1e+14 | books | Article | The 10 Best Books of 2019 | The editors of The Times Book Review choose the best fiction and nonfiction titles this year. | 2019-11-22 | The New York Times | 2019-12-04 14:51:55 | BOOKS AND LITERATURE | TWO THOUSAND NINETEEN |
list(type = “image”, subtype = “photo”, caption = "“, copyright =”“, approved_for_syndication = 0, media-metadata = list(list(url = c(”https://static01.nyt.com/images/2019/11/22/books/22BESTBOOKS-COMBO/22BESTBOOKS-COMBO-thumbStandard.jpg“,”https://static01.nyt.com/images/2019/11/22/books/22BESTBOOKS-COMBO/22BESTBOOKS-COMBO-mediumThreeByTwo210.jpg“,”https://static01.nyt.com/images/2019/11/22/books/22BESTBOOKS-COMBO/22BESTBOOKS-COMBO-mediumThreeByTwo440.jpg“), format = c(”Standard Thumbnail“,”mediumThreeByTwo210“,”mediumThreeByTwo440"), height = c(75, 140, 293), width = c(75, 210, 440))))
|
nyt://article/6b33e860-8169-50ce-bc1a-7cc6e276b4e2 |
Get nrc sentiment and valence value for the articles shared on the abstract api field of the article
#get nrc sentiment for abstract of articles shared on facebook and twitter
nrc_data <- get_nrc_sentiment(new.df$abstract)
valence <- (nrc_data[, 9]*-1) + nrc_data[, 10]
#dataset with valence
final_data <- cbind(new.df$abstract, new.df$count_type,nrc_data[1:10],valence)%>% kable() %>% kable_styling() %>% scroll_box(width = "910px", height = "400px")
final_data| new.df\(abstract </th> <th style="text-align:left;position: sticky; top:0; background-color: #FFFFFF;"> new.df\)count_type | anger | anticipation | disgust | fear | joy | sadness | surprise | trust | negative | positive | valence | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Was she the reason he was alive today? | SHARED-TWITTER | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 2 | 2 |
| I overcame the desperation I felt after stepping down from Congress, and I’m still in the fight. | SHARED-TWITTER | 1 | 0 | 1 | 1 | 0 | 0 | 0 | 1 | 1 | 0 | -1 |
| Hanks is playing Mister Rogers in a new movie and is just as nice as you think he is. Please read this article anyway. | SHARED-TWITTER | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| A shadowy hacker claimed to have the financier’s sex tapes. Two top lawyers wondered: What would the men in those videos pay to keep them secret? | SHARED-TWITTER | 0 | 3 | 0 | 0 | 2 | 0 | 0 | 4 | 0 | 3 | 3 |
| Ms. Harris is the only 2020 Democrat who has fallen hard out of the top tier of candidates. She has proved to be an uneven campaigner who changes her message and tactics to little effect and has a staff torn into factions. | SHARED-TWITTER | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 2 | 2 | 1 | -1 |
| I dropped out of film school to edit video for the conspiracy theorist because I believed in his worldview. Then I saw what it did to people. | SHARED-TWITTER | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 2 | 0 | 0 | 0 |
| Fred Rogers wasn’t just a brilliant educator and a profoundly moral person. He was an uncompromising artist. | SHARED-TWITTER | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 2 | 0 | 2 | 2 |
| For 40 years, journalists chronicled the eccentric royal family of Oudh, deposed aristocrats who lived in a ruined palace in the Indian capital. It was a tragic, astonishing story. But was it true? | SHARED-TWITTER | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 2 | 0 | -2 |
| Top military officials threatened to resign or be fired if their plans to remove Chief Gallagher from the SEALs were halted by President Trump, administration officials said. | SHARED-TWITTER | 2 | 1 | 1 | 3 | 0 | 2 | 1 | 3 | 2 | 2 | 0 |
| “Cancel culture” has always existed — for the powerful, at least. Now, social media has democratized it. | SHARED-TWITTER | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 2 | 1 |
| My brother dishes on Trump, impeachment and the 2020 field. | SHARED-TWITTER | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 1 | 0 |
| In 1964, with “Seven Up!” Michael Apted stumbled into making what has become the most profound documentary series in the history of cinema. Fifty-five years later, the project is reaching its conclusion. | SHARED-TWITTER | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Former President Barack Obama, in an address to liberal donors, warned candidates not to go too far left and sought to calm those who were concerned about the state of the Democratic primary. | SHARED-TWITTER | 0 | 1 | 0 | 2 | 0 | 1 | 1 | 1 | 1 | 4 | 3 |
| President Trump’s former press secretary has returned to Arkansas a bona fide star eager to play a new role in a post-Trump Republican Party. | SHARED-TWITTER | 0 | 2 | 0 | 0 | 2 | 0 | 2 | 3 | 0 | 3 | 3 |
| You might want to think twice before plugging in at an airport or on the train. | SHARED-TWITTER | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Chief Petty Officer Edward Gallagher is expected to be formally notified of the action on Wednesday. | SHARED-TWITTER | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 2 | 1 |
| A reader asks how best to advise her child who wants to stop getting a monthly period. | SHARED-TWITTER | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 3 | 3 |
| I know Karens are hard. As a member of Gen X, I grew up surrounded by them. | SHARED-TWITTER | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Moscow has run a yearslong operation to blame Ukraine for its own 2016 election interference. Republicans have used similar talking points to defend President Trump in impeachment proceedings. | SHARED-TWITTER | 1 | 0 | 1 | 2 | 0 | 0 | 1 | 2 | 3 | 2 | -1 |
| Two-thirds of battleground state voters who chose Trump in 2016 but selected Democrats in the midterms say they will return to the president next year. | SHARED-TWITTER | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 1 | 1 |
| President Trump lashed out at military lawyers who tried the case of Edward Gallagher, a Navy SEAL who was acquitted of killing a captured teenage Islamic State fighter. | SHARED-FACEBOOK | 1 | 0 | 0 | 3 | 0 | 2 | 1 | 2 | 2 | 2 | 0 |
| The aging owners of a Catskills farm say it “has to close so we can survive.” | SHARED-FACEBOOK | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 |
| After a bone marrow transplant, a man with leukemia found that his donor’s DNA traveled to unexpected parts of his body. A crime lab is now studying the case. | SHARED-FACEBOOK | 2 | 1 | 0 | 3 | 3 | 2 | 1 | 2 | 4 | 3 | -1 |
| We asked 18 families to show us what they have for dinner on a typical weeknight. | SHARED-FACEBOOK | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 1 |
| Thirty years ago, Deborah Copaken thought her boyfriend had stood her up. The real story was more complicated. So she used it as a cautionary tale to help reunite another couple. | SHARED-FACEBOOK | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 1 | 1 | 2 | 1 |
| Mary Cain’s male coaches were convinced she had to get “thinner, and thinner, and thinner.” Then her body started breaking down. | SHARED-FACEBOOK | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| Was she the reason he was alive today? | SHARED-FACEBOOK | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 2 | 2 |
| Multiple police officers in Brooklyn say they were told by a commander that white and Asian people should be left alone. | SHARED-FACEBOOK | 0 | 1 | 0 | 1 | 1 | 0 | 0 | 2 | 0 | 2 | 2 |
| Four African countries have reported new cases of polio linked to the oral vaccine, as global health numbers show there are now more children being paralyzed by viruses originating in vaccines than in the wild. | SHARED-FACEBOOK | 1 | 0 | 0 | 2 | 0 | 2 | 2 | 1 | 3 | 2 | -1 |
| Top military officials threatened to resign or be fired if their plans to remove Chief Gallagher from the SEALs were halted by President Trump, administration officials said. | SHARED-FACEBOOK | 2 | 1 | 1 | 3 | 0 | 2 | 1 | 3 | 2 | 2 | 0 |
| For 40 years, journalists chronicled the eccentric royal family of Oudh, deposed aristocrats who lived in a ruined palace in the Indian capital. It was a tragic, astonishing story. But was it true? | SHARED-FACEBOOK | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 2 | 0 | -2 |
| In a new memoir, the bassist describes how he expanded his consciousness, found his muse and landed in a storied rock band. | SHARED-FACEBOOK | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 4 | 4 |
| Hanks is playing Mister Rogers in a new movie and is just as nice as you think he is. Please read this article anyway. | SHARED-FACEBOOK | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| The justice was admitted after experiencing chills and a fever and expects to be released as early as Sunday morning, a Supreme Court spokeswoman said. | SHARED-FACEBOOK | 1 | 1 | 0 | 2 | 0 | 0 | 0 | 1 | 0 | 2 | 2 |
| Elon Musk’s car company presented its long-awaited pickup truck, but it didn’t quite go as planned. (Broken windows were involved.) | SHARED-FACEBOOK | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 1 | 0 | -1 |
| Fred Rogers wasn’t just a brilliant educator and a profoundly moral person. He was an uncompromising artist. | SHARED-FACEBOOK | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 2 | 0 | 2 | 2 |
| Eight hours, 322 sales, two cops, one America’s Next Top Model, and one very persistent drug dealer. | SHARED-FACEBOOK | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 3 | 3 |
| Accusations of sexual abuse led to the expulsion of Mr. Morris, a former coach of the United States Olympic team. | SHARED-FACEBOOK | 2 | 0 | 2 | 2 | 0 | 2 | 0 | 3 | 2 | 1 | -1 |
| Two-thirds of battleground state voters who chose Trump in 2016 but selected Democrats in the midterms say they will return to the president next year. | SHARED-FACEBOOK | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 1 | 1 |
| The editors of The Times Book Review choose the best fiction and nonfiction titles this year. | SHARED-FACEBOOK | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
barplot(
sort(colSums(prop.table(nrc_data))),
horiz = TRUE,
cex.names = 0.7,
las = 1,
main = "Emotions in Sample text", xlab="Percentage"
)
Get nrc sentiment at NYTIMES api at the des_facet field of the returned API data which categorizes articles based on descriptions
#split list for des_facet1 across all observations
new.df2 <- data.frame()
length(new.df$des_facet[[3]])## [1] 1for (i in 1:nrow(new.df)){
id <- as.numeric(i)
type <- new.df$count_type[i]
des_facet1 <- ''
if (length(new.df$des_facet[[i]] > 0)){
des_facet1 <- new.df$des_facet[[i]]}
new.df2 <- rbind(new.df2,(cbind(new.df[i,c(1,2,14)],id,type,des_facet1)))
}## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discarded
## Warning in data.frame(..., check.names = FALSE): row names were found from
## a short variable and have been discardedhead(new.df2)## url
## 1 https://www.nytimes.com/2019/12/08/nyregion/auschwitz-love-story.html
## 2 https://www.nytimes.com/2019/12/08/nyregion/auschwitz-love-story.html
## 3 https://www.nytimes.com/2019/12/07/opinion/sunday/katie-hill-resignation.html
## 4 https://www.nytimes.com/2019/12/07/opinion/sunday/katie-hill-resignation.html
## 5 https://www.nytimes.com/2019/12/07/opinion/sunday/katie-hill-resignation.html
## 31 https://www.nytimes.com/2019/11/13/movies/tom-hanks-mister-rogers.html
## adx_keywords
## 1 Holocaust and the Nazi Era;Concentration Camps;Jews and Judaism;Auschwitz Concentration Camp;Europe;Manhattan (NYC);World War II (1939-45);War Crimes, Genocide and Crimes Against Humanity;Wisnia, David;Tichauer, Helen (1918-2018);Dating and Relationships
## 2 Holocaust and the Nazi Era;Concentration Camps;Jews and Judaism;Auschwitz Concentration Camp;Europe;Manhattan (NYC);World War II (1939-45);War Crimes, Genocide and Crimes Against Humanity;Wisnia, David;Tichauer, Helen (1918-2018);Dating and Relationships
## 3 United States Politics and Government;Elections, House of Representatives;Women and Girls;House of Representatives;Democratic Party;United States;California;Hill, Katie (1987- )
## 4 United States Politics and Government;Elections, House of Representatives;Women and Girls;House of Representatives;Democratic Party;United States;California;Hill, Katie (1987- )
## 5 United States Politics and Government;Elections, House of Representatives;Women and Girls;House of Representatives;Democratic Party;United States;California;Hill, Katie (1987- )
## 31 Hanks, Tom;Actors and Actresses;Movies;A Beautiful Day in the Neighborhood (Movie)
## title id
## 1 Lovers in Auschwitz, Reunited 72 Years Later. He Had One Question. 1
## 2 Lovers in Auschwitz, Reunited 72 Years Later. He Had One Question. 1
## 3 Katie Hill: It’s Not Over After All 2
## 4 Katie Hill: It’s Not Over After All 2
## 5 Katie Hill: It’s Not Over After All 2
## 31 This Tom Hanks Story Will Help You Feel Less Bad 3
## type des_facet1
## 1 SHARED-TWITTER HOLOCAUST AND THE NAZI ERA
## 2 SHARED-TWITTER DATING AND RELATIONSHIPS
## 3 SHARED-TWITTER UNITED STATES POLITICS AND GOVERNMENT
## 4 SHARED-TWITTER ELECTIONS, HOUSE OF REPRESENTATIVES
## 5 SHARED-TWITTER WOMEN AND GIRLS
## 31 SHARED-TWITTER MOVIESnew.df2$des_facet1[1:10]## [1] HOLOCAUST AND THE NAZI ERA
## [2] DATING AND RELATIONSHIPS
## [3] UNITED STATES POLITICS AND GOVERNMENT
## [4] ELECTIONS, HOUSE OF REPRESENTATIVES
## [5] WOMEN AND GIRLS
## [6] MOVIES
## [7] VIDEO RECORDINGS, DOWNLOADS AND STREAMING
## [8] LEGAL PROFESSION
## [9] PRESIDENTIAL ELECTION OF 2020
## [10] UNITED STATES POLITICS AND GOVERNMENT
## 69 Levels: DATING AND RELATIONSHIPS ... OLYMPIC GAMES (1960)new.df2 %>%
count(type, des_facet1) %>%
top_n(50) %>%
ungroup() %>%
mutate(des_facet1 = reorder(des_facet1, n)) %>%
ggplot(aes(des_facet1, n, fill = type)) + geom_bar(stat = "identity") +
geom_col(show.legend = FALSE) +
facet_wrap(~type, scales = "free_y") +
labs(y = "Contribution to sentiment",
x = NULL) +
coord_flip() ## Selecting by n
Get Tokens and then build corpus and create wordcloud on the abstract field of the articles pulled back from API
#get token words from $abstract of returned results on most popular articles
p_word_v <- get_tokens(new.df$abstract, pattern = "\\W")
#build corpus
words <- Corpus(VectorSource(p_word_v))
# Convert the text to lower case
words <- tm_map(words, content_transformer(tolower))## Warning in tm_map.SimpleCorpus(words, content_transformer(tolower)):
## transformation drops documents# Remove numbers
words <- tm_map(words, removeNumbers)## Warning in tm_map.SimpleCorpus(words, removeNumbers): transformation drops
## documents# Remove english common stopwords
words <- tm_map(words, removeWords, stopwords("english"))## Warning in tm_map.SimpleCorpus(words, removeWords, stopwords("english")):
## transformation drops documents# Remove punctuations
words <- tm_map(words, removePunctuation)## Warning in tm_map.SimpleCorpus(words, removePunctuation): transformation
## drops documents# Eliminate extra white spaces
words <- tm_map(words, stripWhitespace)## Warning in tm_map.SimpleCorpus(words, stripWhitespace): transformation
## drops documentsdtm <- TermDocumentMatrix(words)
m <- as.matrix(dtm)
v <- sort(rowSums(m),decreasing=TRUE)
d <- data.frame(word = names(v),freq=v)
set.seed(1234)
wordcloud(words = d$word, freq = d$freq, min.freq = 1,
max.words=100, random.order=FALSE, rot.per=0.35,
colors=brewer.pal(8, "Dark2"))## Warning in wordcloud(words = d$word, freq = d$freq, min.freq = 1, max.words
## = 100, : midterms could not be fit on page. It will not be plotted.## Warning in wordcloud(words = d$word, freq = d$freq, min.freq = 1, max.words
## = 100, : republican could not be fit on page. It will not be plotted.
barplot(d[1:25,]$freq, las = 2, names.arg = d[1:25,]$word,
col ="lightblue", main ="Most frequent words",
ylab = "Word frequencies")
Report how Syuzhet, bing, afinn and nrc reports sentiments
syuzhet_vector <- get_sentiment(new.df$abstract, method="syuzhet")
bing_vector <- get_sentiment(new.df$abstract, method="bing")
afinn_vector <- get_sentiment(new.df$abstract, method="afinn")
nrc_vector <- get_sentiment(new.df$abstract, method="nrc", lang = "english")
#sign converts all positive #'s to 1 and all -ve # to -ve 1
rbind(
sign(syuzhet_vector),
sign(bing_vector),
sign(afinn_vector),
sign(nrc_vector)
)## [,1] [,2] [,3] [,4] [,5] [,6] [,7] [,8] [,9] [,10] [,11] [,12] [,13]
## [1,] 1 -1 1 -1 -1 -1 1 -1 -1 1 -1 1 1
## [2,] 0 -1 1 0 -1 -1 1 -1 1 1 1 0 -1
## [3,] 1 -1 1 1 -1 -1 1 -1 -1 1 0 1 0
## [4,] 1 -1 0 1 -1 0 1 -1 0 1 0 0 1
## [,14] [,15] [,16] [,17] [,18] [,19] [,20] [,21] [,22] [,23] [,24]
## [1,] 1 0 -1 1 -1 -1 -1 -1 1 -1 1
## [2,] 1 0 -1 1 -1 -1 1 0 0 -1 0
## [3,] 1 1 0 1 -1 -1 0 -1 0 -1 0
## [4,] 1 0 1 1 0 -1 1 0 1 -1 1
## [,25] [,26] [,27] [,28] [,29] [,30] [,31] [,32] [,33] [,34] [,35]
## [1,] -1 0 1 -1 -1 -1 -1 1 1 1 -1
## [2,] -1 0 0 0 -1 1 -1 0 1 0 -1
## [3,] 1 1 1 -1 0 -1 -1 0 1 1 -1
## [4,] 1 0 1 1 -1 0 -1 1 0 1 -1
## [,36] [,37] [,38] [,39] [,40]
## [1,] 1 1 -1 -1 0
## [2,] 1 1 -1 1 0
## [3,] 1 1 -1 0 1
## [4,] 1 1 -1 1 0#understanding the overall emotional valence of the sentences, -ve indicates overall negative sentiment of the articles that are most popular across facebook and twitter that were shared
sum(syuzhet_vector)## [1] 1.8mean(syuzhet_vector)## [1] 0.045summary(syuzhet_vector)## Min. 1st Qu. Median Mean 3rd Qu. Max.
## -2.0000 -0.7625 -0.1000 0.0450 0.8750 2.3000Build Corpus for just des_facet field and report wordcloud
#build corpus for des_facet1
words <- Corpus(VectorSource(new.df2$des_facet1))
# Convert the text to lower case
words <- tm_map(words, content_transformer(tolower))## Warning in tm_map.SimpleCorpus(words, content_transformer(tolower)):
## transformation drops documents# Remove numbers
words <- tm_map(words, removeNumbers)## Warning in tm_map.SimpleCorpus(words, removeNumbers): transformation drops
## documents# Remove english common stopwords
words <- tm_map(words, removeWords, stopwords("english"))## Warning in tm_map.SimpleCorpus(words, removeWords, stopwords("english")):
## transformation drops documents# Remove punctuations
words <- tm_map(words, removePunctuation)## Warning in tm_map.SimpleCorpus(words, removePunctuation): transformation
## drops documents# Eliminate extra white spaces
words <- tm_map(words, stripWhitespace)## Warning in tm_map.SimpleCorpus(words, stripWhitespace): transformation
## drops documentsdtm <- TermDocumentMatrix(words)
m <- as.matrix(dtm)
v <- sort(rowSums(m),decreasing=TRUE)
d <- data.frame(word = names(v),freq=v)
set.seed(1234)
wordcloud(words = d$word, freq = d$freq, min.freq = 1,
max.words=100, random.order=FALSE, rot.per=0.35,
colors=brewer.pal(8, "Dark2"))
Start Section for NYTIMES Archive API for 2 timeframes. Report pull back November 2018 and December 2017 data.
Loop through page JSON
Because there are many pages, we have to loop through the page look at only 3 pages. Save Rdata file so we can reload and don’t have to reconnect. Took about 3 minutes to get data.
myurlX <- "https://api.nytimes.com/svc/archive/v1/2018/11.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG"
initialQuery <- fromJSON(myurlX)
maxPages <- round((initialQuery$response$meta$hits[1] / 10)-1)
pages_2018 <- vector("list",length=maxPages)
#try with the max page limit at 10
maxPages = ifelse(maxPages >= 10, 5, maxPages)
for(i in 0:maxPages){
nytSearch <- fromJSON(paste0(myurlX , "&page=", i), flatten = TRUE) %>% data.frame()
pages_2018[[i+1]] <- nytSearch
Sys.sleep(5)
}
nytimes_2018_Novarchive_12072019 <- rbind_pages(pages_2018)
save(nytimes_2018_Novarchive_12072019 ,file="nytimes_2018_Novarchive_12072019.Rdata")
#str(nytimes_2018_Novarchive_12032019[1:10])
nrow(nytimes_2018_Novarchive_12072019)## [1] 40362colnames(nytimes_2018_Novarchive_12072019)## [1] "copyright"
## [2] "response.hits"
## [3] "response.docs.web_url"
## [4] "response.docs.snippet"
## [5] "response.docs.blog"
## [6] "response.docs.source"
## [7] "response.docs.multimedia"
## [8] "response.docs.keywords"
## [9] "response.docs.pub_date"
## [10] "response.docs.document_type"
## [11] "response.docs.news_desk"
## [12] "response.docs.type_of_material"
## [13] "response.docs._id"
## [14] "response.docs.word_count"
## [15] "response.docs.score"
## [16] "response.docs.uri"
## [17] "response.docs.slideshow_credits"
## [18] "response.docs.print_page"
## [19] "response.docs.section_name"
## [20] "response.docs.headline.main"
## [21] "response.docs.headline.kicker"
## [22] "response.docs.headline.content_kicker"
## [23] "response.docs.headline.print_headline"
## [24] "response.docs.headline.name"
## [25] "response.docs.headline.seo"
## [26] "response.docs.headline.sub"
## [27] "response.docs.byline.original"
## [28] "response.docs.byline.person"
## [29] "response.docs.byline.organization"nytimes_2018_Novarchive_12072019$response.docs.snippet[1:50]## [1] "Tips for how to combine pleasure with wellness when you’re on the road, because isn’t living your best life the point of a vacation in the first place?"
## [2] "The district voted for Donald J. Trump and Mitt Romney by comfortable margins, but it has strong Democratic roots. Democrats have a registration advantage."
## [3] "Galas were held last week for the New York Restoration Project, Fashion Group International, Aperture and the Children’s Museums of Manhattan."
## [4] "The Pulitzer Prize-winning author pays homage to Montreal’s patron saint, crooning the artist’s 1967 ballad ‘‘Suzanne,’’ with the musician Cassandra Jenkins on guitar."
## [5] "Watch: The Met invited the break dancers to perform with the museum’s collection of breastplates, gauntlets, hoods and other heraldry live in its galleries."
## [6] "Austerity in a slump, stimulus in a boom."
## [7] "Being a chef is tough on the feet and back. Here’s what Mr. Mattos does to stay fit and fresh. "
## [8] "The tenor Michael Fabiano wed Bryan McCalister at the Metropolitan Opera House, where they met in 2017 after Mr. Fabiano’s performance in “La Traviata.”"
## [9] "The elite field of the New York City Marathon includes 40-somethings like Abdi Abdirahman and Bernard Lagat. Increasingly, aging amateur runners are maintaining their speed. "
## [10] "Mr. Baker, who immigrated to New York from Nevis, like Hamilton, helped to persuade blacks to leave the Republican Party and later, to run for public office."
## [11] "The scholar and author, most recently, of “Why Religion?” tends to avoid reading science fiction: “Religious traditions already are packed with fantasy stories.”"
## [12] "P-Tech schools team up with business to provide lower-income students with much-needed STEM skills and even a job at IBM if they want one."
## [13] "Jay-Z channeled the 1968 Olympics for his Halloween look."
## [14] "Ahead of the midterm elections, we asked young evangelicals to tell The Times about the relationship between their faith and their politics."
## [15] "The tenor Michael Fabiano wed Bryan McCalister at the Metropolitan Opera House, where they met in 2017 after Mr. Fabiano’s performance in “La Traviata.”"
## [16] "The elite field of the New York City Marathon includes 40-somethings like Abdi Abdirahman and Bernard Lagat. Increasingly, aging amateur runners are maintaining their speed. "
## [17] "The Republican Party hopes to beat back the Democrats on Tuesday with a big push from the Christian right."
## [18] "Austerity in a slump, stimulus in a boom."
## [19] "Being a chef is tough on the feet and back. Here’s what Mr. Mattos does to stay fit and fresh. "
## [20] "Though it involves a small number of people, the case deepens the party’s troubles over charges that it has not acted against anti-Semitism in its ranks."
## [21] "Workers in the company’s offices around the world protested how it has handled cases of sexual harassment and misconduct."
## [22] "By threatening to penalize Swift, the financial messaging service, the U.S. is alienating European allies and could undercut the dollar’s dominance."
## [23] "The artist has pushed well beyond his popular “Soundsuits,” and has opened a multidisciplinary space in Chicago to support community collaborations."
## [24] "The short-term political interests of both sides are in a collision with their long-term political and economic interests — not to mention the global economy’s."
## [25] "Why is the Rust Belt trending blue for the midterms? The collapse of community may provide an answer."
## [26] "New York offers city financing to encourage developers to build co-living projects that are below market rate."
## [27] "A leaked school application has prompted debate about whether children in China’s test-crazed education system are being raised as soulless strivers."
## [28] "Thursday: A protest in response to a Times article on sexual harassment, the political feud between Gavin Newsom and President Trump, and the last Battle of the Bay."
## [29] "If you’re a single parent looking for family vacation options that don’t assume two adults, these cruises and travel agencies — among other destinations — are here to help."
## [30] "The scholar and author, most recently, of “Why Religion?” tends to avoid reading science fiction: “Religious traditions already are packed with fantasy stories.”"
## [31] "Following the money isn’t easy in the opaque world of venture capital."
## [32] "The former first couple’s production company will turn the Michael Lewis book “The Fifth Risk,” which examined the haphazard changeover in administration, into a series."
## [33] "The co-creative directors Laura Kim and Fernando Garcia have maintained some ‘Oscarisms’ while bringing their own vision to the brand."
## [34] "By threatening to penalize Swift, the financial messaging service, the U.S. is alienating European allies and could undercut the dollar’s dominance."
## [35] "Workers in the company’s offices around the world protested how it has handled cases of sexual harassment and misconduct."
## [36] "The artist has pushed well beyond his popular “Soundsuits,” and has opened a multidisciplinary space in Chicago to support community collaborations."
## [37] "He created widely popular panoramic fictional universes that inspired movies and video games and that have led some to compare him to J.R.R. Tolkien."
## [38] "A former president of Vassar College offers caveats."
## [39] "A vandal scrawled “Kill,” followed by the slur, on a plaque at the monument."
## [40] "The order came a little over a week after the court granted the administration a partial victory in the case by temporarily blocking the deposition of Wilbur Ross, the commerce secretary."
## [41] "The police said that someone was apparently holding a parking space for Mr. Baldwin, but another car pulled into the space and an altercation ensued."
## [42] "In the On Politics newsletter: While the president stokes fears of an invasion, Beto O’Rourke pushes a message of positivity; plus new polls, and the latest from Opinion."
## [43] "Bob McAdoo won the N.B.A.’s Most Valuable Player Award in 1975, but it wasn’t until he came off the bench for the Lakers in the 80s that he found true success."
## [44] "The star shares his five favorite movie musicals, and, yes, he says, “Labyrinth” counts: “It is totally a David Bowie movie musical.”"
## [45] "What are the president’s priorities? "
## [46] "In South Texas, Customs and Border Protection agents were already conducting military-style exercises as Army troops prepared to deploy along the border."
## [47] "The decision of the president to invoke Ms. Abrams’s background so broadly was an escalation in his attacks on her bid to become the first black woman to be elected governor in the United States."
## [48] "Mr. Baker, who immigrated to New York from Nevis, like Hamilton, helped to persuade blacks to leave the Republican Party and later, to run for public office."
## [49] "Community colleges are relying more and more on technology to help their students succeed."
## [50] "High in the Andes Mountains, conservators are testing traditional methods for strengthening adobe buildings. "Bigram Sentiment analysis on 2018 data and igraph
new_tibble <- enframe(nytimes_2018_Novarchive_12072019$response.docs.snippet[1:50], name = NULL)
my_frame <- data.frame(nytimes_2018_Novarchive_12072019$response.docs.snippet)
names(my_frame) <- c('snippetcol')
nrow(my_frame)## [1] 40362snippet_bigrams <- my_frame %>%
unnest_tokens(bigram, snippetcol, token = "ngrams", n = 2)
nrow(snippet_bigrams)## [1] 846533snippet_bigrams %>%
count(bigram, sort = TRUE)## # A tibble: 57,007 x 2
## bigram n
## <chr> <int>
## 1 of the 5532
## 2 in the 4230
## 3 to the 2136
## 4 for the 1644
## 5 and the 1578
## 6 in a 1524
## 7 on the 1506
## 8 at the 1458
## 9 of a 1362
## 10 new york 1302
## # ... with 56,997 more rowsbigrams_separated <- snippet_bigrams %>%
separate(bigram, c("word1", "word2"), sep = " ")
bigrams_filtered <- bigrams_separated %>%
filter(!word1 %in% stop_words$word) %>%
filter(!word2 %in% stop_words$word)
# new bigram counts:
bigram_counts <- bigrams_filtered %>%
count(word1, word2, sort = TRUE)
bigram_counts## # A tibble: 17,092 x 3
## word1 word2 n
## <chr> <chr> <int>
## 1 president trump 834
## 2 midterm elections 648
## 3 couple met 420
## 4 president trump’s 384
## 5 york city 306
## 6 york times 294
## 7 trump administration 258
## 8 white house 240
## 9 world war 216
## 10 los angeles 210
## # ... with 17,082 more rows# filter for only relatively common combinations
bigram_graph <- bigram_counts %>%
filter(n > 70) %>%
graph_from_data_frame()
bigram_graph## IGRAPH 151ac89 DN-- 125 72 --
## + attr: name (v/c), n (e/n)
## + edges from 151ac89 (vertex names):
## [1] president ->trump midterm ->elections
## [3] couple ->met president ->trump’s
## [5] york ->city york ->times
## [7] trump ->administration white ->house
## [9] world ->war los ->angeles
## [11] corrections->appearing week ->ahead
## [13] week’s ->properties social ->media
## [15] movie ->news prime ->minister
## + ... omitted several edgesset.seed(2017)
ggraph(bigram_graph, layout = "kk") +
geom_edge_link() +
geom_node_point() +
geom_node_text(aes(label = name), vjust = 1, hjust = 1)
#ggsave("bigramgraph3.pdf", bigramgraph3, dpi = 200)
set.seed(2016)
a <- grid::arrow(type = "closed", length = unit(.15, "inches"))
ggraph(bigram_graph, layout = "kk") +
geom_edge_link(aes(edge_alpha = n), show.legend = FALSE,
arrow = a, end_cap = circle(.07, 'inches')) +
geom_node_point(color = "lightblue", size = 5) +
geom_node_text(aes(label = name), vjust = 1, hjust = 1) +
theme_void()
#ggsave("bigramgraph4.pdf", bigramgraph4, dpi = 200)
# length(nytimes_2018_Novarchive_12032019$response.docs.snippet)
# my_corpus <- corpus(nytimes_2018_Novarchive_12032019$response.docs.snippet)
# my_sentences <- corpus_reshape(my_corpus, to = "sentences")
# ndoc(my_sentences)
# texts(my_sentences)[1]Start Section for NYTIMES Archive API. Report pull back December 2017 data.
myurlX <- "https://api.nytimes.com/svc/archive/v1/2017/12.json?api-key=wl3OA7v4AV7cjxGya142nvRGGv46HdNG"
initialQuery <- fromJSON(myurlX)
maxPages <- round((initialQuery$response$meta$hits[1] / 10)-1)
pages_2017 <- vector("list",length=maxPages)
#try with the max page limit at 10
maxPages = ifelse(maxPages >= 10, 8, maxPages)
for(i in 0:maxPages){
nytSearch <- fromJSON(paste0(myurlX , "&page=", i), flatten = TRUE) %>% data.frame()
pages_2017[[i+1]] <- nytSearch
Sys.sleep(5)
}
nytimes_2017_Decarchive_12072019 <- rbind_pages(pages_2017)
save(nytimes_2017_Decarchive_12072019 ,file="nytimes_2017_Decarchive_12072019")
#str(nytimes_2018_Novarchive_12032019[1:10])
nrow(nytimes_2017_Decarchive_12072019)## [1] 59391colnames(nytimes_2017_Decarchive_12072019)## [1] "copyright"
## [2] "response.hits"
## [3] "response.docs.web_url"
## [4] "response.docs.snippet"
## [5] "response.docs.blog"
## [6] "response.docs.source"
## [7] "response.docs.multimedia"
## [8] "response.docs.keywords"
## [9] "response.docs.pub_date"
## [10] "response.docs.document_type"
## [11] "response.docs.type_of_material"
## [12] "response.docs._id"
## [13] "response.docs.word_count"
## [14] "response.docs.score"
## [15] "response.docs.uri"
## [16] "response.docs.news_desk"
## [17] "response.docs.slideshow_credits"
## [18] "response.docs.section_name"
## [19] "response.docs.print_page"
## [20] "response.docs.abstract"
## [21] "response.docs.headline.main"
## [22] "response.docs.headline.kicker"
## [23] "response.docs.headline.content_kicker"
## [24] "response.docs.headline.print_headline"
## [25] "response.docs.headline.name"
## [26] "response.docs.headline.seo"
## [27] "response.docs.headline.sub"
## [28] "response.docs.byline.original"
## [29] "response.docs.byline.person"
## [30] "response.docs.byline.organization"nytimes_2017_Decarchive_12072019$response.docs.snippet[1:50]## [1] "30 million people will suffer from eating disorders in their lifetime, yet decades after Karen Carpenter died from anorexia, myths about eating disorders continue."
## [2] "Chris Wilson, a former professional football player, returned to his Michigan hometown to coach its last remaining public high school team, offering lessons that go far beyond the field."
## [3] "The growing popularity of the NYC Ferry along the East River is helping to reshape the mostly industrial coastline."
## [4] "15 things we love in her inimitable SoHo loft."
## [5] "The first test of Prince Harry and Meghan Markle's fairy-tale romance? A British citizenship exam for Ms. Markle. Thousands of immigrants take it each year, and many fail miserably. Could you ace the test? Take our quiz and find out."
## [6] "The president is trying to appease evangelical supporters and powerful Jewish donors even as he works to avoid derailing his administration’s peace efforts."
## [7] "Many of the journalists who stand accused of sexual harassment covered the 2016 presidential campaign."
## [8] "New York’s attorney general brought the charges, stemming from the shooting of a black motorist in Troy, against Rensselaer County D.A. Joel Abelove."
## [9] "The president plans to repeal protections on as much as two million acres of public land in Utah."
## [10] "Just another day at the Southeastern Conference. An athletic director fired, a $75 million coaching contract, and a postseason ban for Ole Miss."
## [11] "A by-no-means exhaustive list of the things our editors (and a few contributors) find interesting on a given week. "
## [12] "The city’s priciest sale last month was a penthouse occupying the entire 20th floor of the Norman Foster-designed condo at 551 West 21st Street."
## [13] "Secretary of State Rex W. Tillerson has been dogged for months by rumors he would resign but said any White House plan for him to resign was “laughable.”"
## [14] "“8980: Book of Travelers,” a song cycle based on conversations the songwriter had on a nearly 9,000-mile Amtrak journey, comes to BAM."
## [15] "Because the price to sign Ohtani will not be that prohibitive, many major league teams, even small-market ones, may want to get his attention."
## [16] "Romantic gifts from Andy Warhol to Jon Gould include what is believed to be one of the Pop artist’s last sculptures."
## [17] "New taxes are not the answer. A radical reorientation of their mission is."
## [18] "He joined Thor Heyerdahl in 1970 on the Ra II, just one of the adventures that turned a Brooklyn boy into an unconventional world traveler."
## [19] "The Hypocrites’ blithe production of the Gilbert and Sullivan classic offers the perfect restorative alternative to holiday drudgery."
## [20] "More than 20 years after visiting East Africa, I am still weighed down by the hunger I saw there. Today, millions of people are hungry again."
## [21] "The couple was set up by friends and were wed at Deerfield, a golf course in Newark, Del."
## [22] "Luis Rodriguez, a luxury real estate agent, and Ron Davis, a documentary filmmaker who made “Harry & Snowman,” wed Dec. 2 in Wellington, Fla."
## [23] "The couple met in July 2013 in New York while attending Grits and Biscuits, an event for young professionals."
## [24] "Everything you need to be healthier, wiser and more centered in the new year."
## [25] "An exhibition in Oxford, England, shows how the artist’s preoccupations with socialism, anti-fascism and a love of the land shaped her life and work."
## [26] "Corrections appearing in print on Friday, December 1, 2017."
## [27] "Because the price to sign Ohtani will not be that prohibitive, many major league teams, even small-market ones, may want to get his attention."
## [28] "New taxes are not the answer. A radical reorientation of their mission is."
## [29] "The 83-year-old emperor will step down on April 30, 2019, becoming the first Japanese monarch to do so in two centuries."
## [30] "Romantic gifts from Andy Warhol to Jon Gould include what is believed to be one of the Pop artist’s last sculptures."
## [31] "Corrections appearing in print on Friday, December 1, 2017."
## [32] "The 83-year-old emperor will step down on April 30, 2019, becoming the first Japanese monarch to do so in two centuries."
## [33] "The president plans to repeal protections on as much as two million acres of public land in Utah."
## [34] "Just another day at the Southeastern Conference. An athletic director fired, a $75 million coaching contract, and a postseason ban for Ole Miss."
## [35] "The party, which criticized the growth of the federal debt under President Barack Obama, has rallied behind a tax cut that would send it to new heights."
## [36] "The president is trying to appease evangelical supporters and powerful Jewish donors even as he works to avoid derailing his administration’s peace efforts."
## [37] "Many of the journalists who stand accused of sexual harassment covered the 2016 presidential campaign."
## [38] "Mark Diehl"
## [39] "New York’s attorney general brought the charges, stemming from the shooting of a black motorist in Troy, against Rensselaer County D.A. Joel Abelove."
## [40] "Filthy scary alien monster cyborg goth drag is in the club."
## [41] "New York’s attorney general brought the charges, stemming from the shooting of a black motorist in Troy, against Rensselaer County D.A. Joel Abelove."
## [42] "The president plans to repeal protections on as much as two million acres of public land in Utah."
## [43] "Just another day at the Southeastern Conference. An athletic director fired, a $75 million coaching contract, and a postseason ban for Ole Miss."
## [44] "In the Giants’ first game without Manning starting since 2004, the Geno Smith-led offense looked mostly inept in a loss to the Oakland Raiders."
## [45] "Mr. Mayer produced orchestral works, operas, chamber pieces, music for children and more, sometimes displaying a whimsical streak."
## [46] "We all lose because of the biases of Wall Street and Silicon Valley."
## [47] "Corrections appearing in print on Sunday, December 3, 2017."
## [48] "The couple met at New York University, from which they graduated, each magna cum laude."
## [49] "The couple was set up by friends and were wed at Deerfield, a golf course in Newark, Del."
## [50] "Luis Rodriguez, a luxury real estate agent, and Ron Davis, a documentary filmmaker who made “Harry & Snowman,” wed Dec. 2 in Wellington, Fla."Bigram Sentiment analysis on 2017 December data and igraph
#new_tibble <- enframe(nytimes_2018_Novarchive_12032019$response.docs.snippet[1:50], name = NULL)
my_frame2 <- data.frame(nytimes_2017_Decarchive_12072019$response.docs.snippet)
names(my_frame2) <- c('snippetcol')
nrow(my_frame2)## [1] 59391snippet_bigrams2 <- my_frame2 %>%
unnest_tokens(bigram, snippetcol, token = "ngrams", n = 2)
nrow(snippet_bigrams2)## [1] 1219121snippet_bigrams2 %>%
count(bigram, sort = TRUE)## # A tibble: 55,898 x 2
## bigram n
## <chr> <int>
## 1 of the 8118
## 2 in the 6534
## 3 on the 2808
## 4 to the 2763
## 5 new york 2556
## 6 at the 2439
## 7 in a 2331
## 8 for the 2304
## 9 and the 1962
## 10 and a 1665
## # ... with 55,888 more rowsbigrams_separated2 <- snippet_bigrams2 %>%
separate(bigram, c("word1", "word2"), sep = " ")
bigrams_filtered2 <- bigrams_separated2 %>%
filter(!word1 %in% stop_words$word) %>%
filter(!word2 %in% stop_words$word)
# new bigram counts:
bigram_counts2 <- bigrams_filtered2 %>%
count(word1, word2, sort = TRUE)
head(bigram_counts2)## # A tibble: 6 x 3
## word1 word2 n
## <chr> <chr> <int>
## 1 president trump 1062
## 2 sexual harassment 603
## 3 york times 594
## 4 president trump’s 585
## 5 tax bill 531
## 6 york city 477# filter for only relatively common combinations
bigram_graph2 <- bigram_counts2 %>%
filter(n > 70) %>%
graph_from_data_frame()
bigram_graph2## IGRAPH 6508548 DN-- 220 141 --
## + attr: name (v/c), n (e/n)
## + edges from 6508548 (vertex names):
## [1] president ->trump sexual ->harassment
## [3] york ->times president ->trump’s
## [5] tax ->bill york ->city
## [7] sexual ->misconduct corrections->appearing
## [9] white ->house couple ->met
## [11] social ->media trump ->administration
## [13] york ->times’s los ->angeles
## [15] climatetech->conference health ->care
## + ... omitted several edgesset.seed(2017)
ggraph(bigram_graph2, layout = "kk") +
geom_edge_link() +
geom_node_point() +
geom_node_text(aes(label = name), vjust = 1, hjust = 1)
#ggsave("bigramigraph1.pdf", bigramigraph1, dpi = 200)
set.seed(2016)
a <- grid::arrow(type = "closed", length = unit(.15, "inches"))
ggraph(bigram_graph2, layout = "kk") +
geom_edge_link(aes(edge_alpha = n), show.legend = FALSE,
arrow = a, end_cap = circle(.07, 'inches')) +
geom_node_point(color = "lightblue", size = 5) +
geom_node_text(aes(label = name), vjust = 1, hjust = 1) +
theme_void()
#ggsave("bigramigraph2.pdf", bigramigraph2, dpi = 200)
# length(nytimes_2018_Novarchive_12032019$response.docs.snippet)
# my_corpus <- corpus(nytimes_2018_Novarchive_12032019$response.docs.snippet)
# my_sentences <- corpus_reshape(my_corpus, to = "sentences")
# ndoc(my_sentences)
# texts(my_sentences)[1]MODEL LDA: Run a topic model using quant_Eda for topics = 20
length(nytimes_2018_Novarchive_12072019$response.docs.snippet)## [1] 40362my_corpus <- corpus(nytimes_2018_Novarchive_12072019$response.docs.snippet[1:10000])
quant_dfm <- dfm(my_corpus,
remove_punct = TRUE, remove_numbers = TRUE, remove = stopwords("english"))
quant_dfm <- dfm_trim(quant_dfm, min_termfreq = 4, max_docfreq = 10)
quant_dfm## Document-feature matrix of: 10,000 documents, 4,838 features (99.9% sparse).set.seed(100)
if (require(topicmodels)) {
my_lda_fit5 <- LDA(convert(quant_dfm, to = "topicmodels"), k = 20)
get_terms(my_lda_fit5, 10)
}## Topic 1 Topic 2 Topic 3 Topic 4
## [1,] "advantage" "<U+0645><U+0646>" "scored" "bit"
## [2,] "monument" "negotiating" "keeps" "damage"
## [3,] "similar" "interviews" "fortune" "threatened"
## [4,] "visit" "rent" "pasta" "swing"
## [5,] "kavanaugh" "communications" "nowhere" "dallas"
## [6,] "shifts" "delicate" "mode" "fourth"
## [7,] "arthur" "miller" "describes" "boards"
## [8,] "pita's" "preside" "tool" "honest"
## [9,] "dance-drama" "pbs" "eager" "arguments"
## [10,] "committed" "ease" "straight" "taste"
## Topic 5 Topic 6 Topic 7 Topic 8 Topic 9
## [1,] "vacation" "answer" "loud" "wildlife" "counts"
## [2,] "protested" "motorcycle" "broader" "motivated" "consensus"
## [3,] "essential" "hart" "extremism" "increasing" "escalating"
## [4,] "appearance" "style" "landslide" "blood" "association"
## [5,] "harm" "safer" "gay" "campus" "rocket"
## [6,] "strangers" "difference" "available" "spectacle" "brexit"
## [7,] "crimson" "engaging" "p.m" "bans" "delays"
## [8,] "walt" "unthinkable" "decisions" "deepening" "highlighted"
## [9,] "potent" "feared" "eighth" "creator" "goldman"
## [10,] "democracies" "reitman" "worker" "silence" "partnered"
## Topic 10 Topic 11 Topic 12 Topic 13 Topic 14
## [1,] "tiger" "long-term" "crow" "fewer" "apple"
## [2,] "buildings" "honor" "inaccurate" "high-profile" "mount"
## [3,] "incumbents" "swarming" "citizenship" "mississippi" "uncertain"
## [4,] "obstacles" "situation" "civilians" "cranberry" "amazing"
## [5,] "roundup" "soon-to-be" "psychiatrist" "waking" "lift"
## [6,] "menu" "positioned" "bronx" "foreigners" "anti-trump"
## [7,] "warm" "tense" "activism" "shootings" "waiting"
## [8,] "co-founder" "spain" "labor" "masks" "raise"
## [9,] "artistic" "peru" "gold" "scorched" "parliament"
## [10,] "selected" "gap" "stake" "broad" "baltimore"
## Topic 15 Topic 16 Topic 17 Topic 18
## [1,] "boy" "applications" "doctor" "newsom"
## [2,] "corruption" "beierle" "tenor" "feelings"
## [3,] "charter" "identifying" "expanded" "1970s"
## [4,] "jones" "involuntary" "insisted" "guy"
## [5,] "allows" "celibates" "20th-century" "ultimate"
## [6,] "ambitions" "railing" "blight" "ongoing"
## [7,] "ministers" "interracial" "spitz" "generous"
## [8,] "jail" "b" "comeback" "dissident"
## [9,] "sexually" "rice" "pianist" "cyber"
## [10,] "redrawn" "felt" "reaching" "wine"
## Topic 19 Topic 20
## [1,] "club's" "leg"
## [2,] "apparently" "galas"
## [3,] "revival" "installed"
## [4,] "achievements" "spicy"
## [5,] "settled" "fx"
## [6,] "op-ed" "governments"
## [7,] "propaganda" "inner"
## [8,] "register" "weird"
## [9,] "reviews" "contradictory"
## [10,] "targeted" "bus"topics <- tidy(my_lda_fit5, matrix = "beta")
topics## # A tibble: 96,760 x 3
## topic term beta
## <int> <chr> <dbl>
## 1 1 wellness 1.13e-321
## 2 2 wellness 4.80e-322
## 3 3 wellness 4.55e-322
## 4 4 wellness 9.00e-322
## 5 5 wellness 2.94e- 3
## 6 6 wellness 8.55e-322
## 7 7 wellness 2.87e-311
## 8 8 wellness 6.95e-322
## 9 9 wellness 1.04e-321
## 10 10 wellness 1.02e-321
## # ... with 96,750 more rowstop_terms <- topics %>%
group_by(topic) %>%
top_n(5, beta) %>%
ungroup() %>%
arrange(topic, -beta)
top_terms %>%
mutate(term = reorder_within(term, beta, topic)) %>%
ggplot(aes(term, beta, fill = factor(topic))) +
geom_col(show.legend = FALSE) +
facet_wrap(~ topic, scales = "free") +
coord_flip() +
scale_x_reordered()
#ggsave("topicplot.pdf",topicplot, dpi = 300) Error running a cluster dendoogram
Trying to run a cluster dendogram but unable to resolve errors on NaN errors , unsure how to resovle these on the corpus. Intention was to show a dendogram.
# quant_dfm <- dfm(my_corpus,
# remove_punct = TRUE, remove_numbers = TRUE, remove = stopwords("english"))
# quant_dfm <- dfm_trim(quant_dfm, min_termfreq = 4, max_docfreq = 10)
# quant_dfm1 <- dfm_smooth(quant_dfm, smoothing =1)
#
#
# # hierarchical clustering - get distances on normalized dfm
# quant_dfm_mat1 <- dfm_weight(quant_dfm1,scheme = "prop") %>%
# textstat_dist(method = "euclidean") %>%
# as.dist()
#
# dfm_smooth(quant_dfm_mat, smoothing =1)
#
#
#
# quant_dfm_new <- NaRV.omit(as.matrix(quant_dfm_mat))
# head(quant_dfm_new )
#
# quant_dfm1 <- as.matrix(quant_dfm_mat, )
# quant_dfm1[2]
# nrow(quant_dfm1)
#
# # hiarchical clustering the distance object;100
# quant_dfm_cluster <- hclust(quant_dfm_mat)
#
# # label with document names
# quant_dfm_cluster$labels <- docnames(quant_dfm_cluster)
#
# # plot as a dendrogram
# plot(quant_dfm_cluster, xlab = "", sub = "",
# main = "Euclidean Distance on Normalized Token Frequency")
#
#
# dd <- hclust(as.matrix(quant_dfm_mat))Conclusions
ANALYSIS 1 SECTION
The correlation coefficient is 0.5788396. We see a positive linear relationship therefore we can hypothesize that their may be significant relationship between the two variables such that as the Mean scale score increases the Percentage of students with reduced lunches increases as well. From this analysis we see that my assumption was incorrect. This actually shows the opposite trend.
Now we can look into the p-value to determine if the difference in significant.My NULL hypothesis is that there is no statistical significance between the two variables.
WE can see the linear line below and the statistical analysis.
-Our p value is 0.000519 which is below .05 therefore we have strong evidence against the null hypothesis. To conclude we can say that their is a statistical significance between the two variables.My Analysis was very limited as it only included a small dataset.
ANALYSIS 2 SECTION:
Extracting data from NYtimes API, learning how to extract page wise data and building corpus from it was challenging. Also running an LDA topic model and fit needs to be explored better. On further reading the way all the articles were combined and read in across an entire month to understand topics might not be the right approach. Segmenting monthly articles retrieved and doing a gamma distribution a analysis on the LDA fit graph to do more analyis on topic terms and mismatch would be a better analyis in the future. Upon reviewing the frequency of terms related to me too, based on sentiment and bigram analysis the presence of this term within the NYtimes articles retrieved was not significant compared to topics related to Present Trump within the period of October 2018 or October, November, December 2017. The height of the Me too movement was in October 2017 so I expected to see possibly more on the wordcloud or articles circulated and shared on NYtimes related to this topic. Possibly another option would be to retrieve 100 max pages from the API as opposed to only 8 pages which by itself retrieved created a large corpus. So, the next method to choose would be through twitter which may have better data if searched on celebrities and specifically the #metoo related to the metoo movement. Also we scrapped the Wikipedia metoo main page and bigram analysis conducted on that and data stored in neo4j for future relationship (PART2).
Works Cited
Textmining with R https://www.tidytextmining.com/ https://developer.nytimes.com/apis