SNA Grad Seminar, Fall 2017 Due: October 24th, 11:59 pm Name of Student:

The purpose of this lab is to develop your familiarity conducting descriptive network analysis using the statistical software package R. This assignment will make use of a data set you collect by defining a search query (a collection of your user-defined search terms) from the New York Times’s Article Search Application Programming Interface. Networks are generated from the co-occurrences between search terms included in the same search query. For example, a link exists between “apple” and “orange” if there are articles in the New York Times that contained these two terms. You will be visualizing and interpreting individual and global network properties of this network.

You will be graded primarily on the completeness and accuracy of your responses, but the clarity of the prepared report will also affect your grade. While students may work together to perform the analysis, each student must submit his or her own report and is responsible for writing the narrative in the report. You must answer all of the bolded questions.

Part 1: Collect Network Data (20 pts)

For this lab, you will search the New York Times, save that data, create networks from that data, compare the differences among networks, and demonstrate your proficiency with basic network descriptive statistics.

Loading and Installing Packages, Set Working Directory

When working with R, you should run each line of code individually, unless it is part of a function definition, so you can see the results. Generally speaking, any line of code that includes ‘{’ (the beginning of a function definition) should be run with all the other lines until you hit ‘}’.

# Lines that start with a hashtag/pound symbol, like this one, are comment lines. Comment lines are ignored by R when it is interpreting code.
# You only need to install packages once. Remove the # in front of each line and then run it to install each package. After successful installation, delete the line of code or replace the #s so the R Notebook doesn't run into problems.
# install.packages('magrittr', repos = "https://cran.rstudio.com")
# install.packages('igraph', repos = "https://cran.rstudio.com")
# install.packages('httr', repos = "https://cran.rstudio.com")
# install.packages('data.table', repos = "https://cran.rstudio.com")
# install.packages('dplyr', repos = "https://cran.rstudio.com")
# install.packages('xml2', repos = "https://cran.rstudio.com")
# You need to load packages every time you run the script or restart R.
library(magrittr)
library(httr)
library(data.table)
library(igraph)
library(dplyr)
library(xml2)
# Set your directory for the project
# You can either enter your filename path within the parentheses below and remove the # creating the comment, or select "Session > Set Working Directory ... Source File Location" in R Studio.
# setwd("Input Directory")

Choose a topic for your search terms

You can decide search terms based on personal interests, research interests, or popular topical areas, among others. You have flexibility in selecting your search term list. For example, you can search for some commercial brands, celebrities, countries, universities, etc. It will be most useful if you choose a collection of words that are not all extremely common. Think about a set of words that might have interesting co-occurrences in articles within the New York Times website. For example, you might be interested in the last names of every Senator involved in a certain political debate, football teams, or cities and their co-occurrence in news articles. Generally speaking, proper nouns are best, but you might have compelling reasons to choose verbs or adjectives. You might want to throw a couple of terms in that aren’t thematically related to make sure you don’t get a totally connected component. The more interesting your network is in terms of differing centrality, distinct components, etc., the easier it will be to do the written analysis. Keep in mind that the Article Search archive is very large; many terms co-occur. You might want to consider two tenuously related subjects. The example file uses four football teams and their home senators, plus a few topical terms.

Create your text input

Create a plain text file with .txt extension in the same directory as the R Markdown Notebook used in this assignment. Make a note of the file name for use in the next code snippet. Place one search term per line, and use 15–20 terms. You’ll also likely want to add quotation marks around your search terms to ensure that you’re only receiving results for the complete term. NOTE: The function will process your terms so that they work in the URL request. You do not need to encode non-alphabetic characters.

The text file cannot include any additional information or characters and it must be a .txt file; Word or RTF documents won’t work.

Analysis

a. Provide a high level overview of the terms you included in the search query.

b. Why did you choose this collection of terms? Were there some specific overarching question—intellectual or extracurricular curiosity—that motivated this collection of terms?

c. How did you decide which terms to use in the search query? Were these terms you intuitively deemed important? Were they culled from a specific source or the result of some separate analysis or search query?

d. What are the insights you hope to glean by looking at the network of terms in terms of individual node metrics, sub-grouping of nodes, overall global network properties?

Working with the API to Collect Your Data

The New York Times controls access to its API by assigning each user a key. Each key has a limited number of calls that can be made within a certain time period. You can read more about the limitations of the API system here.

You will need to create your own API key to complete this assignment. Go to the New York Times developers page and request a key. You will copy that key (received via email) into the api variable below.

# Import your word list
name_of_file <- "NFL.txt" # Creates a variable called name_of_file that you should populate with the name of your text file between quotation marks.
word_list <- read.table(name_of_file, sep = "\n", stringsAsFactors = F) %>% unlist %>% as.vector # Reads the content of your file into a variable.
num_words <- length(word_list) # Creates a variable with the number of words in your list.
url_base <- "https://api.nytimes.com/svc/search/v2/articlesearch.json"
# When you receive the email with your API key, paste it below between the quotation marks.
api <- '4682842fdaf244d2b7b3470c77a2c943'

Our first function will gather all of the search terms and their number of hits to be placed in a table. All lines of a function should be run together.

Get_hits_one <- function(keyword1) {
  Sys.sleep(time=3)
  url <- paste0(url_base, "?api-key=", api, "&q=", URLencode(keyword1),"&begin_date=","20160101") # Begin date is in format YYYYMMDD; you can change it if you want only more recent results, for example.
  # The number of results
  print(keyword1)
  hits <- content(GET(url))$response$meta$hits %>% as.numeric
  print(hits)
  # Put results in table
  c(SearchTerm=keyword1,ResultsTotal=hits)
}

Now we will invoke our function to put information from the API into our global environment.

#Create a table of your words and their number of results.
total_table <- t(sapply(word_list,Get_hits_one))
[1] "“New Orleans Saints”"
[1] 163
[1] "“Steve Scalise”"
[1] 96
[1] "“Sen. Bill Cassidy”"
[1] 8
[1] "“Tampa Bay Buccaneers”"
[1] 143
[1] "“Sen. Bill Nelson”"
[1] 7
[1] "“Sen. Marco Rubio”"
[1] 52
[1] "“Carolina Panthers”"
[1] 312
[1] "“Sen. Lindsey Graham”"
[1] 18
[1] "“Sen. Tim Scott”"
[1] 3
[1] "“Atlanta Falcons”"
[1] 238
[1] "“Sen. Johnny Isakson”"
[1] 2
[1] "“Sen. David Perdue”"
[1] 3
[1] "“Roger Goodell”"
[1] 225
[1] "“Donald Trump”"
[1] 9675
[1] "“Colin Kaepernick”"
[1] 395
total_table <- as.data.frame(total_table)
total_table$ResultsTotal <- as.numeric(as.character(total_table$ResultsTotal))

If you get zero hits for any of these terms, you should substitute that term for somethign else and rerun the lab up to this point. Next, we will define the function that will collect the article co-occurences network.

Get_hits_two <- function(row_input) {
  keyword1 <- row_input[1]
  keyword2 <- row_input[2]
  url <- paste0(url_base, "?api-key=", api, "&q=", keyword1,"+", keyword2,"&begin_date=","20100101")
  # The number of results
  print(paste0(keyword1," ",keyword2)) 
  hits <- content(GET(url))$response$meta$hits %>% as.numeric
  print(hits)
  Sys.sleep(time=3)
  # Put results in table
  c(SearchTerm1=keyword1,SearchTerm2=keyword2,CoOccurrences=hits)
} 

In this next step, we will call the API and collect the co-occurrence network. This may take some time. If you receive “numeric(0)” in any of your resposnes, you’ve likely hit your API key limit and will either need to wait for the calls to reset (24 hours) or request a new key. If you receive the error message “$ operator is invalid for atomic vectors,” you have also hit the API call limit. This could be due to running the script multiple times, or due to hitting too many results based on very common search terms. Request a new API, shorten your word list, and try again. Don’t forget you need to reload your word list from the first part of the Lab in order to get a different set of results! You must also rerun the functions to reassign the API value. If none of your results come back as “0,” you might want to redo your search with the appropriate words.

pairs_list <- expand.grid(word_list,word_list) %>% filter(Var1 != Var2)
pairs_list <- t(combn(word_list,2))
#Create a network table, run the Get_hits_two function using the pairs lists
network_table <- t(apply(pairs_list,1,Get_hits_two))
[1] "“New Orleans Saints” “Steve Scalise”"
[1] 0
[1] "“New Orleans Saints” “Sen. Bill Cassidy”"
[1] 0
[1] "“New Orleans Saints” “Tampa Bay Buccaneers”"
[1] 49
[1] "“New Orleans Saints” “Sen. Bill Nelson”"
[1] 0
[1] "“New Orleans Saints” “Sen. Marco Rubio”"
[1] 0
[1] "“New Orleans Saints” “Carolina Panthers”"
[1] 57
[1] "“New Orleans Saints” “Sen. Lindsey Graham”"
[1] 0
[1] "“New Orleans Saints” “Sen. Tim Scott”"
[1] 0
[1] "“New Orleans Saints” “Atlanta Falcons”"
[1] 56
[1] "“New Orleans Saints” “Sen. Johnny Isakson”"
[1] 0
[1] "“New Orleans Saints” “Sen. David Perdue”"
[1] 0
[1] "“New Orleans Saints” “Roger Goodell”"
[1] 11
[1] "“New Orleans Saints” “Donald Trump”"
[1] 2
[1] "“New Orleans Saints” “Colin Kaepernick”"
[1] 15
[1] "“Steve Scalise” “Sen. Bill Cassidy”"
[1] 1
[1] "“Steve Scalise” “Tampa Bay Buccaneers”"
[1] 0
[1] "“Steve Scalise” “Sen. Bill Nelson”"
[1] 1
[1] "“Steve Scalise” “Sen. Marco Rubio”"
[1] 1
[1] "“Steve Scalise” “Carolina Panthers”"
[1] 0
[1] "“Steve Scalise” “Sen. Lindsey Graham”"
[1] 0
[1] "“Steve Scalise” “Sen. Tim Scott”"
[1] 0
[1] "“Steve Scalise” “Atlanta Falcons”"
[1] 0
[1] "“Steve Scalise” “Sen. Johnny Isakson”"
[1] 0
[1] "“Steve Scalise” “Sen. David Perdue”"
[1] 0
[1] "“Steve Scalise” “Roger Goodell”"
[1] 0
[1] "“Steve Scalise” “Donald Trump”"
[1] 21
[1] "“Steve Scalise” “Colin Kaepernick”"
[1] 0
[1] "“Sen. Bill Cassidy” “Tampa Bay Buccaneers”"
[1] 0
[1] "“Sen. Bill Cassidy” “Sen. Bill Nelson”"
[1] 0
[1] "“Sen. Bill Cassidy” “Sen. Marco Rubio”"
[1] 0
[1] "“Sen. Bill Cassidy” “Carolina Panthers”"
[1] 0
[1] "“Sen. Bill Cassidy” “Sen. Lindsey Graham”"
[1] 0
[1] "“Sen. Bill Cassidy” “Sen. Tim Scott”"
[1] 1
[1] "“Sen. Bill Cassidy” “Atlanta Falcons”"
[1] 0
[1] "“Sen. Bill Cassidy” “Sen. Johnny Isakson”"
[1] 0
[1] "“Sen. Bill Cassidy” “Sen. David Perdue”"
[1] 0
[1] "“Sen. Bill Cassidy” “Roger Goodell”"
[1] 0
[1] "“Sen. Bill Cassidy” “Donald Trump”"
[1] 3
[1] "“Sen. Bill Cassidy” “Colin Kaepernick”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Sen. Bill Nelson”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Sen. Marco Rubio”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Carolina Panthers”"
[1] 65
[1] "“Tampa Bay Buccaneers” “Sen. Lindsey Graham”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Sen. Tim Scott”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Atlanta Falcons”"
[1] 53
[1] "“Tampa Bay Buccaneers” “Sen. Johnny Isakson”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Sen. David Perdue”"
[1] 0
[1] "“Tampa Bay Buccaneers” “Roger Goodell”"
[1] 6
[1] "“Tampa Bay Buccaneers” “Donald Trump”"
[1] 2
[1] "“Tampa Bay Buccaneers” “Colin Kaepernick”"
[1] 14
[1] "“Sen. Bill Nelson” “Sen. Marco Rubio”"
[1] 2
[1] "“Sen. Bill Nelson” “Carolina Panthers”"
[1] 0
[1] "“Sen. Bill Nelson” “Sen. Lindsey Graham”"
[1] 1
[1] "“Sen. Bill Nelson” “Sen. Tim Scott”"
[1] 0
[1] "“Sen. Bill Nelson” “Atlanta Falcons”"
[1] 0
[1] "“Sen. Bill Nelson” “Sen. Johnny Isakson”"
[1] 0
[1] "“Sen. Bill Nelson” “Sen. David Perdue”"
[1] 0
[1] "“Sen. Bill Nelson” “Roger Goodell”"
[1] 0
[1] "“Sen. Bill Nelson” “Donald Trump”"
[1] 1
[1] "“Sen. Bill Nelson” “Colin Kaepernick”"
[1] 0
[1] "“Sen. Marco Rubio” “Carolina Panthers”"
[1] 0
[1] "“Sen. Marco Rubio” “Sen. Lindsey Graham”"
[1] 1
[1] "“Sen. Marco Rubio” “Sen. Tim Scott”"
[1] 0
[1] "“Sen. Marco Rubio” “Atlanta Falcons”"
[1] 0
[1] "“Sen. Marco Rubio” “Sen. Johnny Isakson”"
[1] 0
[1] "“Sen. Marco Rubio” “Sen. David Perdue”"
[1] 0
[1] "“Sen. Marco Rubio” “Roger Goodell”"
[1] 0
[1] "“Sen. Marco Rubio” “Donald Trump”"
[1] 29
[1] "“Sen. Marco Rubio” “Colin Kaepernick”"
[1] 0
[1] "“Carolina Panthers” “Sen. Lindsey Graham”"
[1] 0
[1] "“Carolina Panthers” “Sen. Tim Scott”"
[1] 0
[1] "“Carolina Panthers” “Atlanta Falcons”"
[1] 59
[1] "“Carolina Panthers” “Sen. Johnny Isakson”"
[1] 0
[1] "“Carolina Panthers” “Sen. David Perdue”"
[1] 0
[1] "“Carolina Panthers” “Roger Goodell”"
[1] 18
[1] "“Carolina Panthers” “Donald Trump”"
[1] 10
[1] "“Carolina Panthers” “Colin Kaepernick”"
[1] 37
[1] "“Sen. Lindsey Graham” “Sen. Tim Scott”"
[1] 0
[1] "“Sen. Lindsey Graham” “Atlanta Falcons”"
[1] 0
[1] "“Sen. Lindsey Graham” “Sen. Johnny Isakson”"
[1] 0
[1] "“Sen. Lindsey Graham” “Sen. David Perdue”"
[1] 0
[1] "“Sen. Lindsey Graham” “Roger Goodell”"
[1] 0
[1] "“Sen. Lindsey Graham” “Donald Trump”"
[1] 13
[1] "“Sen. Lindsey Graham” “Colin Kaepernick”"
[1] 0
[1] "“Sen. Tim Scott” “Atlanta Falcons”"
[1] 0
[1] "“Sen. Tim Scott” “Sen. Johnny Isakson”"
[1] 0
[1] "“Sen. Tim Scott” “Sen. David Perdue”"
[1] 0
[1] "“Sen. Tim Scott” “Roger Goodell”"
[1] 0
[1] "“Sen. Tim Scott” “Donald Trump”"
[1] 0
[1] "“Sen. Tim Scott” “Colin Kaepernick”"
[1] 0
[1] "“Atlanta Falcons” “Sen. Johnny Isakson”"
[1] 0
[1] "“Atlanta Falcons” “Sen. David Perdue”"
[1] 0
[1] "“Atlanta Falcons” “Roger Goodell”"
[1] 19
[1] "“Atlanta Falcons” “Donald Trump”"
[1] 8
[1] "“Atlanta Falcons” “Colin Kaepernick”"
[1] 18
[1] "“Sen. Johnny Isakson” “Sen. David Perdue”"
[1] 0
[1] "“Sen. Johnny Isakson” “Roger Goodell”"
[1] 0
[1] "“Sen. Johnny Isakson” “Donald Trump”"
[1] 1
[1] "“Sen. Johnny Isakson” “Colin Kaepernick”"
[1] 0
[1] "“Sen. David Perdue” “Roger Goodell”"
[1] 0
[1] "“Sen. David Perdue” “Donald Trump”"
[1] 1
[1] "“Sen. David Perdue” “Colin Kaepernick”"
[1] 0
[1] "“Roger Goodell” “Donald Trump”"
[1] 29
[1] "“Roger Goodell” “Colin Kaepernick”"
[1] 49
[1] "“Donald Trump” “Colin Kaepernick”"
[1] 61
#Convert the network table into a dataframe
network_table <- as.data.frame(network_table)

Analysis

Is the graph directed or undirected?

How many nodes and links does your network have?

numVertices <- vcount(g_valued)
numVertices
[1] 15
numEdges <- ecount(g_valued)
numEdges
[1] 35

What is the number of possible links in your network?

maxEdges <- numVertices*(numVertices-1)/2
maxEdges
[1] 105

What is the density of your network?

graphDensity <- numEdges/maxEdges # manual calculation
graphDensity
[1] 0.3333333
graphDensity1 <- graph.density(g_valued) # using the graph.density function from igraph
graphDensity1
[1] 0.3333333

Briefly describe how your choice of dataset may influence your findings. What differences would you expect if you use different search terms? Are the current search terms related to one another? If so, how? Do you think the limitation to one word might skew your answers? (i.e. if you’re interested in Hillary Clinton, but you include “Clinton” as a term, you will get stories that mention Chelsea, Bill, & even P-Funk Allstar George Clinton).

Part 2: Visualize Your Network (20 points)

Let’s start by visualizing the network that we’ve collected from the New York Times Article Search API. We’ll need to choose node colors and set a layout. You can learn more about Fruchterman Reingold layout and other layouts here.

Analysis

In a paragraph, describe the macro-level structure of your graphs based on the Fruchterman Reingold visualization. Is it a giant, connected component, are there distinct sub-components, or are there isolated components? Can you recognize common features of the subcomponents? Does this visualization give you any insight into the co-occurrence patterns of the search-terms? If yes, what? If not, why?

Now we’ll create a second visualization using a different layout.

Analysis

In a paragraph, compare and contrast the information given to you by the two different layouts.

Part 3: Community Detection Analysis with R (20 Points)

Identifying subgroups within a network is of great interest to social network researchers, so a variety of algorithms have been developed to identify and measure subgroups. We will use some of R’s built-in tools to identify subgroups and central nodes for visual inspection.

For the remainder of the visualizations we will use the Fruchterman Reingold layout.

L = layout_with_fr(g_valued) 

Cluster the nodes in your network.

cluster <- cluster_walktrap(g_valued)
# Find the number of clusters
membership(cluster)   # affiliation list
  “New Orleans Saints”        “Steve Scalise”    “Sen. Bill Cassidy” “Tampa Bay Buccaneers”     “Sen. Bill Nelson” 
                     3                      1                      2                      3                      1 
    “Sen. Marco Rubio”    “Carolina Panthers”  “Sen. Lindsey Graham”       “Sen. Tim Scott”      “Atlanta Falcons” 
                     1                      3                      1                      2                      3 
 “Sen. Johnny Isakson”    “Sen. David Perdue”        “Roger Goodell”         “Donald Trump”     “Colin Kaepernick” 
                     1                      1                      3                      1                      3 
length(sizes(cluster)) # number of clusters
[1] 3
# Find the size the each cluster 
# Note that communities with one node are isolates, or have only a single tie
sizes(cluster) 
Community sizes
1 2 3 
7 2 6 

How many communities have been created?

How many nodes are in each community? In networks containing node attribute information, we can often gain insight into a network by looking at the nodes that get placed in the same partition. For your network, what might each cluster of nodes potentially have in common? Describe each cluster, its membership, and the relationship between nodes in the cluster. Next we visualize the clusters by coloring nodes according to their modularity class.

What information does this layout convey? Are the clusters well-separated, or is there a great deal of overlap? Is it easier to identify the common themes among clusters in this layout rather than looking only at the graphs?

What differences are there between nodes in the same cluster and across clusters?

Describe the brokers between any components and cliques. What are common features of these brokers? About how many brokers would you have to remove from your network to “shatter” it into two or more disconnected components?

Part 4: Centrality Visualization & Weighted Values (20 Points)

For each network, you will use centrality metrics to improve your visualization. You may need to adjust the size parameter to make your network more easily visible.

Degree Centrality

totalDegree <- degree(g_valued,mode="all")
sort(totalDegree,decreasing=TRUE)[1:5]
        “Donald Trump”   “New Orleans Saints” “Tampa Bay Buccaneers”    “Carolina Panthers”      “Atlanta Falcons” 
                    13                      6                      6                      6                      6 
g2 <- g_valued
V(g2)$size <- totalDegree*2 #can adjust the number if nodes are too big
plot(g2, layout = L, vertex.label=NA)

Briefly explain degree centrality and why nodes are more or less central in the network.

Weighted Degree Centrality

wd <- graph.strength(g_valued,weights = E(g_valued)$CoOccurrences)
sort(wd,decreasing=TRUE)[1:5]
   “Carolina Panthers”      “Atlanta Falcons”     “Colin Kaepernick”   “New Orleans Saints” “Tampa Bay Buccaneers” 
                   246                    213                    194                    190                    189 
wg2 <- g_valued
V(wg2)$size <- wd*.1 # adjust the number if nodes are too big
plot(wg2, layout = L, vertex.label=NA, edge.width=sqrt(E(g_valued)$CoOccurrences)) #taking the square root is a good way to make a large range of numbers visible in an edge.

What does the addition of weighted degree and edge information tell you about your graph?

Betweenness Centrality

b <- betweenness(g_valued,directed=TRUE)
sort(b,decreasing=TRUE)[1:5]
     “Donald Trump” “Sen. Bill Cassidy”     “Steve Scalise”  “Sen. Bill Nelson”  “Sen. Marco Rubio” 
         65.3333333          13.0000000           2.0000000           0.3333333           0.3333333 
g4 <- g_valued
V(g4)$size <- b*1.2#can adjust the number
plot(g4, layout = L, vertex.label=NA)

Briefly explain betweenness centrality and why nodes are more or less central in the network.

Weighted Betweenness Centrality

wbtwn <- betweenness(g_valued,weights = E(g_valued)$CoOccurrences)
sort(wbtwn,decreasing=TRUE)[1:5]
        “Donald Trump”     “Sen. Bill Nelson” “Tampa Bay Buccaneers”        “Steve Scalise”    “Sen. Bill Cassidy” 
              70.50000               37.50000               22.50000               18.33333               13.00000 
wBtwnG <- g_valued
V(wBtwnG)$size <- wbtwn*.5 # adjust the number if nodes are too big
plot(wBtwnG, layout = L, vertex.label=NA, edge.width=sqrt(E(g_valued)$CoOccurrences)) #taking the square root is a good way to make a large range of numbers visible in an edge.

What does the addition of weighted degree and edge information tell you about your graph?

Closeness Centrality

c <- closeness(g_valued)
sort(c,decreasing=TRUE)[1:5]
        “Donald Trump”   “New Orleans Saints” “Tampa Bay Buccaneers”    “Carolina Panthers”      “Atlanta Falcons” 
            0.06666667             0.04347826             0.04347826             0.04347826             0.04347826 
g5 <- g_valued
V(g5)$size <- c*500  #can adjust the number
plot(g5, layout = L, vertex.label=NA)

Briefly explain closeness centrality and why nodes are more or less central in the network.

Weighted Closeness Centrality

wClsnss <- closeness(g_valued,weights = E(g_valued)$CoOccurrences)
sort(wClsnss,decreasing=TRUE)[1:5]
       “Donald Trump”    “Sen. Bill Nelson”       “Steve Scalise” “Sen. Johnny Isakson”   “Sen. David Perdue” 
           0.01587302            0.01515152            0.01369863            0.01315789            0.01315789 
wClsnssG <- g_valued
V(wClsnssG)$size <- wClsnss*1000 # adjust the number if nodes are too big
plot(wClsnssG, layout = L, vertex.label=NA, edge.width=sqrt(E(g_valued)$CoOccurrences)) #taking the square root is a good way to make a large range of numbers visible in an edge.

What does the addition of weighted degree and edge information tell you about your graph?

Eigenvector Centrality

eigc <- eigen_centrality(g_valued,directed=TRUE)
sort(eigc$vector,decreasing=TRUE)[1:5]
        “Donald Trump” “Tampa Bay Buccaneers”    “Carolina Panthers”        “Roger Goodell”     “Colin Kaepernick” 
             1.0000000              0.7745642              0.7745642              0.7745642              0.7745642 
g6 <- g_valued
V(g6)$size <- eigc$vector*50 #can adjust the number
plot(g6, layout = L, vertex.label=NA)

Briefly explain eigenvector centrality and why nodes are more or less central in the network.

Analysis

Choose the visualization that you think is most interesting and briefly explain what it tells you about a central node in your network. Discuss the type of centrality, and what that node’s centrality score tells you about the search co-occurrence network.

Briefly discuss an interesting difference between types of centrality for your network.

Global Network Metrics with R

Compute the network centralization scores for your network for degree, betweenness, closeness, and eigenvector centrality.

centralization.evcent(g_valued,normalized = TRUE)
$vector
 [1] 0.77456419 0.28452963 0.20947656 0.77456419 0.29025659 0.29025659 0.77456419 0.25123207 0.03329756 0.77456419 0.15895601
[12] 0.15895601 0.77456419 1.00000000 0.77456419

$value
[1] 6.291049

$options
$options$bmat
[1] "I"

$options$n
[1] 15

$options$which
[1] "LA"

$options$nev
[1] 1

$options$tol
[1] 0

$options$ncv
[1] 0

$options$ldv
[1] 0

$options$ishift
[1] 1

$options$maxiter
[1] 1000

$options$nb
[1] 1

$options$mode
[1] 1

$options$start
[1] 1

$options$sigma
[1] 0

$options$sigmai
[1] 0

$options$info
[1] 0

$options$iter
[1] 2

$options$nconv
[1] 1

$options$numop
[1] 11

$options$numopb
[1] 0

$options$numreo
[1] 8


$centralization
[1] 0.5904349

$theoretical_max
[1] 13

Record the centralization score of each centrality measure.

Briefly explain what the centralization of a network is.

Compare the centralization scores above with the graphs you created where the nodes are scaled by centrality. Describe the appearance of more centralized v. less centralized networks.

Part 5. Power Laws & Small Worlds (20)

Power Laws

Networks often demonstrate power law distributions. Plot the degree distribution of the nodes in your base graph.

# Calculate degree distribution
deg <- degree(g_valued,v=V(g_valued), mode="all")
deg
  “New Orleans Saints”        “Steve Scalise”    “Sen. Bill Cassidy” “Tampa Bay Buccaneers”     “Sen. Bill Nelson” 
                     6                      4                      3                      6                      4 
    “Sen. Marco Rubio”    “Carolina Panthers”  “Sen. Lindsey Graham”       “Sen. Tim Scott”      “Atlanta Falcons” 
                     4                      6                      3                      1                      6 
 “Sen. Johnny Isakson”    “Sen. David Perdue”        “Roger Goodell”         “Donald Trump”     “Colin Kaepernick” 
                     1                      1                      6                     13                      6 
# Degree distribution is the cumulative frequency of nodes with a given degree
deg_distr <-degree.distribution(g_valued, cumulative=T, mode="all")
deg_distr
 [1] 1.00000000 1.00000000 0.80000000 0.80000000 0.66666667 0.46666667 0.46666667 0.06666667 0.06666667 0.06666667 0.06666667
[12] 0.06666667 0.06666667 0.06666667
plot(deg_distr, ylim=c(.01,10), bg="black",pch=21, xlab="Degree", ylab="Cumulative Frequency")

Test whether it’s approximately a power law, estimate log f (k) = log a − c log k. “This says that if we have a power-law relationship, and we plot log f (k) as a function of log k, then we should see a straight line: −c will be the slope, and log a will be the y-intercept. Such a “log-log” plot thus provides a quick way to see if one’s data exhibits an approximate power-law: it is easy to see if one has an approximately straight line, and one can read off the exponent from the slope.” (E&K, Chapter 18, p.546).

power <- power.law.fit(deg_distr)
power
$continuous
[1] TRUE

$alpha
[1] 3.069992

$xmin
[1] 0.4666667

$logLik
[1] 1.343847

$KS.stat
[1] 0.2920275

$KS.p
[1] 0.502511
plot(deg_distr, log="xy", ylim=c(.01,10), bg="black",pch=21, xlab="Degree", ylab="Cumulative Frequency")

Does your network exhibit a power law distribution of degree centrality?

Small Worlds

Networks often demonstrate small world characteristics. Compute the average clustering coefficient (ACC) and the characteristic path length (CPL).

# Average clustering coefficient (ACC)
transitivity(g_valued, type = c("average"))
[1] 0.8279915
# Characteristic path length (CPL)
average.path.length(g_valued)
[1] 1.771429

Compute the ACC and CPL for 100 random networks with the same number of nodes and ties as your test network.

accSum <- 0
cplSum <- 0
for (i in 1:100){
  grph <- erdos.renyi.game(numVertices, numEdges, type = "gnm")
  accSum <- accSum + transitivity(grph, type = c("average"))
  cplSum <- cplSum + average.path.length(grph)
}
accSum/100
[1] 0.3488651
cplSum/100
[1] 1.804484

Based on these data, would you conclude that the observed network demonstrates small world properties? Why or why not?

Wrapping up

To complete the lab, make sure output/previews have been generated for each block of code. Then click the “Publish” button on the upper right hand corner of this screen and sign up for an RPubs account. Submit the URL of the published, completed lab on Canvas.

LS0tCnRpdGxlOiAnRGVzY3JpcHRpdmUgQW5hbHl0aWMgRXhlcmNpc2UgMTogVmlzdWFsaXppbmcgYW5kIEludGVycHJldGluZyBOZXR3b3JrcycKb3V0cHV0OgogIGh0bWxfbm90ZWJvb2s6IGRlZmF1bHQKICBodG1sX2RvY3VtZW50OiBkZWZhdWx0CiAgcGRmX2RvY3VtZW50OiBkZWZhdWx0CiAgd29yZF9kb2N1bWVudDogZGVmYXVsdAotLS0KKipTTkEgR3JhZCBTZW1pbmFyLCBGYWxsIDIwMTcqKgoqKkR1ZToqKiBPY3RvYmVyIDI0dGgsIDExOjU5IHBtCioqTmFtZSBvZiBTdHVkZW50Kio6IAoKVGhlIHB1cnBvc2Ugb2YgdGhpcyBsYWIgaXMgdG8gZGV2ZWxvcCB5b3VyIGZhbWlsaWFyaXR5IGNvbmR1Y3RpbmcgZGVzY3JpcHRpdmUgbmV0d29yayBhbmFseXNpcyB1c2luZyB0aGUgc3RhdGlzdGljYWwgc29mdHdhcmUgcGFja2FnZSBSLiBUaGlzIGFzc2lnbm1lbnQgd2lsbCBtYWtlIHVzZSBvZiBhIGRhdGEgc2V0IHlvdSBjb2xsZWN0IGJ5IGRlZmluaW5nIGEgc2VhcmNoIHF1ZXJ5IChhIGNvbGxlY3Rpb24gb2YgeW91ciB1c2VyLWRlZmluZWQgc2VhcmNoIHRlcm1zKSBmcm9tIHRoZSAqW05ldyBZb3JrIFRpbWVzXSh3d3cubnl0aW1lcy5jb20pKidzIEFydGljbGUgU2VhcmNoIFtBcHBsaWNhdGlvbiBQcm9ncmFtbWluZyBJbnRlcmZhY2VdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL0FwcGxpY2F0aW9uX3Byb2dyYW1taW5nX2ludGVyZmFjZSkuIE5ldHdvcmtzIGFyZSBnZW5lcmF0ZWQgZnJvbSB0aGUgY28tb2NjdXJyZW5jZXMgYmV0d2VlbiBzZWFyY2ggdGVybXMgaW5jbHVkZWQgaW4gdGhlIHNhbWUgc2VhcmNoIHF1ZXJ5LiBGb3IgZXhhbXBsZSwgYSBsaW5rIGV4aXN0cyBiZXR3ZWVuIOKAnGFwcGxl4oCdIGFuZCDigJxvcmFuZ2XigJ0gaWYgdGhlcmUgYXJlIGFydGljbGVzIGluIHRoZSAqTmV3IFlvcmsgVGltZXMqIHRoYXQgY29udGFpbmVkIHRoZXNlIHR3byB0ZXJtcy4gIFlvdSB3aWxsIGJlIHZpc3VhbGl6aW5nIGFuZCBpbnRlcnByZXRpbmcgaW5kaXZpZHVhbCBhbmQgZ2xvYmFsIG5ldHdvcmsgcHJvcGVydGllcyBvZiB0aGlzIG5ldHdvcmsuCgpZb3Ugd2lsbCBiZSBncmFkZWQgcHJpbWFyaWx5IG9uIHRoZSBjb21wbGV0ZW5lc3MgYW5kIGFjY3VyYWN5IG9mIHlvdXIgcmVzcG9uc2VzLCBidXQgdGhlIGNsYXJpdHkgb2YgdGhlIHByZXBhcmVkIHJlcG9ydCB3aWxsIGFsc28gYWZmZWN0IHlvdXIgZ3JhZGUuICBXaGlsZSBzdHVkZW50cyBtYXkgd29yayB0b2dldGhlciB0byBwZXJmb3JtIHRoZSBhbmFseXNpcywgZWFjaCBzdHVkZW50IG11c3Qgc3VibWl0IGhpcyBvciBoZXIgb3duIHJlcG9ydCBhbmQgaXMgcmVzcG9uc2libGUgZm9yIHdyaXRpbmcgdGhlIG5hcnJhdGl2ZSBpbiB0aGUgcmVwb3J0LiBZb3UgbXVzdCBhbnN3ZXIgYWxsIG9mIHRoZSBib2xkZWQgcXVlc3Rpb25zLgoKIyBQYXJ0IDE6IENvbGxlY3QgTmV0d29yayBEYXRhICgyMCBwdHMpCgpGb3IgdGhpcyBsYWIsIHlvdSB3aWxsIHNlYXJjaCB0aGUgKk5ldyBZb3JrIFRpbWVzKiwgc2F2ZSB0aGF0IGRhdGEsIGNyZWF0ZSBuZXR3b3JrcyBmcm9tIHRoYXQgZGF0YSwgY29tcGFyZSB0aGUgZGlmZmVyZW5jZXMgYW1vbmcgbmV0d29ya3MsIGFuZCBkZW1vbnN0cmF0ZSB5b3VyIHByb2ZpY2llbmN5IHdpdGggYmFzaWMgbmV0d29yayBkZXNjcmlwdGl2ZSBzdGF0aXN0aWNzLgoKIyMgTG9hZGluZyBhbmQgSW5zdGFsbGluZyBQYWNrYWdlcywgU2V0IFdvcmtpbmcgRGlyZWN0b3J5CgpXaGVuIHdvcmtpbmcgd2l0aCBSLCB5b3Ugc2hvdWxkIHJ1biBlYWNoIGxpbmUgb2YgY29kZSBpbmRpdmlkdWFsbHksIHVubGVzcyBpdCBpcyBwYXJ0IG9mIGEgZnVuY3Rpb24gZGVmaW5pdGlvbiwgc28geW91IGNhbiBzZWUgdGhlIHJlc3VsdHMuIEdlbmVyYWxseSBzcGVha2luZywgYW55IGxpbmUgb2YgY29kZSB0aGF0IGluY2x1ZGVzICd7JyAodGhlIGJlZ2lubmluZyBvZiBhIGZ1bmN0aW9uIGRlZmluaXRpb24pIHNob3VsZCBiZSBydW4gd2l0aCBhbGwgdGhlIG90aGVyIGxpbmVzIHVudGlsIHlvdSBoaXQgJ30nLgoKYGBge3J9CiMgTGluZXMgdGhhdCBzdGFydCB3aXRoIGEgaGFzaHRhZy9wb3VuZCBzeW1ib2wsIGxpa2UgdGhpcyBvbmUsIGFyZSBjb21tZW50IGxpbmVzLiBDb21tZW50IGxpbmVzIGFyZSBpZ25vcmVkIGJ5IFIgd2hlbiBpdCBpcyBpbnRlcnByZXRpbmcgY29kZS4KIyBZb3Ugb25seSBuZWVkIHRvIGluc3RhbGwgcGFja2FnZXMgb25jZS4gUmVtb3ZlIHRoZSAjIGluIGZyb250IG9mIGVhY2ggbGluZSBhbmQgdGhlbiBydW4gaXQgdG8gaW5zdGFsbCBlYWNoIHBhY2thZ2UuIEFmdGVyIHN1Y2Nlc3NmdWwgaW5zdGFsbGF0aW9uLCBkZWxldGUgdGhlIGxpbmUgb2YgY29kZSBvciByZXBsYWNlIHRoZSAjcyBzbyB0aGUgUiBOb3RlYm9vayBkb2Vzbid0IHJ1biBpbnRvIHByb2JsZW1zLgojIGluc3RhbGwucGFja2FnZXMoJ21hZ3JpdHRyJywgcmVwb3MgPSAiaHR0cHM6Ly9jcmFuLnJzdHVkaW8uY29tIikKIyBpbnN0YWxsLnBhY2thZ2VzKCdpZ3JhcGgnLCByZXBvcyA9ICJodHRwczovL2NyYW4ucnN0dWRpby5jb20iKQojIGluc3RhbGwucGFja2FnZXMoJ2h0dHInLCByZXBvcyA9ICJodHRwczovL2NyYW4ucnN0dWRpby5jb20iKQojIGluc3RhbGwucGFja2FnZXMoJ2RhdGEudGFibGUnLCByZXBvcyA9ICJodHRwczovL2NyYW4ucnN0dWRpby5jb20iKQojIGluc3RhbGwucGFja2FnZXMoJ2RwbHlyJywgcmVwb3MgPSAiaHR0cHM6Ly9jcmFuLnJzdHVkaW8uY29tIikKIyBpbnN0YWxsLnBhY2thZ2VzKCd4bWwyJywgcmVwb3MgPSAiaHR0cHM6Ly9jcmFuLnJzdHVkaW8uY29tIikKIyBZb3UgbmVlZCB0byBsb2FkIHBhY2thZ2VzIGV2ZXJ5IHRpbWUgeW91IHJ1biB0aGUgc2NyaXB0IG9yIHJlc3RhcnQgUi4KbGlicmFyeShtYWdyaXR0cikKbGlicmFyeShodHRyKQpsaWJyYXJ5KGRhdGEudGFibGUpCmxpYnJhcnkoaWdyYXBoKQpsaWJyYXJ5KGRwbHlyKQpsaWJyYXJ5KHhtbDIpCiMgU2V0IHlvdXIgZGlyZWN0b3J5IGZvciB0aGUgcHJvamVjdAojIFlvdSBjYW4gZWl0aGVyIGVudGVyIHlvdXIgZmlsZW5hbWUgcGF0aCB3aXRoaW4gdGhlIHBhcmVudGhlc2VzIGJlbG93IGFuZCByZW1vdmUgdGhlICMgY3JlYXRpbmcgdGhlIGNvbW1lbnQsIG9yIHNlbGVjdCAiU2Vzc2lvbiA+IFNldCBXb3JraW5nIERpcmVjdG9yeSAuLi4gU291cmNlIEZpbGUgTG9jYXRpb24iIGluIFIgU3R1ZGlvLgojIHNldHdkKCJJbnB1dCBEaXJlY3RvcnkiKQpgYGAKCiMjIENob29zZSBhIHRvcGljIGZvciB5b3VyIHNlYXJjaCB0ZXJtcwoKWW91IGNhbiBkZWNpZGUgc2VhcmNoIHRlcm1zIGJhc2VkIG9uIHBlcnNvbmFsIGludGVyZXN0cywgcmVzZWFyY2ggaW50ZXJlc3RzLCBvciBwb3B1bGFyIHRvcGljYWwgYXJlYXMsIGFtb25nIG90aGVycy4gWW91IGhhdmUgZmxleGliaWxpdHkgaW4gc2VsZWN0aW5nIHlvdXIgc2VhcmNoIHRlcm0gbGlzdC4gRm9yIGV4YW1wbGUsIHlvdSBjYW4gc2VhcmNoIGZvciBzb21lIGNvbW1lcmNpYWwgYnJhbmRzLCBjZWxlYnJpdGllcywgY291bnRyaWVzLCB1bml2ZXJzaXRpZXMsIGV0Yy4gSXQgd2lsbCBiZSBtb3N0IHVzZWZ1bCBpZiB5b3UgY2hvb3NlIGEgY29sbGVjdGlvbiBvZiB3b3JkcyB0aGF0IGFyZSBub3QgYWxsIGV4dHJlbWVseSBjb21tb24uIFRoaW5rIGFib3V0IGEgc2V0IG9mIHdvcmRzIHRoYXQgbWlnaHQgaGF2ZSBpbnRlcmVzdGluZyBjby1vY2N1cnJlbmNlcyBpbiBhcnRpY2xlcyB3aXRoaW4gdGhlICpOZXcgWW9yayBUaW1lcyogd2Vic2l0ZS4gRm9yIGV4YW1wbGUsIHlvdSBtaWdodCBiZSBpbnRlcmVzdGVkIGluIHRoZSBsYXN0IG5hbWVzIG9mIGV2ZXJ5IFNlbmF0b3IgaW52b2x2ZWQgaW4gYSBjZXJ0YWluIHBvbGl0aWNhbCBkZWJhdGUsIGZvb3RiYWxsIHRlYW1zLCBvciBjaXRpZXMgYW5kIHRoZWlyIGNvLW9jY3VycmVuY2UgaW4gbmV3cyBhcnRpY2xlcy4gR2VuZXJhbGx5IHNwZWFraW5nLCBwcm9wZXIgbm91bnMgYXJlIGJlc3QsIGJ1dCB5b3UgbWlnaHQgaGF2ZSBjb21wZWxsaW5nIHJlYXNvbnMgdG8gY2hvb3NlIHZlcmJzIG9yIGFkamVjdGl2ZXMuIFlvdSBtaWdodCB3YW50IHRvIHRocm93IGEgY291cGxlIG9mIHRlcm1zIGluIHRoYXQgYXJlbid0IHRoZW1hdGljYWxseSByZWxhdGVkIHRvIG1ha2Ugc3VyZSB5b3UgZG9uJ3QgZ2V0IGEgdG90YWxseSBjb25uZWN0ZWQgY29tcG9uZW50LiBUaGUgbW9yZSBpbnRlcmVzdGluZyB5b3VyIG5ldHdvcmsgaXMgaW4gdGVybXMgb2YgZGlmZmVyaW5nIGNlbnRyYWxpdHksIGRpc3RpbmN0IGNvbXBvbmVudHMsIGV0Yy4sIHRoZSBlYXNpZXIgaXQgd2lsbCBiZSB0byBkbyB0aGUgd3JpdHRlbiBhbmFseXNpcy4gS2VlcCBpbiBtaW5kIHRoYXQgdGhlIEFydGljbGUgU2VhcmNoIGFyY2hpdmUgaXMgdmVyeSBsYXJnZTsgbWFueSB0ZXJtcyBjby1vY2N1ci4gWW91IG1pZ2h0IHdhbnQgdG8gY29uc2lkZXIgdHdvIHRlbnVvdXNseSByZWxhdGVkIHN1YmplY3RzLiBUaGUgZXhhbXBsZSBmaWxlIHVzZXMgZm91ciBmb290YmFsbCB0ZWFtcyBhbmQgdGhlaXIgaG9tZSBzZW5hdG9ycywgcGx1cyBhIGZldyB0b3BpY2FsIHRlcm1zLgoKIyMgQ3JlYXRlIHlvdXIgdGV4dCBpbnB1dAoKQ3JlYXRlIGEgcGxhaW4gdGV4dCBmaWxlIHdpdGggLnR4dCBleHRlbnNpb24gaW4gdGhlIHNhbWUgZGlyZWN0b3J5IGFzIHRoZSBSIE1hcmtkb3duIE5vdGVib29rIHVzZWQgaW4gdGhpcyBhc3NpZ25tZW50LiBNYWtlIGEgbm90ZSBvZiB0aGUgZmlsZSBuYW1lIGZvciB1c2UgaW4gdGhlIG5leHQgY29kZSBzbmlwcGV0LiBQbGFjZSBvbmUgc2VhcmNoIHRlcm0gcGVyIGxpbmUsIGFuZCB1c2UgMTXigJMyMCB0ZXJtcy4gIFlvdSdsbCBhbHNvIGxpa2VseSB3YW50IHRvIGFkZCBxdW90YXRpb24gbWFya3MgYXJvdW5kIHlvdXIgc2VhcmNoIHRlcm1zIHRvIGVuc3VyZSB0aGF0IHlvdSdyZSBvbmx5IHJlY2VpdmluZyByZXN1bHRzIGZvciB0aGUgY29tcGxldGUgdGVybS4gTk9URTogVGhlIGZ1bmN0aW9uIHdpbGwgcHJvY2VzcyB5b3VyIHRlcm1zIHNvIHRoYXQgdGhleSB3b3JrIGluIHRoZSBVUkwgcmVxdWVzdC4gWW91IGRvIG5vdCBuZWVkIHRvIGVuY29kZSBub24tYWxwaGFiZXRpYyBjaGFyYWN0ZXJzLgoKVGhlIHRleHQgZmlsZSBjYW5ub3QgaW5jbHVkZSBhbnkgYWRkaXRpb25hbCBpbmZvcm1hdGlvbiBvciBjaGFyYWN0ZXJzIGFuZCBpdCBtdXN0IGJlIGEgLnR4dCBmaWxlOyBXb3JkIG9yIFJURiBkb2N1bWVudHMgd29u4oCZdCB3b3JrLgoKIyMgQW5hbHlzaXMKCioqYS4JUHJvdmlkZSBhIGhpZ2ggbGV2ZWwgb3ZlcnZpZXcgb2YgdGhlIHRlcm1zIHlvdSBpbmNsdWRlZCBpbiB0aGUgc2VhcmNoIHF1ZXJ5LioqCgoqKmIuCVdoeSBkaWQgeW91IGNob29zZSB0aGlzIGNvbGxlY3Rpb24gb2YgdGVybXM/ICBXZXJlIHRoZXJlIHNvbWUgc3BlY2lmaWMgb3ZlcmFyY2hpbmcgcXVlc3Rpb27igJRpbnRlbGxlY3R1YWwgb3IgZXh0cmFjdXJyaWN1bGFyIGN1cmlvc2l0eeKAlHRoYXQgbW90aXZhdGVkIHRoaXMgY29sbGVjdGlvbiBvZiB0ZXJtcz8qKgoKKipjLglIb3cgZGlkIHlvdSBkZWNpZGUgd2hpY2ggdGVybXMgdG8gdXNlIGluIHRoZSBzZWFyY2ggcXVlcnk/IFdlcmUgdGhlc2UgdGVybXMgeW91IGludHVpdGl2ZWx5IGRlZW1lZCBpbXBvcnRhbnQ/IFdlcmUgdGhleSBjdWxsZWQgZnJvbSBhIHNwZWNpZmljIHNvdXJjZSBvciB0aGUgcmVzdWx0IG9mIHNvbWUgc2VwYXJhdGUgYW5hbHlzaXMgb3Igc2VhcmNoIHF1ZXJ5PyoqCgoqKmQuCVdoYXQgYXJlIHRoZSBpbnNpZ2h0cyB5b3UgaG9wZSB0byBnbGVhbiBieSBsb29raW5nIGF0IHRoZSBuZXR3b3JrIG9mIHRlcm1zIGluIHRlcm1zIG9mIGluZGl2aWR1YWwgbm9kZSBtZXRyaWNzLCBzdWItZ3JvdXBpbmcgb2Ygbm9kZXMsIG92ZXJhbGwgZ2xvYmFsIG5ldHdvcmsgcHJvcGVydGllcz8qKgoKIyMgV29ya2luZyB3aXRoIHRoZSBBUEkgdG8gQ29sbGVjdCBZb3VyIERhdGEKVGhlICpOZXcgWW9yayBUaW1lcyogY29udHJvbHMgYWNjZXNzIHRvIGl0cyBBUEkgYnkgYXNzaWduaW5nIGVhY2ggdXNlciBhIGtleS4gRWFjaCBrZXkgaGFzIGEgbGltaXRlZCBudW1iZXIgb2YgY2FsbHMgdGhhdCBjYW4gYmUgbWFkZSB3aXRoaW4gYSBjZXJ0YWluIHRpbWUgcGVyaW9kLiBZb3UgY2FuIHJlYWQgbW9yZSBhYm91dCB0aGUgbGltaXRhdGlvbnMgb2YgdGhlIEFQSSBzeXN0ZW0gW2hlcmVdKGh0dHA6Ly9kZXZlbG9wZXIubnl0aW1lcy5jb20vYXJ0aWNsZV9zZWFyY2hfdjIuanNvbiMpLgoKWW91IHdpbGwgbmVlZCB0byBjcmVhdGUgeW91ciBvd24gQVBJIGtleSB0byBjb21wbGV0ZSB0aGlzIGFzc2lnbm1lbnQuIEdvIHRvIHRoZSAqTmV3IFlvcmsgVGltZXMqIFtkZXZlbG9wZXJzIHBhZ2VdKGh0dHBzOi8vZGV2ZWxvcGVyLm55dGltZXMuY29tL3NpZ251cCkgYW5kIHJlcXVlc3QgYSBrZXkuIFlvdSB3aWxsIGNvcHkgdGhhdCBrZXkgKHJlY2VpdmVkIHZpYSBlbWFpbCkgaW50byB0aGUgYXBpIHZhcmlhYmxlIGJlbG93LgoKYGBge3J9CiMgSW1wb3J0IHlvdXIgd29yZCBsaXN0Cm5hbWVfb2ZfZmlsZSA8LSAiTkZMLnR4dCIgIyBDcmVhdGVzIGEgdmFyaWFibGUgY2FsbGVkIG5hbWVfb2ZfZmlsZSB0aGF0IHlvdSBzaG91bGQgcG9wdWxhdGUgd2l0aCB0aGUgbmFtZSBvZiB5b3VyIHRleHQgZmlsZSBiZXR3ZWVuIHF1b3RhdGlvbiBtYXJrcy4Kd29yZF9saXN0IDwtIHJlYWQudGFibGUobmFtZV9vZl9maWxlLCBzZXAgPSAiXG4iLCBzdHJpbmdzQXNGYWN0b3JzID0gRikgJT4lIHVubGlzdCAlPiUgYXMudmVjdG9yICMgUmVhZHMgdGhlIGNvbnRlbnQgb2YgeW91ciBmaWxlIGludG8gYSB2YXJpYWJsZS4KbnVtX3dvcmRzIDwtIGxlbmd0aCh3b3JkX2xpc3QpICMgQ3JlYXRlcyBhIHZhcmlhYmxlIHdpdGggdGhlIG51bWJlciBvZiB3b3JkcyBpbiB5b3VyIGxpc3QuCnVybF9iYXNlIDwtICJodHRwczovL2FwaS5ueXRpbWVzLmNvbS9zdmMvc2VhcmNoL3YyL2FydGljbGVzZWFyY2guanNvbiIKIyBXaGVuIHlvdSByZWNlaXZlIHRoZSBlbWFpbCB3aXRoIHlvdXIgQVBJIGtleSwgcGFzdGUgaXQgYmVsb3cgYmV0d2VlbiB0aGUgcXVvdGF0aW9uIG1hcmtzLgphcGkgPC0gJzc2ZjA2YzNkMTZjNTQyODBiOTIzM2Q4ZjNkNzZlNGJmJwpgYGAKCk91ciBmaXJzdCBmdW5jdGlvbiB3aWxsIGdhdGhlciBhbGwgb2YgdGhlIHNlYXJjaCB0ZXJtcyBhbmQgdGhlaXIgbnVtYmVyIG9mIGhpdHMgdG8gYmUgcGxhY2VkIGluIGEgdGFibGUuIEFsbCBsaW5lcyBvZiBhIGZ1bmN0aW9uIHNob3VsZCBiZSBydW4gdG9nZXRoZXIuCgpgYGB7cn0KR2V0X2hpdHNfb25lIDwtIGZ1bmN0aW9uKGtleXdvcmQxKSB7CiAgU3lzLnNsZWVwKHRpbWU9MykKICB1cmwgPC0gcGFzdGUwKHVybF9iYXNlLCAiP2FwaS1rZXk9IiwgYXBpLCAiJnE9IiwgVVJMZW5jb2RlKGtleXdvcmQxKSwiJmJlZ2luX2RhdGU9IiwiMjAxNjAxMDEiKSAjIEJlZ2luIGRhdGUgaXMgaW4gZm9ybWF0IFlZWVlNTUREOyB5b3UgY2FuIGNoYW5nZSBpdCBpZiB5b3Ugd2FudCBvbmx5IG1vcmUgcmVjZW50IHJlc3VsdHMsIGZvciBleGFtcGxlLgogICMgVGhlIG51bWJlciBvZiByZXN1bHRzCiAgcHJpbnQoa2V5d29yZDEpCiAgaGl0cyA8LSBjb250ZW50KEdFVCh1cmwpKSRyZXNwb25zZSRtZXRhJGhpdHMgJT4lIGFzLm51bWVyaWMKICBwcmludChoaXRzKQogICMgUHV0IHJlc3VsdHMgaW4gdGFibGUKICBjKFNlYXJjaFRlcm09a2V5d29yZDEsUmVzdWx0c1RvdGFsPWhpdHMpCn0KYGBgCgpOb3cgd2Ugd2lsbCBpbnZva2Ugb3VyIGZ1bmN0aW9uIHRvIHB1dCBpbmZvcm1hdGlvbiBmcm9tIHRoZSBBUEkgaW50byBvdXIgZ2xvYmFsIGVudmlyb25tZW50LgoKYGBge3J9CiNDcmVhdGUgYSB0YWJsZSBvZiB5b3VyIHdvcmRzIGFuZCB0aGVpciBudW1iZXIgb2YgcmVzdWx0cy4KdG90YWxfdGFibGUgPC0gdChzYXBwbHkod29yZF9saXN0LEdldF9oaXRzX29uZSkpCnRvdGFsX3RhYmxlIDwtIGFzLmRhdGEuZnJhbWUodG90YWxfdGFibGUpCnRvdGFsX3RhYmxlJFJlc3VsdHNUb3RhbCA8LSBhcy5udW1lcmljKGFzLmNoYXJhY3Rlcih0b3RhbF90YWJsZSRSZXN1bHRzVG90YWwpKQpgYGAKSWYgeW91IGdldCB6ZXJvIGhpdHMgZm9yIGFueSBvZiB0aGVzZSB0ZXJtcywgeW91IHNob3VsZCBzdWJzdGl0dXRlIHRoYXQgdGVybSBmb3Igc29tZXRoaWduIGVsc2UgYW5kIHJlcnVuIHRoZSBsYWIgdXAgdG8gdGhpcyBwb2ludC4KTmV4dCwgd2Ugd2lsbCBkZWZpbmUgdGhlIGZ1bmN0aW9uIHRoYXQgd2lsbCBjb2xsZWN0IHRoZSBhcnRpY2xlIGNvLW9jY3VyZW5jZXMgbmV0d29yay4KYGBge3J9CkdldF9oaXRzX3R3byA8LSBmdW5jdGlvbihyb3dfaW5wdXQpIHsKICBrZXl3b3JkMSA8LSByb3dfaW5wdXRbMV0KICBrZXl3b3JkMiA8LSByb3dfaW5wdXRbMl0KICB1cmwgPC0gcGFzdGUwKHVybF9iYXNlLCAiP2FwaS1rZXk9IiwgYXBpLCAiJnE9IiwgVVJMZW5jb2RlKGtleXdvcmQxKSwiKyIsIFVSTGVuY29kZShrZXl3b3JkMiksIiZiZWdpbl9kYXRlPSIsIjIwMTYwMTAxIikgI21hdGNoIHcvIEJlZ2luIERhdGUgaW4gR2V0X2hpdHNfb25lLgogICMgVGhlIG51bWJlciBvZiByZXN1bHRzCiAgcHJpbnQocGFzdGUwKGtleXdvcmQxLCIgIixrZXl3b3JkMikpIAogIGhpdHMgPC0gY29udGVudChHRVQodXJsKSkkcmVzcG9uc2UkbWV0YSRoaXRzICU+JSBhcy5udW1lcmljCiAgcHJpbnQoaGl0cykKICBTeXMuc2xlZXAodGltZT0zKQogICMgUHV0IHJlc3VsdHMgaW4gdGFibGUKICBjKFNlYXJjaFRlcm0xPWtleXdvcmQxLFNlYXJjaFRlcm0yPWtleXdvcmQyLENvT2NjdXJyZW5jZXM9aGl0cykKfSAKYGBgCgpJbiB0aGlzIG5leHQgc3RlcCwgd2Ugd2lsbCBjYWxsIHRoZSBBUEkgYW5kIGNvbGxlY3QgdGhlIGNvLW9jY3VycmVuY2UgbmV0d29yay4gVGhpcyBtYXkgdGFrZSBzb21lIHRpbWUuIElmIHlvdSByZWNlaXZlICJudW1lcmljKDApIiBpbiBhbnkgb2YgeW91ciByZXNwb3NuZXMsIHlvdSd2ZSBsaWtlbHkgaGl0IHlvdXIgQVBJIGtleSBsaW1pdCBhbmQgd2lsbCBlaXRoZXIgbmVlZCB0byB3YWl0IGZvciB0aGUgY2FsbHMgdG8gcmVzZXQgKDI0IGhvdXJzKSBvciByZXF1ZXN0IGEgbmV3IGtleS4gSWYgeW91IHJlY2VpdmUgdGhlIGVycm9yIG1lc3NhZ2UgIiQgb3BlcmF0b3IgaXMgaW52YWxpZCBmb3IgYXRvbWljIHZlY3RvcnMsIiB5b3UgaGF2ZSBhbHNvIGhpdCB0aGUgQVBJIGNhbGwgbGltaXQuIFRoaXMgY291bGQgYmUgZHVlIHRvIHJ1bm5pbmcgdGhlIHNjcmlwdCBtdWx0aXBsZSB0aW1lcywgb3IgZHVlIHRvIGhpdHRpbmcgdG9vIG1hbnkgcmVzdWx0cyBiYXNlZCBvbiB2ZXJ5IGNvbW1vbiBzZWFyY2ggdGVybXMuIFJlcXVlc3QgYSBuZXcgQVBJLCBzaG9ydGVuIHlvdXIgd29yZCBsaXN0LCBhbmQgdHJ5IGFnYWluLiBEb24ndCBmb3JnZXQgeW91IG5lZWQgdG8gcmVsb2FkIHlvdXIgd29yZCBsaXN0IGZyb20gdGhlIGZpcnN0IHBhcnQgb2YgdGhlIExhYiBpbiBvcmRlciB0byBnZXQgYSBkaWZmZXJlbnQgc2V0IG9mIHJlc3VsdHMhIFlvdSBtdXN0IGFsc28gcmVydW4gdGhlIGZ1bmN0aW9ucyB0byByZWFzc2lnbiB0aGUgQVBJIHZhbHVlLiBJZiBub25lIG9mIHlvdXIgcmVzdWx0cyBjb21lIGJhY2sgYXMgIjAsIiB5b3UgbWlnaHQgd2FudCB0byByZWRvIHlvdXIgc2VhcmNoIHdpdGggdGhlIGFwcHJvcHJpYXRlIHdvcmRzLgoKYGBge3J9CiMgQ29udmVydCB0aGUgcGFpcnMgbGlzdCBpbnRvIGEgdGFibGUKcGFpcnNfbGlzdCA8LSBleHBhbmQuZ3JpZCh3b3JkX2xpc3Qsd29yZF9saXN0KSAlPiUgZmlsdGVyKFZhcjEgIT0gVmFyMikKcGFpcnNfbGlzdCA8LSB0KGNvbWJuKHdvcmRfbGlzdCwyKSkKI0NyZWF0ZSBhIG5ldHdvcmsgdGFibGUsIHJ1biB0aGUgR2V0X2hpdHNfdHdvIGZ1bmN0aW9uIHVzaW5nIHRoZSBwYWlycyBsaXN0cwpuZXR3b3JrX3RhYmxlIDwtIHQoYXBwbHkocGFpcnNfbGlzdCwxLEdldF9oaXRzX3R3bykpCiNDb252ZXJ0IHRoZSBuZXR3b3JrIHRhYmxlIGludG8gYSBkYXRhZnJhbWUKbmV0d29ya190YWJsZSA8LSBhcy5kYXRhLmZyYW1lKG5ldHdvcmtfdGFibGUpCiMgUmVhZCBlYWNoIHRoZSBjb250ZW50IG9mIGVhY2ggaXRlbSB3aXRoaW4gdGhlICRDb09jY3VycmVlbmNlcyBmYWN0b3IgYXMgY2hhcmFjdGVycywgCiMgdGhlbiBmb3JjZSB0aG9zZSBjaGFyYWN0ZXJzIGludG8gdGhlICJudW1lcmljIiBvciAiZG91YmxlIiB0eXBlLgpuZXR3b3JrX3RhYmxlJENvT2NjdXJyZW5jZXMgPC0gYXMubnVtZXJpYyhhcy5jaGFyYWN0ZXIobmV0d29ya190YWJsZSRDb09jY3VycmVuY2VzKSkKIyBDb252ZXJ0IGRhdGEgdG8gZGF0YS50YWJsZSB0eXBlLgp0b3RhbF90YWJsZSA8LSBhcy5kYXRhLnRhYmxlKHRvdGFsX3RhYmxlKQpuZXR3b3JrX3RhYmxlIDwtIGFzLmRhdGEudGFibGUobmV0d29ya190YWJsZSkKCiMgUmVtb3ZlIHplcm8gZWRnZXMgZnJvbSB5b3VyIG5ldHdvcmsKbmV0d29ya190YWJsZSA8LSBuZXR3b3JrX3RhYmxlWyFDb09jY3VycmVuY2VzPT0wXSAKCiMgQ3JlYXRlIGEgZ3JhcGggb2JqZWN0IHdpdGggeW91ciBkYXRhCmdfdmFsdWVkIDwtIGdyYXBoX2Zyb21fZGF0YV9mcmFtZShkID0gbmV0d29ya190YWJsZVssMTozLHdpdGg9RkFMU0VdLGRpcmVjdGVkID0gRkFMU0UsdmVydGljZXMgPSB0b3RhbF90YWJsZSkKCiMgSWYgeW91J3JlIGhhdmluZyB0cm91YmxlIHdpdGggZGF0YSBjb2xsZWN0aW9uLCB5b3UgY2FuIGxvYWQgdGhlICdORkwgTGFiIFJlc3VsdHMuUkRhdGEnIGZpbGUgbm93IGJ5IGNsaWNraW5nIHRoZSBvcGVuIGZvbGRlciBpY29uIG9uIHRoZSAiRW52aXJvbm1lbnQiIiB0YWIgYW5kIGNvbnRpbnVlIHRoZSBsYWIgZnJvbSBoZXJlLiBZb3UnbGwgbmVlZCB0byBmaWd1cmUgb3V0IHdoYXQgdGhlIHNpZ25pZmljYW5jZSBvZiB0aGUgdGVybXMgYXJlIHlvdXJzZWxmLCBob3dldmVyLgojIFlvdSBzaG91bGQgc2F2ZSB5b3VyIGRhdGEgYXQgdGhpcyBwb2ludCBieSBjbGlja2luZyB0aGUgZmxvcHB5IGRpc2sgaWNvbiB1bmRlciB0aGUgIkVudmlyb25tZW50IiB0YWIuCmBgYAoKIyMgQW5hbHlzaXMKCioqSXMgdGhlIGdyYXBoIGRpcmVjdGVkIG9yIHVuZGlyZWN0ZWQ/KiogCgoqKkhvdyBtYW55IG5vZGVzIGFuZCBsaW5rcyBkb2VzIHlvdXIgbmV0d29yayBoYXZlPyAqKgpgYGB7cn0KbnVtVmVydGljZXMgPC0gdmNvdW50KGdfdmFsdWVkKQpudW1WZXJ0aWNlcwpudW1FZGdlcyA8LSBlY291bnQoZ192YWx1ZWQpCm51bUVkZ2VzCmBgYAoKKipXaGF0IGlzIHRoZSBudW1iZXIgb2YgcG9zc2libGUgbGlua3MgaW4geW91ciBuZXR3b3JrPyAqKgpgYGB7cn0KbWF4RWRnZXMgPC0gbnVtVmVydGljZXMqKG51bVZlcnRpY2VzLTEpLzIKbWF4RWRnZXMKYGBgCgoqKldoYXQgaXMgdGhlIGRlbnNpdHkgb2YgeW91ciBuZXR3b3JrPyoqIApgYGB7cn0KZ3JhcGhEZW5zaXR5IDwtIG51bUVkZ2VzL21heEVkZ2VzICMgbWFudWFsIGNhbGN1bGF0aW9uCmdyYXBoRGVuc2l0eQpncmFwaERlbnNpdHkxIDwtIGdyYXBoLmRlbnNpdHkoZ192YWx1ZWQpICMgdXNpbmcgdGhlIGdyYXBoLmRlbnNpdHkgZnVuY3Rpb24gZnJvbSBpZ3JhcGgKZ3JhcGhEZW5zaXR5MQpgYGAKCioqQnJpZWZseSBkZXNjcmliZSBob3cgeW91ciBjaG9pY2Ugb2YgZGF0YXNldCBtYXkgaW5mbHVlbmNlIHlvdXIgZmluZGluZ3MuKiogIFdoYXQgZGlmZmVyZW5jZXMgd291bGQgeW91IGV4cGVjdCBpZiB5b3UgdXNlIGRpZmZlcmVudCBzZWFyY2ggdGVybXM/IEFyZSB0aGUgY3VycmVudCBzZWFyY2ggdGVybXMgcmVsYXRlZCB0byBvbmUgYW5vdGhlcj8gSWYgc28sIGhvdz8gRG8geW91IHRoaW5rIHRoZSBsaW1pdGF0aW9uIHRvIG9uZSB3b3JkIG1pZ2h0IHNrZXcgeW91ciBhbnN3ZXJzPyAoaS5lLiBpZiB5b3XigJlyZSBpbnRlcmVzdGVkIGluIEhpbGxhcnkgQ2xpbnRvbiwgYnV0IHlvdSBpbmNsdWRlIOKAnENsaW50b27igJ0gYXMgYSB0ZXJtLCB5b3Ugd2lsbCBnZXQgc3RvcmllcyB0aGF0IG1lbnRpb24gQ2hlbHNlYSwgQmlsbCwgJiBldmVuIFAtRnVuayBBbGxzdGFyIEdlb3JnZSBDbGludG9uKS4KCiMgUGFydCAyOiBWaXN1YWxpemUgWW91ciBOZXR3b3JrICgyMCBwb2ludHMpCgpMZXQncyBzdGFydCBieSB2aXN1YWxpemluZyB0aGUgbmV0d29yayB0aGF0IHdlJ3ZlIGNvbGxlY3RlZCBmcm9tIHRoZSAqTmV3IFlvcmsgVGltZXMqIEFydGljbGUgU2VhcmNoIEFQSS4gV2UnbGwgbmVlZCB0byBjaG9vc2Ugbm9kZSBjb2xvcnMgYW5kIHNldCBhIGxheW91dC4gWW91IGNhbiBsZWFybiBtb3JlIGFib3V0IEZydWNodGVybWFuIFJlaW5nb2xkIGxheW91dCBhbmQgb3RoZXIgbGF5b3V0cyBbaGVyZV0oaHR0cDovL2lncmFwaC5vcmcvci9kb2MvbGF5b3V0X3dpdGhfZnIuaHRtbCkuCgpgYGB7cn0KIyMgTGVhcm4gbW9yZSBhYm91dCBwbG90dGluZyB3aXRoIGlncmFwaAo/PyBpZ3JhcGgucGxvdHRpbmcKY29sYmFyID0gcmFpbmJvdyhsZW5ndGgod29yZF9saXN0KSkgIyMgd2UgYXJlIHNlbGVjdGluZyBkaWZmZXJlbnQgY29sb3JzIHRvIGNvcnJlc3BvbmQgdG8gZWFjaCB3b3JkClYoZ192YWx1ZWQpJGNvbG9yID0gY29sYmFyCiMgU2V0IGxheW91dCBoZXJlIApMID0gbGF5b3V0X3dpdGhfZnIoZ192YWx1ZWQpICAjIEZydWNodGVybWFuIFJlaW5nb2xkCnBsb3QoZ192YWx1ZWQsdmVydGV4LmNvbG9yPVYoZ192YWx1ZWQpJGNvbG9yLCBsYXlvdXQgPSBMLCB2ZXJ0ZXguc2l6ZT02KSAKCmBgYAojIyBBbmFseXNpcwoqKkluIGEgcGFyYWdyYXBoLCBkZXNjcmliZSB0aGUgbWFjcm8tbGV2ZWwgc3RydWN0dXJlIG9mIHlvdXIgZ3JhcGhzIGJhc2VkIG9uIHRoZSBGcnVjaHRlcm1hbiBSZWluZ29sZCB2aXN1YWxpemF0aW9uLioqCklzIGl0IGEgZ2lhbnQsIGNvbm5lY3RlZCBjb21wb25lbnQsIGFyZSB0aGVyZSBkaXN0aW5jdCBzdWItY29tcG9uZW50cywgb3IgYXJlIHRoZXJlIGlzb2xhdGVkIGNvbXBvbmVudHM/ICBDYW4geW91IHJlY29nbml6ZSBjb21tb24gZmVhdHVyZXMgb2YgdGhlIHN1YmNvbXBvbmVudHM/ICBEb2VzIHRoaXMgdmlzdWFsaXphdGlvbiBnaXZlIHlvdSBhbnkgaW5zaWdodCBpbnRvIHRoZSBjby1vY2N1cnJlbmNlIHBhdHRlcm5zIG9mIHRoZSBzZWFyY2gtdGVybXM/ICBJZiB5ZXMsIHdoYXQ/IElmIG5vdCwgd2h5PwoKTm93IHdlJ2xsIGNyZWF0ZSBhIHNlY29uZCB2aXN1YWxpemF0aW9uIHVzaW5nIGEgZGlmZmVyZW50IGxheW91dC4KYGBge3J9CiMjIFlvdSBjYW4gY2hhbmdlIHRoZSBsYXlvdXQgYnkgcGlja2luZyBvbmUgb2YgdGhlIG90aGVyIG9wdGlvbnMuIFVuY29tbWVudCBvbmUgb2YgdGhlIGxpbmVzIGJlbG93IGJ5IGVyYXNpbmcgdGhlICMgYW5kIHJ1bm5pbmcgdGhlIGxpbmUuIFRyeSB0byBmaW5kIGEgbGF5b3V0IHRoYXQgZ2l2ZXMgeW91IGRpZmZlcmVudCBpbmZvcm1hdGlvbiB0aGF0IEZydWNodGVybWFuIFJlaW5nb2xkLgoKIEwgPSBsYXlvdXRfd2l0aF9kaChnX3ZhbHVlZCkgIyMgRGF2aWRzb24gYW5kIEhhcmVsCgojIEwgPSBsYXlvdXRfd2l0aF9kcmwoZ192YWx1ZWQpICMjIEZvcmNlLWRpcmVjdGVkCgojIEwgPSBsYXlvdXRfd2l0aF9rayhnX3ZhbHVlZCkgIyMgU3ByaW5nCnBsb3QoZ192YWx1ZWQsdmVydGV4LmNvbG9yPVYoZ192YWx1ZWQpJGNvbG9yLCBsYXlvdXQgPSBMLCB2ZXJ0ZXguc2l6ZT02KSAKYGBgCiMjIEFuYWx5c2lzCgoqKkluIGEgcGFyYWdyYXBoLCBjb21wYXJlIGFuZCBjb250cmFzdCB0aGUgaW5mb3JtYXRpb24gZ2l2ZW4gdG8geW91IGJ5IHRoZSB0d28gZGlmZmVyZW50IGxheW91dHMuKioKCiMgUGFydCAzOiBDb21tdW5pdHkgRGV0ZWN0aW9uIEFuYWx5c2lzIHdpdGggUiAoMjAgUG9pbnRzKQoKSWRlbnRpZnlpbmcgc3ViZ3JvdXBzIHdpdGhpbiBhIG5ldHdvcmsgaXMgb2YgZ3JlYXQgaW50ZXJlc3QgdG8gc29jaWFsIG5ldHdvcmsgcmVzZWFyY2hlcnMsIHNvIGEgdmFyaWV0eSBvZiBhbGdvcml0aG1zIGhhdmUgYmVlbiBkZXZlbG9wZWQgdG8gaWRlbnRpZnkgYW5kIG1lYXN1cmUgc3ViZ3JvdXBzLiAgV2Ugd2lsbCB1c2Ugc29tZSBvZiBS4oCZcyBidWlsdC1pbiB0b29scyB0byBpZGVudGlmeSBzdWJncm91cHMgYW5kIGNlbnRyYWwgbm9kZXMgZm9yIHZpc3VhbCBpbnNwZWN0aW9uLgoKRm9yIHRoZSByZW1haW5kZXIgb2YgdGhlIHZpc3VhbGl6YXRpb25zIHdlIHdpbGwgdXNlIHRoZSBGcnVjaHRlcm1hbiBSZWluZ29sZCBsYXlvdXQuCmBgYHtyfQpMID0gbGF5b3V0X3dpdGhfZnIoZ192YWx1ZWQpIApgYGAKCkNsdXN0ZXIgdGhlIG5vZGVzIGluIHlvdXIgbmV0d29yay4KYGBge3J9CiMgTGVhcm4gbW9yZSBhYm91dCB0aGUgY2x1c3RlcmluZyBhbGdvcml0aG0uCj8/IGNsdXN0ZXJfd2Fsa3RyYXAKY2x1c3RlciA8LSBjbHVzdGVyX3dhbGt0cmFwKGdfdmFsdWVkKQojIEZpbmQgdGhlIG51bWJlciBvZiBjbHVzdGVycwptZW1iZXJzaGlwKGNsdXN0ZXIpICAgIyBhZmZpbGlhdGlvbiBsaXN0Cmxlbmd0aChzaXplcyhjbHVzdGVyKSkgIyBudW1iZXIgb2YgY2x1c3RlcnMKIyBGaW5kIHRoZSBzaXplIHRoZSBlYWNoIGNsdXN0ZXIgCiMgTm90ZSB0aGF0IGNvbW11bml0aWVzIHdpdGggb25lIG5vZGUgYXJlIGlzb2xhdGVzLCBvciBoYXZlIG9ubHkgYSBzaW5nbGUgdGllCnNpemVzKGNsdXN0ZXIpIApgYGAKCioqSG93IG1hbnkgY29tbXVuaXRpZXMgaGF2ZSBiZWVuIGNyZWF0ZWQ/KioKCioqSG93IG1hbnkgbm9kZXMgYXJlIGluIGVhY2ggY29tbXVuaXR5PyoqCkluIG5ldHdvcmtzIGNvbnRhaW5pbmcgbm9kZSBhdHRyaWJ1dGUgaW5mb3JtYXRpb24sIHdlIGNhbiBvZnRlbiBnYWluIGluc2lnaHQgaW50byBhIG5ldHdvcmsgYnkgbG9va2luZyBhdCB0aGUgbm9kZXMgdGhhdCBnZXQgcGxhY2VkIGluIHRoZSBzYW1lIHBhcnRpdGlvbi4gCioqRm9yIHlvdXIgbmV0d29yaywgd2hhdCBtaWdodCBlYWNoIGNsdXN0ZXIgb2Ygbm9kZXMgcG90ZW50aWFsbHkgaGF2ZSBpbiBjb21tb24/IERlc2NyaWJlIGVhY2ggY2x1c3RlciwgaXRzIG1lbWJlcnNoaXAsIGFuZCB0aGUgcmVsYXRpb25zaGlwIGJldHdlZW4gbm9kZXMgaW4gdGhlIGNsdXN0ZXIuKioKTmV4dCB3ZSB2aXN1YWxpemUgdGhlIGNsdXN0ZXJzIGJ5IGNvbG9yaW5nIG5vZGVzIGFjY29yZGluZyB0byB0aGVpciBtb2R1bGFyaXR5IGNsYXNzLiAKYGBge3J9CnBsb3QoY2x1c3RlciwgZ192YWx1ZWQsIGNvbCA9IFYoZ192YWx1ZWQpJGNvbG9yLCBsYXlvdXQgPSBMLCB2ZXJ0ZXguc2l6ZT02KQpgYGAKCioqV2hhdCBpbmZvcm1hdGlvbiBkb2VzIHRoaXMgbGF5b3V0IGNvbnZleT8gIEFyZSB0aGUgY2x1c3RlcnMgd2VsbC1zZXBhcmF0ZWQsIG9yIGlzIHRoZXJlIGEgZ3JlYXQgZGVhbCBvZiBvdmVybGFwPyBJcyBpdCBlYXNpZXIgdG8gaWRlbnRpZnkgdGhlIGNvbW1vbiB0aGVtZXMgYW1vbmcgY2x1c3RlcnMgaW4gdGhpcyBsYXlvdXQgcmF0aGVyIHRoYW4gbG9va2luZyBvbmx5IGF0IHRoZSBncmFwaHM/KioKCioqV2hhdCBkaWZmZXJlbmNlcyBhcmUgdGhlcmUgYmV0d2VlbiBub2RlcyBpbiB0aGUgc2FtZSBjbHVzdGVyIGFuZCBhY3Jvc3MgY2x1c3RlcnM/KioKCioqRGVzY3JpYmUgdGhlIGJyb2tlcnMgYmV0d2VlbiBhbnkgY29tcG9uZW50cyBhbmQgY2xpcXVlcy4gIFdoYXQgYXJlIGNvbW1vbiBmZWF0dXJlcyBvZiB0aGVzZSBicm9rZXJzPyAgQWJvdXQgaG93IG1hbnkgYnJva2VycyB3b3VsZCB5b3UgaGF2ZSB0byByZW1vdmUgZnJvbSB5b3VyIG5ldHdvcmsgdG8gInNoYXR0ZXIiIGl0IGludG8gdHdvIG9yIG1vcmUgZGlzY29ubmVjdGVkIGNvbXBvbmVudHM/KioKCiMgUGFydCA0OiBDZW50cmFsaXR5IFZpc3VhbGl6YXRpb24gJiBXZWlnaHRlZCBWYWx1ZXMgKDIwIFBvaW50cykKCkZvciBlYWNoIG5ldHdvcmssIHlvdSB3aWxsIHVzZSBjZW50cmFsaXR5IG1ldHJpY3MgdG8gaW1wcm92ZSB5b3VyIHZpc3VhbGl6YXRpb24uIFlvdSBtYXkgbmVlZCB0byBhZGp1c3QgdGhlIHNpemUgcGFyYW1ldGVyIHRvIG1ha2UgeW91ciBuZXR3b3JrIG1vcmUgZWFzaWx5IHZpc2libGUuCgojIyBEZWdyZWUgQ2VudHJhbGl0eQpgYGB7cn0KdG90YWxEZWdyZWUgPC0gZGVncmVlKGdfdmFsdWVkLG1vZGU9ImFsbCIpCnNvcnQodG90YWxEZWdyZWUsZGVjcmVhc2luZz1UUlVFKVsxOjVdCmcyIDwtIGdfdmFsdWVkClYoZzIpJHNpemUgPC0gdG90YWxEZWdyZWUqMiAjY2FuIGFkanVzdCB0aGUgbnVtYmVyIGlmIG5vZGVzIGFyZSB0b28gYmlnCnBsb3QoZzIsIGxheW91dCA9IEwsIHZlcnRleC5sYWJlbD1OQSkKYGBgCioqQnJpZWZseSBleHBsYWluIGRlZ3JlZSBjZW50cmFsaXR5IGFuZCB3aHkgbm9kZXMgYXJlIG1vcmUgb3IgbGVzcyBjZW50cmFsIGluIHRoZSBuZXR3b3JrLioqCgojIyBXZWlnaHRlZCBEZWdyZWUgQ2VudHJhbGl0eQpgYGB7cn0Kd2QgPC0gZ3JhcGguc3RyZW5ndGgoZ192YWx1ZWQsd2VpZ2h0cyA9IEUoZ192YWx1ZWQpJENvT2NjdXJyZW5jZXMpCnNvcnQod2QsZGVjcmVhc2luZz1UUlVFKVsxOjVdCndnMiA8LSBnX3ZhbHVlZApWKHdnMikkc2l6ZSA8LSB3ZCouMSAjIGFkanVzdCB0aGUgbnVtYmVyIGlmIG5vZGVzIGFyZSB0b28gYmlnCnBsb3Qod2cyLCBsYXlvdXQgPSBMLCB2ZXJ0ZXgubGFiZWw9TkEsIGVkZ2Uud2lkdGg9c3FydChFKGdfdmFsdWVkKSRDb09jY3VycmVuY2VzKSkgI3Rha2luZyB0aGUgc3F1YXJlIHJvb3QgaXMgYSBnb29kIHdheSB0byBtYWtlIGEgbGFyZ2UgcmFuZ2Ugb2YgbnVtYmVycyB2aXNpYmxlIGluIGFuIGVkZ2UuIE90aGVyd2lzZSBlZGdlcyB0ZW5kIHRvIGNvdmVyIHVwIGFsbCB0aGUgb3RoZXIgZWRnZXMgYW5kIG9ic2N1cmUgdGhlIHJlbGF0aW9uc2hpcHMuCmBgYAoqKldoYXQgZG9lcyB0aGUgYWRkaXRpb24gb2Ygd2VpZ2h0ZWQgZGVncmVlIGFuZCBlZGdlIGluZm9ybWF0aW9uIHRlbGwgeW91IGFib3V0IHlvdXIgZ3JhcGg/KioKCiMjIEJldHdlZW5uZXNzIENlbnRyYWxpdHkKYGBge3J9CmIgPC0gYmV0d2Vlbm5lc3MoZ192YWx1ZWQsZGlyZWN0ZWQ9VFJVRSkKc29ydChiLGRlY3JlYXNpbmc9VFJVRSlbMTo1XQpnNCA8LSBnX3ZhbHVlZApWKGc0KSRzaXplIDwtIGIqMS4yI2NhbiBhZGp1c3QgdGhlIG51bWJlcgpwbG90KGc0LCBsYXlvdXQgPSBMLCB2ZXJ0ZXgubGFiZWw9TkEpCmBgYAoqKkJyaWVmbHkgZXhwbGFpbiBiZXR3ZWVubmVzcyBjZW50cmFsaXR5IGFuZCB3aHkgbm9kZXMgYXJlIG1vcmUgb3IgbGVzcyBjZW50cmFsIGluIHRoZSBuZXR3b3JrLioqCgojIyMgV2VpZ2h0ZWQgQmV0d2Vlbm5lc3MgQ2VudHJhbGl0eQpgYGB7cn0Kd2J0d24gPC0gYmV0d2Vlbm5lc3MoZ192YWx1ZWQsd2VpZ2h0cyA9IEUoZ192YWx1ZWQpJENvT2NjdXJyZW5jZXMpCnNvcnQod2J0d24sZGVjcmVhc2luZz1UUlVFKVsxOjVdCndCdHduRyA8LSBnX3ZhbHVlZApWKHdCdHduRykkc2l6ZSA8LSB3YnR3biouNSAjIGFkanVzdCB0aGUgbnVtYmVyIGlmIG5vZGVzIGFyZSB0b28gYmlnCnBsb3Qod0J0d25HLCBsYXlvdXQgPSBMLCB2ZXJ0ZXgubGFiZWw9TkEsIGVkZ2Uud2lkdGg9c3FydChFKGdfdmFsdWVkKSRDb09jY3VycmVuY2VzKSkgI3Rha2luZyB0aGUgc3F1YXJlIHJvb3QgaXMgYSBnb29kIHdheSB0byBtYWtlIGEgbGFyZ2UgcmFuZ2Ugb2YgbnVtYmVycyB2aXNpYmxlIGluIGFuIGVkZ2UuCmBgYAoqKldoYXQgZG9lcyB0aGUgYWRkaXRpb24gb2Ygd2VpZ2h0ZWQgZGVncmVlIGFuZCBlZGdlIGluZm9ybWF0aW9uIHRlbGwgeW91IGFib3V0IHlvdXIgZ3JhcGg/KioKCiMjIENsb3NlbmVzcyBDZW50cmFsaXR5CmBgYHtyfQpjIDwtIGNsb3NlbmVzcyhnX3ZhbHVlZCkKc29ydChjLGRlY3JlYXNpbmc9VFJVRSlbMTo1XQpnNSA8LSBnX3ZhbHVlZApWKGc1KSRzaXplIDwtIGMqNTAwICAjY2FuIGFkanVzdCB0aGUgbnVtYmVyCnBsb3QoZzUsIGxheW91dCA9IEwsIHZlcnRleC5sYWJlbD1OQSkKYGBgCioqQnJpZWZseSBleHBsYWluIGNsb3NlbmVzcyBjZW50cmFsaXR5IGFuZCB3aHkgbm9kZXMgYXJlIG1vcmUgb3IgbGVzcyBjZW50cmFsIGluIHRoZSBuZXR3b3JrLioqCgojIyMgV2VpZ2h0ZWQgQ2xvc2VuZXNzIENlbnRyYWxpdHkKCmBgYHtyfQp3Q2xzbnNzIDwtIGNsb3NlbmVzcyhnX3ZhbHVlZCx3ZWlnaHRzID0gRShnX3ZhbHVlZCkkQ29PY2N1cnJlbmNlcykKc29ydCh3Q2xzbnNzLGRlY3JlYXNpbmc9VFJVRSlbMTo1XQp3Q2xzbnNzRyA8LSBnX3ZhbHVlZApWKHdDbHNuc3NHKSRzaXplIDwtIHdDbHNuc3MqMTAwMCAjIGFkanVzdCB0aGUgbnVtYmVyIGlmIG5vZGVzIGFyZSB0b28gYmlnCnBsb3Qod0Nsc25zc0csIGxheW91dCA9IEwsIHZlcnRleC5sYWJlbD1OQSwgZWRnZS53aWR0aD1zcXJ0KEUoZ192YWx1ZWQpJENvT2NjdXJyZW5jZXMpKSAjdGFraW5nIHRoZSBzcXVhcmUgcm9vdCBpcyBhIGdvb2Qgd2F5IHRvIG1ha2UgYSBsYXJnZSByYW5nZSBvZiBudW1iZXJzIHZpc2libGUgaW4gYW4gZWRnZS4KYGBgCioqV2hhdCBkb2VzIHRoZSBhZGRpdGlvbiBvZiB3ZWlnaHRlZCBkZWdyZWUgYW5kIGVkZ2UgaW5mb3JtYXRpb24gdGVsbCB5b3UgYWJvdXQgeW91ciBncmFwaD8qKgoKIyMgRWlnZW52ZWN0b3IgQ2VudHJhbGl0eQpgYGB7cn0KZWlnYyA8LSBlaWdlbl9jZW50cmFsaXR5KGdfdmFsdWVkLGRpcmVjdGVkPVRSVUUpCnNvcnQoZWlnYyR2ZWN0b3IsZGVjcmVhc2luZz1UUlVFKVsxOjVdCmc2IDwtIGdfdmFsdWVkClYoZzYpJHNpemUgPC0gZWlnYyR2ZWN0b3IqNTAgI2NhbiBhZGp1c3QgdGhlIG51bWJlcgpwbG90KGc2LCBsYXlvdXQgPSBMLCB2ZXJ0ZXgubGFiZWw9TkEpCmBgYAoKKipCcmllZmx5IGV4cGxhaW4gZWlnZW52ZWN0b3IgY2VudHJhbGl0eSBhbmQgd2h5IG5vZGVzIGFyZSBtb3JlIG9yIGxlc3MgY2VudHJhbCBpbiB0aGUgbmV0d29yay4qKgoKIyMgQW5hbHlzaXMKKipDaG9vc2UgdGhlIHZpc3VhbGl6YXRpb24gdGhhdCB5b3UgdGhpbmsgaXMgbW9zdCBpbnRlcmVzdGluZyBhbmQgYnJpZWZseSBleHBsYWluIHdoYXQgaXQgdGVsbHMgeW91IGFib3V0IGEgY2VudHJhbCBub2RlIGluIHlvdXIgbmV0d29yay4gRGlzY3VzcyB0aGUgdHlwZSBvZiBjZW50cmFsaXR5LCBhbmQgd2hhdCB0aGF0IG5vZGXigJlzIGNlbnRyYWxpdHkgc2NvcmUgdGVsbHMgeW91IGFib3V0IHRoZSBzZWFyY2ggY28tb2NjdXJyZW5jZSBuZXR3b3JrLioqCgoqKkJyaWVmbHkgZGlzY3VzcyBhbiBpbnRlcmVzdGluZyBkaWZmZXJlbmNlIGJldHdlZW4gdHlwZXMgb2YgY2VudHJhbGl0eSBmb3IgeW91ciBuZXR3b3JrLioqCgojIyBHbG9iYWwgTmV0d29yayBNZXRyaWNzIHdpdGggUgoKQ29tcHV0ZSB0aGUgbmV0d29yayBjZW50cmFsaXphdGlvbiBzY29yZXMgZm9yIHlvdXIgbmV0d29yayBmb3IgZGVncmVlLCBiZXR3ZWVubmVzcywgY2xvc2VuZXNzLCBhbmQgZWlnZW52ZWN0b3IgY2VudHJhbGl0eS4KCmBgYHtyfQojIERlZ3JlZSBjZW50cmFsaXphdGlvbgpjZW50cmFsaXphdGlvbi5kZWdyZWUoZ192YWx1ZWQsbm9ybWFsaXplZCA9IFRSVUUpCgojIEJldHdlZW5uZXNzIGNlbnRyYWxpemF0aW9uCmNlbnRyYWxpemF0aW9uLmJldHdlZW5uZXNzKGdfdmFsdWVkLG5vcm1hbGl6ZWQgPSBUUlVFKQoKIyBDbG9zZW5lc3MgY2VudHJhbGl6YXRpb24gCmNlbnRyYWxpemF0aW9uLmNsb3NlbmVzcyhnX3ZhbHVlZCxub3JtYWxpemVkID0gVFJVRSkKCiMgRWlnZW52ZWN0b3IgY2VudHJhbGl6YXRpb24gCmNlbnRyYWxpemF0aW9uLmV2Y2VudChnX3ZhbHVlZCxub3JtYWxpemVkID0gVFJVRSkKCmBgYAoqKlJlY29yZCB0aGUgY2VudHJhbGl6YXRpb24gc2NvcmUgb2YgZWFjaCBjZW50cmFsaXR5IG1lYXN1cmUuKioKCioqQnJpZWZseSBleHBsYWluIHdoYXQgdGhlIGNlbnRyYWxpemF0aW9uIG9mIGEgbmV0d29yayBpcy4qKgoKKipDb21wYXJlIHRoZSBjZW50cmFsaXphdGlvbiBzY29yZXMgYWJvdmUgd2l0aCB0aGUgZ3JhcGhzIHlvdSBjcmVhdGVkIHdoZXJlIHRoZSBub2RlcyBhcmUgc2NhbGVkIGJ5IGNlbnRyYWxpdHkuIERlc2NyaWJlIHRoZSBhcHBlYXJhbmNlIG9mIG1vcmUgY2VudHJhbGl6ZWQgdi4gbGVzcyBjZW50cmFsaXplZCBuZXR3b3Jrcy4qKgoKIyMgUGFydCA1LiBQb3dlciBMYXdzICYgU21hbGwgV29ybGRzICgyMCkKCiMjIFBvd2VyIExhd3MKTmV0d29ya3Mgb2Z0ZW4gZGVtb25zdHJhdGUgcG93ZXIgbGF3IGRpc3RyaWJ1dGlvbnMuIFBsb3QgdGhlIGRlZ3JlZSBkaXN0cmlidXRpb24gb2YgdGhlIG5vZGVzIGluIHlvdXIgYmFzZSBncmFwaC4gCmBgYHtyfQojIENhbGN1bGF0ZSBkZWdyZWUgZGlzdHJpYnV0aW9uCmRlZyA8LSBkZWdyZWUoZ192YWx1ZWQsdj1WKGdfdmFsdWVkKSwgbW9kZT0iYWxsIikKZGVnCgojIERlZ3JlZSBkaXN0cmlidXRpb24gaXMgdGhlIGN1bXVsYXRpdmUgZnJlcXVlbmN5IG9mIG5vZGVzIHdpdGggYSBnaXZlbiBkZWdyZWUKZGVnX2Rpc3RyIDwtZGVncmVlLmRpc3RyaWJ1dGlvbihnX3ZhbHVlZCwgY3VtdWxhdGl2ZT1ULCBtb2RlPSJhbGwiKQpkZWdfZGlzdHIKcGxvdChkZWdfZGlzdHIsIHlsaW09YyguMDEsMTApLCBiZz0iYmxhY2siLHBjaD0yMSwgeGxhYj0iRGVncmVlIiwgeWxhYj0iQ3VtdWxhdGl2ZSBGcmVxdWVuY3kiKSAjWW91IG1heSBuZWVkIHRvIGFkanVzdCB0aGUgeWxpbSB0byBhIGxhcmdlciBvciBzbWFsbGVyIG51bWJlciB0byBtYWtlIHRoZSBncmFwaCBzaG93IG1vcmUgZGF0YS4KYGBgCgpUZXN0IHdoZXRoZXIgaXTigJlzIGFwcHJveGltYXRlbHkgYSBwb3dlciBsYXcsIGVzdGltYXRlIGxvZyBmIChrKSA9IGxvZyBhIOKIkiBjIGxvZyBrLiDigJxUaGlzIHNheXMgdGhhdCBpZiB3ZSBoYXZlIGEgcG93ZXItbGF3IHJlbGF0aW9uc2hpcCwgYW5kIHdlIHBsb3QgbG9nIGYgKGspIGFzIGEgZnVuY3Rpb24gb2YgbG9nIGssIHRoZW4gd2Ugc2hvdWxkIHNlZSBhIHN0cmFpZ2h0IGxpbmU6IOKIkmMgd2lsbCBiZSB0aGUgc2xvcGUsIGFuZCBsb2cgYSB3aWxsIGJlIHRoZSB5LWludGVyY2VwdC4gU3VjaCBhIOKAnGxvZy1sb2figJ0gcGxvdCB0aHVzIHByb3ZpZGVzIGEgcXVpY2sgd2F5IHRvIHNlZSBpZiBvbmXigJlzIGRhdGEgZXhoaWJpdHMgYW4gYXBwcm94aW1hdGUgcG93ZXItbGF3OiBpdCBpcyBlYXN5IHRvIHNlZSBpZiBvbmUgaGFzIGFuIGFwcHJveGltYXRlbHkgc3RyYWlnaHQgbGluZSwgYW5kIG9uZSBjYW4gcmVhZCBvZmYgdGhlIGV4cG9uZW50IGZyb20gdGhlIHNsb3BlLuKAnSAoRSZLLCBDaGFwdGVyIDE4LCBwLjU0NikuCgpgYGB7cn0KcG93ZXIgPC0gcG93ZXIubGF3LmZpdChkZWdfZGlzdHIpCnBvd2VyCnBsb3QoZGVnX2Rpc3RyLCBsb2c9Inh5IiwgeWxpbT1jKC4wMSwxMCksIGJnPSJibGFjayIscGNoPTIxLCB4bGFiPSJEZWdyZWUiLCB5bGFiPSJDdW11bGF0aXZlIEZyZXF1ZW5jeSIpCmBgYAoKKipEb2VzIHlvdXIgbmV0d29yayBleGhpYml0IGEgcG93ZXIgbGF3IGRpc3RyaWJ1dGlvbiBvZiBkZWdyZWUgY2VudHJhbGl0eT8qKgoKIyMgU21hbGwgV29ybGRzCgpOZXR3b3JrcyBvZnRlbiBkZW1vbnN0cmF0ZSBzbWFsbCB3b3JsZCBjaGFyYWN0ZXJpc3RpY3MuIENvbXB1dGUgdGhlIGF2ZXJhZ2UgY2x1c3RlcmluZyBjb2VmZmljaWVudCAoQUNDKSBhbmQgdGhlIGNoYXJhY3RlcmlzdGljIHBhdGggbGVuZ3RoIChDUEwpLgpgYGB7cn0KIyBBdmVyYWdlIGNsdXN0ZXJpbmcgY29lZmZpY2llbnQgKEFDQykKdHJhbnNpdGl2aXR5KGdfdmFsdWVkLCB0eXBlID0gYygiYXZlcmFnZSIpKQoKIyBDaGFyYWN0ZXJpc3RpYyBwYXRoIGxlbmd0aCAoQ1BMKQphdmVyYWdlLnBhdGgubGVuZ3RoKGdfdmFsdWVkKQpgYGAKCkNvbXB1dGUgdGhlIEFDQyBhbmQgQ1BMIGZvciAxMDAgcmFuZG9tIG5ldHdvcmtzIHdpdGggdGhlIHNhbWUgbnVtYmVyIG9mIG5vZGVzIGFuZCB0aWVzIGFzIHlvdXIgdGVzdCBuZXR3b3JrLiAKCmBgYHtyfQphY2NTdW0gPC0gMApjcGxTdW0gPC0gMApmb3IgKGkgaW4gMToxMDApewogIGdycGggPC0gZXJkb3MucmVueWkuZ2FtZShudW1WZXJ0aWNlcywgbnVtRWRnZXMsIHR5cGUgPSAiZ25tIikKICBhY2NTdW0gPC0gYWNjU3VtICsgdHJhbnNpdGl2aXR5KGdycGgsIHR5cGUgPSBjKCJhdmVyYWdlIikpCiAgY3BsU3VtIDwtIGNwbFN1bSArIGF2ZXJhZ2UucGF0aC5sZW5ndGgoZ3JwaCkKfQphY2NTdW0vMTAwCmNwbFN1bS8xMDAKYGBgCgoqKkJhc2VkIG9uIHRoZXNlIGRhdGEsIHdvdWxkIHlvdSBjb25jbHVkZSB0aGF0IHRoZSBvYnNlcnZlZCBuZXR3b3JrIGRlbW9uc3RyYXRlcyBzbWFsbCB3b3JsZCBwcm9wZXJ0aWVzPyBXaHkgb3Igd2h5IG5vdD8qKgoKIyMgV3JhcHBpbmcgdXAKVG8gY29tcGxldGUgdGhlIGxhYiwgbWFrZSBzdXJlIG91dHB1dC9wcmV2aWV3cyBoYXZlIGJlZW4gZ2VuZXJhdGVkIGZvciBlYWNoIGJsb2NrIG9mIGNvZGUuIFRoZW4gY2xpY2sgdGhlICJQdWJsaXNoIiBidXR0b24gb24gdGhlIHVwcGVyIHJpZ2h0IGhhbmQgY29ybmVyIG9mIHRoaXMgc2NyZWVuIGFuZCBzaWduIHVwIGZvciBhbiBSUHVicyBhY2NvdW50LiBTdWJtaXQgdGhlIFVSTCBvZiB0aGUgcHVibGlzaGVkLCBjb21wbGV0ZWQgbGFiIG9uIENhbnZhcy4=