We will create two sets of keywords to gauge number of false positive cases.
threat <- c('hostile', 'danger', 'risk', 'threat', 'pressure', 'incident', 'use of force', 'emergency')
threat_ext <- c('safety', 'security', 'defence', 'war', 'casualty', 'death') # need many more
We will identify if those keywords are use in the context of military or diplomatic threat in actual text segments. We will ask workers on crowd sourcing platform to determine (1) if text segments are about military or diplomatic threat, and, if so, (2) from which country the threat is coming.
For example, the text segment around 10 in Document 3 can be understood that threat is coming from China. Dictionary analysis can capture this. The text segment around 253 in Document 5 is not about diplomatic or military threat, suggesting “security” should not be in the keyword set.
Dictionary analysis fails around 413 in Document 7, because the threat is not from ‘Thailand’, but it identifies that the threat is coming from Vietnam around 431 in the same document.
require(quanteda)
## Loading required package: quanteda
## quanteda version 0.99.9002
## Using 7 of 8 threads for parallel computing
##
## Attaching package: 'quanteda'
## The following object is masked from 'package:utils':
##
## View
corp <- readRDS('/home/kohei/Documents/Power balance/Data/data_corpus_guardian.RDS')
toks <- tokens(corp[1:10000])
kw <- kwic(toks, threat, window = 10)
nrow(kw)
## [1] 6859
kw_ext <- kwic(toks, c(threat, threat_ext), window = 10)
nrow(kw_ext)
## [1] 27350
knitr::kable(head(kw_ext, 100))
| docname | from | to | pre | keyword | post |
|---|---|---|---|---|---|
| 3 | 10 | 10 | | British Bigheads Wring Wee Wallets . A diplomatic | incident | is building up between the UK and China , claims |
| 4 | 312 | 312 | simply because it had to secure its year against a | hostile | and unpredictable regime which had Chinese backing . No doubt |
| 4 | 391 | 391 | ’ a power vacuum that constituted a menace to regional | security | . ’ | Indochina has suffered for 40 years - |
| 4 | 603 | 603 | at least one area the growing globalisation of the cold | war | which multiplies the threat to world peace . | The |
| 4 | 607 | 607 | the growing globalisation of the cold war which multiplies the | threat | to world peace . | The Kampuchea question is admittedly |
| 4 | 761 | 761 | here tomorrow morning . ’ | * Red Brotherhood at | War | . Verso Editions , pounds 6.95 . |
| 5 | 100 | 100 | Khrushchev’s ‘secret speech’ three years after the dictator’s | death | . | The speech is one of the score of |
| 5 | 253 | 253 | European workers prize and want to maintain , like job | security | , stable prices , relative social equality . | Polish |
| 5 | 761 | 761 | articles is Jon Halliday’s carefully documented one on the Korean | War | , which as he says badly needs to be rescued |
| 6 | 208 | 208 | the force should take total responsibility for the maintenance of | security | and law and order there . | The Israelis on |
| 6 | 257 | 257 | be an Israeli responsibility , although they agree that overall | security | should be safeguarded by the MFO . | The Israelis |
| 6 | 592 | 592 | emphasised to all parties the need for agreed and effective | security | arrangements in areas to be vacated by Israeli forces . |
| 7 | 156 | 156 | said that the Khmer Rouge are counter-attacking to relieve the | pressure | . | Mr Wu’s warning that China would be obliged |
| 7 | 413 | 413 | Government , cannot seriously be said to pose a military | threat | to Thailand . But Mr Wu’s warning against Vietnamese ’ |
| 7 | 431 | 431 | against Vietnamese ‘provocation’ of Thailand is a coded | threat | that , if the military balance changes too drastically within |
| 9 | 17 | 17 | won a pounds 50 million contract to supply China with | defence | related equipment consisting of message processing systems and interlinked radio |
| 13 | 119 | 119 | ‘she said ,’ I use it in my | defence | . I feel safe behind it . I feel very |
| 13 | 818 | 818 | and romantic view . Riot , arson , and sudden | death | were followed by curfew , the setting up of refugee |
| 13 | 841 | 841 | the Chinese , and the establishment of a state of | emergency | . The actual death toll was not large , a |
| 13 | 845 | 845 | the establishment of a state of emergency . The actual | death | toll was not large , a few hundred , but |
| 13 | 1785 | 1785 | century . | Ambivalent though the Chinese may be about | death | , they do not like anyone monkeying around with the |
| 13 | 1962 | 1962 | states with a multi-ethnic population . Only during ’ the | Emergency | ’ and the period which immediately preceded it was the |
| 13 | 2043 | 2043 | future . ’ We are not predicting an inevitable racial | war | , ’ write two university lecturers , Ishak Shari and |
| 13 | 2104 | 2104 | ethnic tension and conflict will remain of the ’ cold | war | ’ type , that is , without necessarily erupting . |
| 14 | 129 | 129 | critical biography of Taiwan’s President Chiang Ching-Kuo shortly before his | death | . | | Government sources said that President Chiang , |
| 16 | 801 | 801 | replied : ’ Muslims believe they will realise paradise after | death | . The Communists think they can turn the existing world |
| 18 | 326 | 326 | the biggest arms deal between the two countries since the | Defence | Secretary , Mr Caspar Weinberger , cleared the way for |
| 19 | 314 | 314 | of the world - and has achieved this while at | war | . President Castro’s visit will deepen Washington’s paranoia , or |
| 19 | 492 | 492 | with whom Western Europe has scant purchase . | The | war | in Nicaragua is different , since it involves a country |
| 21 | 215 | 215 | there was hardly a ‘scholar’ who foresaw the | death | of Pakistan . | India was caught in the pincer |
| 21 | 389 | 389 | the Ministry of Tourism ) . | The only real | danger | that India still faces comes from the same theocratic interests |
| 21 | 931 | 931 | not that the constant effort to distance oneself from ’ | hostile | India ’ can lead to dangerous geopolitics . It is |
| 22 | 114 | 114 | present Kampuchean conflict is a classic example of a political | war | : support for the anti-Vietnamese Coalition Government of democratic Kampuchea |
| 22 | 338 | 338 | , is less to gain terrain than to maintain political | pressure | . | One reason that the coalition’s backers are taking |
| 22 | 360 | 360 | reverses so calmly may be because this is an inexpensive | war | . The 240,000 refugees spread along the border are fed |
| 22 | 452 | 452 | KPNLF , not the Khmer Rouge , will win the | war | is an offence in Khmer Rouge areas . But China |
| 22 | 851 | 851 | Vietnamese operations in Kampuchea has been to increase the military | pressure | on the 720-mile border . This does not force Hanoi |
| 26 | 597 | 597 | honest peasants than at any time since the second world | war | . | The school system is not being Vietnamised , |
| 26 | 1239 | 1239 | Nations , the United States and China . | National | defence | takes priority over almost everything else , and this means |
| 26 | 1258 | 1258 | this means low incomes , slow economic recovery , strict | security | measures , particularly in the north and north-west , and |
| 27 | 228 | 228 | | The Hagfors Observatory , a wing of Sweden’s National | Defence | Research Institute , revealed yesterday that the nuclear powers had |
| 29 | 166 | 166 | a Fascist country . | ’ Fascism anywhere is a | threat | to the human family - Britain , Israel , Germany |
| 29 | 680 | 680 | right to vote - their lack of democracy is a | threat | to the integrity of ours . ’ | The Reagan |
| 29 | 851 | 851 | South Africa . ’ In both you have unions under | pressure | , the churches under pressure - but the criteria for |
| 29 | 856 | 856 | both you have unions under pressure , the churches under | pressure | - but the criteria for criticism are not the same |
| 29 | 957 | 957 | of Americans living in poverty and unemployment will increase the | pressure | for fundamental change in both domestic and foreign policy . |
| 29 | 1021 | 1021 | . These are devastating social effects of current policies . | Pressure | for change is coming from the bottom up . Hunger |
| 30 | 3 | 3 | | If | war | is the mother of invention : philanthropy can be its |
| 30 | 37 | 37 | the United States ’ most devastating weapons during the Vietnam | War | . Mounted in the rear of an aircraft , within |
| 30 | 130 | 130 | London for today’s executive meeting of International Physicians Against Nuclear | War | , Prof McCally explained how a good intention went lethally |
| 30 | 282 | 282 | The final straw was the discovery that , despite his | security | rating , he was denied access to work in the |
| 30 | 322 | 322 | dollars 7 million F-5s were being shot down with world | war | two ack-ack guns with a minimum of technology and a |
| 30 | 397 | 397 | already a centre of expertise . During the second world | war | it helped to design oxygen masks , heated flak suits |
| 30 | 418 | 418 | and the gun turrets of Superfortresses . | After the | war | it was partly staffed with German medical scientists who had |
| 30 | 624 | 624 | now grown up in the States , because of not | war | experiences but over such questions as withholding life support . |
| 30 | 671 | 671 | from black men with syphilis . ’ | The Vietnam | War | forced him to draw the line . ’ It’s a |
| 30 | 845 | 845 | makes him a useful voice in International Physicians Against Nuclear | War | during its current offensive . | This year’s dollars 1.6 |
| 30 | 1055 | 1055 | to learn to control our technology . The most striking | danger | about Star Wars is that it will be totally computer |
| 31 | 848 | 848 | crisis , and there were three during the second world | war | . | Between 1946 and 1971 , there were ten |
| 31 | 1013 | 1013 | law and order which can mean intolerance ; it means | death | . Pluto brings fanaticism , deep disruption , the underhand |
| 31 | 1152 | 1152 | violence within the UK . They did not think of | war | , for war is the unthinkable . But as soon |
| 31 | 1155 | 1155 | UK . They did not think of war , for | war | is the unthinkable . But as soon as the task |
| 31 | 1180 | 1180 | the Falklands , he says now , he knew that | war | was the inevitable too . | Turn now to the |
| 31 | 1768 | 1768 | from looking at the chart of the USSR , the | death | of Andropov - and that almost to the day . |
| 32 | 336 | 336 | this continuation is inevitable . ’ | This is where | defence | bureaucracies show their power . The British Defence Ministry , |
| 32 | 344 | 344 | is where defence bureaucracies show their power . The British | Defence | Ministry , the country’s largest employer with a staff of |
| 32 | 590 | 590 | mill create considerable production capacity which in turn will create | pressure | to find programmes to use that capacity . ’ | |
| 32 | 661 | 661 | four decades , of renegotiating alliances , of resisting industrial | pressure | , and of deciding what to do with the installations |
| 32 | 747 | 747 | select committees have no power to summon ministers . The | defence | committee has indeed complained that ’ Parliament’s role in the |
| 32 | 804 | 804 | to get full agreement of the Cabinet or of its | defence | and overseas policy committee , to the R & D |
| 32 | 847 | 847 | other ministers might disagree - and not for reasons of | security | . ’ | Cataloguing the ineffectiveness of parliaments , the |
| 32 | 945 | 945 | are apparently less prone to manipulation by scientists , and | pressure | is the other way round . The group found a |
| 32 | 1314 | 1314 | , you have to be seen to be preparing for | war | , and there is no difference between that and actually |
| 33 | 9 | 9 | | A secret report sent to the Cabinet’s | defence | committee showed how the allies considered the possibility of using |
| 33 | 67 | 67 | said : ’ Although the use of nuclear weapons in | war | against China would , from the military point of view |
| 33 | 121 | 121 | the Tongking Delta was of the greatest importance to the | defence | of South-east Asia , its loss ’ should not automatically |
| 33 | 182 | 182 | New Zealand . | The report said : ’ Should | war | with China be precipitated by Chinese Communist aggression in South-east |
| 34 | 47 | 47 | the British Government believed this could have led to nuclear | war | . | After the Vietminh victory over the French in |
| 34 | 110 | 110 | told the Cabinet in April that he doubted whether any | threat | would work . The coalition would have to either withdraw |
| 35 | 247 | 247 | re-election in the Senate . They will be under great | pressure | at a time when Reagan will be seen as a |
| 35 | 908 | 908 | only the first step toward a more secure world . | Pressure | would have to continue until deep cuts in nuclear arms |
| 35 | 1097 | 1097 | , China and France , would then be under great | pressure | to follow . | Opposition of the British Government to |
| 35 | 1113 | 1113 | of the British Government to US plans For space-based missile | defence | may present an important opportunity for common ground with supporters |
| 35 | 1206 | 1206 | a member of International Physicians for the Prevention of Nuclear | War | and a member of the steering group of the UK |
| 37 | 121 | 121 | to write with more reverence about Emperor Hirohito , whose | war | responsibility is not mentioned . | | ’ The new |
| 37 | 233 | 233 | Unions alleged this year that the Education Ministry had increased | pressure | on publishers to reflect the Government line . Citing the |
| 37 | 424 | 424 | to make the new generation more receptive to the country’s | defence | policies . | Although textbook writers have experienced pressure for |
| 37 | 433 | 433 | country’s defence policies . | Although textbook writers have experienced | pressure | for decades - Professor Ienaga’s longest-running suit concerns censorship of |
| 37 | 514 | 514 | - served by school textbooks that reported the horrors of | war | . | First it was necessary to refurbish the image |
| 37 | 529 | 529 | was necessary to refurbish the image of the 250,000-strong Self | Defence | Forces , who are given most favoured treatment in the |
| 37 | 615 | 615 | suppressing dissenting voices about the legal status of the Self | Defence | Forces , Professor Ienaga says . | ’ It was |
| 38 | 138 | 138 | , and Britain ( as permanent members of the UN | Security | Council ) as well as India , Japan , and |
| 40 | 219 | 219 | in the region generally , with particular reference to the | threat | which , they say , is posed by China . |
| 42 | 47 | 47 | ’ placed him one step away from a declaration of | war | . ’ He said , however , that the comments |
| 42 | 245 | 245 | Although Sandinista rhetoric has been kept to a minimum , | defence | preparations are quietly being speeded up . In the past |
| 44 | 871 | 871 | rising birth rates as in China or uncontrolled and rising | death | rates . | Conventional economists would also be well-advised to |
| 44 | 1443 | 1443 | atmosphere by fossil fuel burning may well pose a serious | threat | , as the Worldwatch Institute argues . But slower growth |
| 45 | 44 | 44 | systems pushing retail sales to record highs and placing unprecedented | pressure | on the domestic market . | | The lifting of |
| 46 | 399 | 399 | forces inside Kampuchea so we don’t think we’ve lost the | war | , ’ one soldier remarked . | The Vietnamese successes |
| 48 | 243 | 243 | ’ is a near-universal in our culture . Workers are | hostile | to state interference and devoted to self-reliance . They are |