SentimentalAnalysis

R Markdown

This is an R Markdown document. Markdown is a simple formatting syntax for authoring HTML, PDF, and MS Word documents. For more details on using R Markdown see http://rmarkdown.rstudio.com.

When you click the Knit button a document will be generated that includes both content as well as the output of any embedded R code chunks within the document. You can embed an R code chunk like this:

import nltk 
nltk.download('punkt_tab')

## True

from nltk.tokenize import word_tokenize
text = "Hello, world! This is a sample text for tokenization."
tokens = word_tokenize(text)
print("分词结果：", tokens)

## 分词结果： ['Hello', ',', 'world', '!', 'This', 'is', 'a', 'sample', 'text', 'for', 'tokenization', '.']