R과 RStudio를 이용한 재현가능한 연구

• Replication ? Reproducible Research ?
• Reproducible research using RStudio

• The Confirmation of Results and Conclusions From One Study obtained independently in another

• is considered the scientific gold stanadrd

• Replication of findings and conducting studies with independent

  • Investigators
  • Data
  • Analytic Methods
  • Laboratories
  • Instruments

• Replication is particularly important in studies that can impact broad policy or regulatory decisions

• Some studies cannot be replicated

  • No time, opportunistic : 장기간 연구
  • No money : 대규모 무작위 - 대조군 연구
  • Unique

• 대규모 , 장기간 연구가 아닌 경우

  • replication이 가능할까?

• Selected articles published in Nature Genetics between January 2005 and December 2006 that had used profiling with microarrays

• Of the 56 items retrieved electronically, 20 articles were considered potentially eligible for the project

• The four teams were from

  • University of Alabama at Birmingham(UAB)
  • Stanford/Dana-Farber(SD)
  • London(L)
  • Ioannina/Trento(IT)

• Each team was comprised of 3-6 scientists who worked together to evaluate each article.

• Result could be reproduced : n=2

• Reproduced with discrepancy : n=6

• Could not be reproduced : n=10

  • No data n=4 (no data n=2, subset n=1, no reporter data n=1)
  • Confusion over matching of data to analysis (n=2)
  • Specialized software required and not available (n=1)
  • Raw data available but could not be processed (n=2)

• data and the computer code used to analyze the data be made available to others
• attainable minimum reproducibility standard
• fill the gap between full replication of a study and no replication

• New technologies increasing data collection throughput; data are more complex and extremely high dimensional
• Existing databases can be merged into new “megadatabases”
• Computing power is greatly increased, allowing more sophisticated analyses
• For every field “X” there is a field “Computational X”

• Estimating small (but important) health effects in the presence of much stronger signals
• Results inform substantial policy decisions, affect many stakeholders
  • EPA regulations can cost billions of dollars
• Complex statistical methods are needed and subjected to intense scrutiny

• genomics
• transcriptomics
• proteomics
• metabolomics

In the Discovery/Test Validation stage of omics-based tests:

• Data/metadata used to develop test should be made publicly available
  
• The computer code and fully specified computational procedures used for development of the candidate omics-based test should be made sustainably available
• “Ideally, the computer code that is released will encompass all of the steps of computational analysis, including all data preprocessing steps, that have been described in this chapter. All aspects of the analysis need to be transparently reported.”

Why R ?

• (왜 R을 써야 하지?)

RStudio ?

• (이건 또 뭐지? 듣보잡)

Reproducible research using R and RStudio

• (이건 또 뭥미?)

왜 R을 써야 하지 ?

• 난 SPSS는 쓸줄 안다.
• SAS는 넘사벽…. R도 어렵다.
• 새로운 걸 배우기 싫다. 이 나이에…
• 그냥 하던대로 할랜다. 그게 속 편하다. 내 맘이다.

acs 데이타의 모든 변수를 진단명별로 비교해서 표를 만들어라

mytable(Dx ~ ., data=acs)

전체 환자를 남여로 나눈 후 당뇨가 있는 환자/없는 환자로 나누어 표를 그린다.

mytable(sex+DM~.,data=acs)

Literate Programing

• (문학적 프로그래밍)

Reproducible Research

• (재현가능한 연구)

• “Remember that microarray analysis you did six months ago?
  We ran a few more arrays.
  Can you add them to the project and repeat the same analysis?”
• “The statistical analyst who looked at the data I generated previously is no longer available.
  Can you get someone else to analyze my new data set using the same methods (and thus producing a report I can expect to understand)”
• “Please write/edit the methods sections for the abstract/paper/grant proposal I am submitting based on the analysis you did several months ago.”

1. Collect and manage data(EXCEL)

2. Analysis (R/SPSS)

3. Writeup(WORD)

Integrating

• 1. Data management
• 2. Data analysis
• 3. Writing up results

in a single dynamic document

Reproducible research !!

- If spotting eror in data, or using different dataset…

- make changes in Rmarkdown and report will update automatically

• Reproducible research is important as a minimum standard, particularly for studies that are difficult to replicate
  
• Infrastructure is needed for creating and distributing reproducible documents, beyond what is currently available
  
• There is a growing number of tools for creating reproducible documents
  

*의학논문작성을 위한 R통계와 그래프

*R을 이용한 누구나 하는 통계분석

*R과 knitr를 활용한 데이타 연동형 문서 만들기

Online Resources

*www.rstudio.com

*ztable 소개

*Web based analysis using moonBook

온라인교육프로그램

*Coursera : Reproducible Research (Jones Hopkins University)