Plotting of very large data sets in R

How can I plot a very large data set in R?

I'd like to use a boxplot, or violin plot, or similar. All the data cannot be fit in memory. Can I incrementally read in and calculate the summaries needed to make these plots? If so how?

Answers


In supplement to my comment to Dmitri answer, a function to calculate quantiles using ff big-data handling package:

ffquantile<-function(ffv,qs=c(0,0.25,0.5,0.75,1),...){
 stopifnot(all(qs<=1 & qs>=0))
 ffsort(ffv,...)->ffvs
 j<-(qs*(length(ffv)-1))+1
 jf<-floor(j);ceiling(j)->jc
 rowSums(matrix(ffvs[c(jf,jc)],length(qs),2))/2
}

This is an exact algorithm, so it uses sorting -- and thus may take a lot of time.


Need Your Help

App logo in actionbar appears larger on tablet vs phone

android android-resources nexus-7 android-icons

I'm having trouble figuring out why my app logo in the actionbar appears larger on a nexus 7 vs a nexus 5. I'm using the actionbar in the support library. They're both running android 4.2.2

SQL Query /stored procedure to get complete organization hierarchy detail

sql-server-2008 tsql stored-procedures common-table-expression

I tried and searched the solution for the below problem statement but unfortunately I didn't get the exact output. I need to display the complete organizational hierarchy in the below format. I tried

About UNIX Resources Network

Original, collect and organize Developers related documents, information and materials, contains jQuery, Html, CSS, MySQL, .NET, ASP.NET, SQL, objective-c, iPhone, Ruby on Rails, C, SQL Server, Ruby, Arrays, Regex, ASP.NET MVC, WPF, XML, Ajax, DataBase, and so on.