
> 
> 
> dim(  data.table::fread(
+ 
    "/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv") )

+     "/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv") )



> 
|--------------------------------------------------|
|===========

  C-c C-c

==============

=  C-c C-c=  C-c C-c  C-c C-c  C-c C-c=======================|
|--------------------------------------------------|
|==================================================|
[1] 1085693      68
> 
> 
>class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="characcter"))) 
> 
> 
> 
> 
> 
    "/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv") )

>     "/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv") )

Error: unexpected ')' in "    "/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv")"
> 
> 
> 
> 
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="characcter")))
|--------------------------------------------------|
|==================================================|
Error in ans[[1L]] : subscript out of bounds
In addition: Warning message:
In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'characcter' not found in column name header (case sensitive), skipping.
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character")))
|--------------------------------------------------|
|==================================================|
Error in ans[[1L]] : subscript out of bounds
In addition: Warning message:
In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
> 
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=list(bin="character")))
Error in data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  : 
  select = 0 (select[1]) has no meaning. All values of select should be in the range [1,ncol=68].
> 
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character")))


|--------------------------------------------------|
|==================================================|
Error in ans[[1L]] : subscript out of bounds
In addition: Warning message:
In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
> > > 
> 
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character", is_relevant="logical")))
|--------------------------------------------------|
|==================================================|
Error in ans[[1L]] : subscript out of bounds
In addition: Warning messages:
1: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
2: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'logical' not found in column name header (case sensitive), skipping.
> sessionInfo()
R version 3.6.1 (2019-07-05)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 18.04 LTS

Matrix products: default
BLAS:   /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.7.1
LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.7.1

locale:
 [1] LC_CTYPE=en_IL       LC_NUMERIC=C         LC_TIME=en_IL       
 [4] LC_COLLATE=en_IL     LC_MONETARY=en_IL    LC_MESSAGES=en_IL   
 [7] LC_PAPER=en_IL       LC_NAME=C            LC_ADDRESS=C        
[10] LC_TELEPHONE=C       LC_MEASUREMENT=en_IL LC_IDENTIFICATION=C 

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

loaded via a namespace (and not attached):
[1] bit_1.1-14        compiler_3.6.1    tools_3.6.1       bit64_0.9-7      
[5] data.table_1.12.2
> 
> 
> library(data.table)
data.table 1.12.2 using 4 threads (see ?getDTthreads).  Latest news: r-datatable.com
> install.packages(data.table)
Installing package into ‘/workspace/xubuntu/R/x86_64-pc-linux-gnu-library/3.6’
(as ‘lib’ is unspecified)
Error in as.character(x) : 
  cannot coerce type 'closure' to vector of type 'character'
> 
> install.packages("data.table")
Installing package into ‘/workspace/xubuntu/R/x86_64-pc-linux-gnu-library/3.6’
(as ‘lib’ is unspecified)
trying URL 'https://cloud.r-project.org/src/contrib/data.table_1.12.8.tar.gz'
Content type 'application/x-gzip' length 4948391 bytes (4.7 MB)
==================================================
downloaded 4.7 MB

* installing *source* package ‘data.table’ ...
** package ‘data.table’ successfully unpacked and MD5 sums checked
** using staged installation
zlib 1.2.11 is available ok
** libs
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c assign.c -o assign.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c between.c -o between.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c bmerge.c -o bmerge.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c chmatch.c -o chmatch.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c cj.c -o cj.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c coalesce.c -o coalesce.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c dogroups.c -o dogroups.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fastmean.c -o fastmean.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fcast.c -o fcast.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fifelse.c -o fifelse.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fmelt.c -o fmelt.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c forder.c -o forder.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c frank.c -o frank.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fread.c -o fread.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c freadR.c -o freadR.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c froll.c -o froll.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c frollR.c -o frollR.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c frolladaptive.c -o frolladaptive.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fsort.c -o fsort.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fwrite.c -o fwrite.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c fwriteR.c -o fwriteR.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c gsumm.c -o gsumm.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c ijoin.c -o ijoin.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c init.c -o init.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c inrange.c -o inrange.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c nafill.c -o nafill.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c nqrecreateindices.c -o nqrecreateindices.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c openmp-utils.c -o openmp-utils.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c quickselect.c -o quickselect.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c rbindlist.c -o rbindlist.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c reorder.c -o reorder.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c shift.c -o shift.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c subset.c -o subset.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c transpose.c -o transpose.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c types.c -o types.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c uniqlist.c -o uniqlist.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c utils.c -o utils.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c vecseq.c -o vecseq.o
gcc -std=gnu99 -I"/usr/share/R/include" -DNDEBUG    -fopenmp -fpic  -g -O2 -fdebug-prefix-map=/build/r-base-p1m1mT/r-base-3.6.1=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -g  -c wrappers.c -o wrappers.o
gcc -std=gnu99 -shared -L/usr/lib/R/lib -Wl,-Bsymbolic-functions -Wl,-z,relro -o data.table.so assign.o between.o bmerge.o chmatch.o cj.o coalesce.o dogroups.o fastmean.o fcast.o fifelse.o fmelt.o forder.o frank.o fread.o freadR.o froll.o frollR.o frolladaptive.o fsort.o fwrite.o fwriteR.o gsumm.o ijoin.o init.o inrange.o nafill.o nqrecreateindices.o openmp-utils.o quickselect.o rbindlist.o reorder.o shift.o subset.o transpose.o types.o uniqlist.o utils.o vecseq.o wrappers.o -fopenmp -lz -L/usr/lib/R/lib -lR
mv data.table.so datatable.so
if [ "" != "Windows_NT" ] && [ `uname -s` = 'Darwin' ]; then install_name_tool -id datatable.so datatable.so; fi
installing to /workspace/xubuntu/R/x86_64-pc-linux-gnu-library/3.6/00LOCK-data.table/00new/data.table/libs
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** checking absolute paths in shared objects and dynamic libraries
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (data.table)

The downloaded source packages are in
	‘/tmp/RtmpReri22/downloaded_packages’
> 
> 
> 
> 
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character", is_relevant="logical")))
|--------------------------------------------------|
|==================================================|
Error in ans[[1L]] : subscript out of bounds
In addition: Warning messages:
1: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
2: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'logical' not found in column name header (case sensitive), skipping.
> 
> 
> class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character", is_relevant="logical"), data.table=TRUE))


|--------------------------------------------------|
|==================================================|
Error in ans[[1L]] : subscript out of bounds
In addition: Warning messages:
1: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
2: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'logical' not found in column name header (case sensitive), skipping.
> > > class(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character", is_relevant="logical"), data.table=TRUE, verbose=TRUE))
omp_get_num_procs()==8
R_DATATABLE_NUM_PROCS_PERCENT=="" (default 50)
R_DATATABLE_NUM_THREADS==""
omp_get_thread_limit()==2147483647
omp_get_max_threads()==8
OMP_THREAD_LIMIT==""
OMP_NUM_THREADS==""
data.table is using 4 threads. This is set on startup, and by setDTthreads(). See ?setDTthreads.
RestoreAfterFork==true
Input contains no \n. Taking this to be a filename to open
[01] Check arguments
  Using 4 threads (omp_get_max_threads()=8, nth=4)
  NAstrings = [<<NA>>]
  None of the NAstrings look like numbers.
  show progress = 1
  0/1 column will be read as integer
[02] Opening the file
  Opening file /workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv
  File opened, size = 2.419GB (2597586970 bytes).
  Memory mapped ok
[03] Detect and skip BOM
[04] Arrange mmap to be \0 terminated
  \n has been found in the input and different lines can end with different line endings (e.g. mixed \n and \r\n in one file). This is common and ideal.
[05] Skipping initial rows if needed
  Positioned on line 1 starting: <<bin,bin_source,dummy_bin,is_re>>
[06] Detect separator, quoting rule, and ncolumns
  Detecting sep automatically ...
  sep=','  with 100 lines of 68 fields using quote rule 0
  Detected 68 columns on line 1. This line is either column names or first data row. Line starts as: <<bin,bin_source,dummy_bin,is_re>>
  Quote rule picked = 0
  fill=false and the most number of columns found is 68
[07] Detect column types, good nrow estimate and whether first row is column names
  Number of sampling jump points = 100 because (2597586969 bytes from row 1 to eof) / (2 * 2109253 jump0size) == 615
  Type codes (jump 000)    : 5A226AA5AAAAAAAA5AAA5AAAA252AAA2AA555555A7572757A5555AAAAA555577AAAA  Quote rule 0
  Type codes (jump 100)    : 5A226AA5AAAAAAAA5AAA5AAAA252AAA2AA555555A7572757A5555AAAAA555577AAAA  Quote rule 0
  'header' determined to be true due to column 1 containing a string on row 1 and a lower type (int32) in the rest of the 10100 sample rows
  =====
  Sampled 10100 rows (handled \n inside quoted fields) at 101 jump points
  Bytes from first data row on line 2 to the end of last row: 2597586091
  Line length: mean=2718.84 sd=-nan min=311 max=381192
  Estimated number of rows: 2597586091 / 2718.84 = 955401
  Initial alloc = 1910802 rows (955401 + 100%) using bytes/max(mean-2*sd,min) clamped between [1.1*estn, 2.0*estn]
  =====
[08] Assign column names
[09] Apply user overrides on column types
  After 0 type and 68 drop user overrides : 00000000000000000000000000000000000000000000000000000000000000000000
[10] Allocate memory for the datatable
  Allocating 0 column slots (68 - 68 dropped) with 1910802 rows
[11] Read the data
  jumps=[0..956), chunk_size=2717140, total_size=2597586091
|--------------------------------------------------|
|==================================================|
Read 1085693 rows x 0 columns from 2.419GB (2597586970 bytes) file in 00:03.822 wall clock time
[12] Finalizing the datatable
  Type counts:
        68 : drop      '0'
=============================
   0.000s (  0%) Memory map 2.419GB file
   0.609s ( 16%) sep=',' ncol=68 and header detection
   0.000s (  0%) Column type detection using 10100 sample rows
   0.000s (  0%) Allocation of 1910802 rows x 68 cols (0.000GB) of which 1085693 ( 57%) rows used
   3.213s ( 84%) Reading 956 chunks (0 swept) of 2.591MB (each chunk 1135 rows) using 4 threads
   +    3.074s ( 80%) Parse to row-major thread buffers (grown 0 times)
   +    0.000s (  0%) Transpose
   +    0.139s (  4%) Waiting
   0.000s (  0%) Rereading 0 columns due to out-of-sample type exceptions
   3.822s        Total
Error in ans[[1L]] : subscript out of bounds
In addition: Warning messages:
1: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
2: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'logical' not found in column name header (case sensitive), skipping.
> 
> 
> 
> x<-(data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin="character", is_relevant="logical"), data.table=TRUE, verbose=TRUE))
omp_get_num_procs()==8
R_DATATABLE_NUM_PROCS_PERCENT=="" (default 50)
R_DATATABLE_NUM_THREADS==""
omp_get_thread_limit()==2147483647
omp_get_max_threads()==8
OMP_THREAD_LIMIT==""
OMP_NUM_THREADS==""
data.table is using 4 threads. This is set on startup, and by setDTthreads(). See ?setDTthreads.
RestoreAfterFork==true
Input contains no \n. Taking this to be a filename to open
[01] Check arguments
  Using 4 threads (omp_get_max_threads()=8, nth=4)
  NAstrings = [<<NA>>]
  None of the NAstrings look like numbers.
  show progress = 1
  0/1 column will be read as integer
[02] Opening the file
  Opening file /workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv
  File opened, size = 2.419GB (2597586970 bytes).
  Memory mapped ok
[03] Detect and skip BOM
[04] Arrange mmap to be \0 terminated
  \n has been found in the input and different lines can end with different line endings (e.g. mixed \n and \r\n in one file). This is common and ideal.
[05] Skipping initial rows if needed
  Positioned on line 1 starting: <<bin,bin_source,dummy_bin,is_re>>
[06] Detect separator, quoting rule, and ncolumns
  Detecting sep automatically ...
  sep=','  with 100 lines of 68 fields using quote rule 0
  Detected 68 columns on line 1. This line is either column names or first data row. Line starts as: <<bin,bin_source,dummy_bin,is_re>>
  Quote rule picked = 0
  fill=false and the most number of columns found is 68
[07] Detect column types, good nrow estimate and whether first row is column names
  Number of sampling jump points = 100 because (2597586969 bytes from row 1 to eof) / (2 * 2109253 jump0size) == 615
  Type codes (jump 000)    : 5A226AA5AAAAAAAA5AAA5AAAA252AAA2AA555555A7572757A5555AAAAA555577AAAA  Quote rule 0
  Type codes (jump 100)    : 5A226AA5AAAAAAAA5AAA5AAAA252AAA2AA555555A7572757A5555AAAAA555577AAAA  Quote rule 0
  'header' determined to be true due to column 1 containing a string on row 1 and a lower type (int32) in the rest of the 10100 sample rows
  =====
  Sampled 10100 rows (handled \n inside quoted fields) at 101 jump points
  Bytes from first data row on line 2 to the end of last row: 2597586091
  Line length: mean=2718.84 sd=-nan min=311 max=381192
  Estimated number of rows: 2597586091 / 2718.84 = 955401
  Initial alloc = 1910802 rows (955401 + 100%) using bytes/max(mean-2*sd,min) clamped between [1.1*estn, 2.0*estn]
  =====
[08] Assign column names
[09] Apply user overrides on column types
  After 0 type and 68 drop user overrides : 00000000000000000000000000000000000000000000000000000000000000000000
[10] Allocate memory for the datatable
  Allocating 0 column slots (68 - 68 dropped) with 1910802 rows
[11] Read the data
  jumps=[0..956), chunk_size=2717140, total_size=2597586091


|--------------------------------------------------|
|==================================================|
Read 1085693 rows x 0 columns from 2.419GB (2597586970 bytes) file in 00:04.437 wall clock time
[12] Finalizing the datatable
  Type counts:
        68 : drop      '0'
=============================
   0.000s (  0%) Memory map 2.419GB file
   0.609s ( 14%) sep=',' ncol=68 and header detection
   0.000s (  0%) Column type detection using 10100 sample rows
   0.000s (  0%) Allocation of 1910802 rows x 68 cols (0.000GB) of which 1085693 ( 57%) rows used
   3.828s ( 86%) Reading 956 chunks (0 swept) of 2.591MB (each chunk 1135 rows) using 4 threads
   +    3.475s ( 78%) Parse to row-major thread buffers (grown 0 times)
   +    0.000s (  0%) Transpose
   +    0.353s (  8%) Waiting
   0.000s (  0%) Rereading 0 columns due to out-of-sample type exceptions
   4.437s        Total
Error in ans[[1L]] : subscript out of bounds
In addition: Warning messages:
1: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
2: In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'logical' not found in column name header (case sensitive), skipping.
> > > 
> 
> 
> 
> 
>  x <- data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin
          ="character"), data.table = T, verbose = T) 
 x <- data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv", select=c(bin
+           ="character"), data.table = T, verbose = T) 
> 
omp_get_num_procs()==8
R_DATATABLE_NUM_PROCS_PERCENT=="" (default 50)
R_DATATABLE_NUM_THREADS==""
omp_get_thread_limit()==2147483647
omp_get_max_threads()==8
OMP_THREAD_LIMIT==""
OMP_NUM_THREADS==""
data.table is using 4 threads. This is set on startup, and by setDTthreads(). See ?setDTthreads.
RestoreAfterFork==true
Input contains no \n. Taking this to be a filename to open
[01] Check arguments
  Using 4 threads (omp_get_max_threads()=8, nth=4)
  NAstrings = [<<NA>>]
  None of the NAstrings look like numbers.
  show progress = 1
  0/1 column will be read as integer
[02] Opening the file
  Opening file /workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv
  File opened, size = 2.419GB (2597586970 bytes).
  Memory mapped ok
[03] Detect and skip BOM
[04] Arrange mmap to be \0 terminated
  \n has been found in the input and different lines can end with different line endings (e.g. mixed \n and \r\n in one file). This is common and ideal.
[05] Skipping initial rows if needed
  Positioned on line 1 starting: <<bin,bin_source,dummy_bin,is_re>>
[06] Detect separator, quoting rule, and ncolumns
  Detecting sep automatically ...
  sep=','  with 100 lines of 68 fields using quote rule 0
  Detected 68 columns on line 1. This line is either column names or first data row. Line starts as: <<bin,bin_source,dummy_bin,is_re>>
  Quote rule picked = 0
  fill=false and the most number of columns found is 68
[07] Detect column types, good nrow estimate and whether first row is column names
  Number of sampling jump points = 100 because (2597586969 bytes from row 1 to eof) / (2 * 2109253 jump0size) == 615
  Type codes (jump 000)    : 5A226AA5AAAAAAAA5AAA5AAAA252AAA2AA555555A7572757A5555AAAAA555577AAAA  Quote rule 0
  Type codes (jump 100)    : 5A226AA5AAAAAAAA5AAA5AAAA252AAA2AA555555A7572757A5555AAAAA555577AAAA  Quote rule 0
  'header' determined to be true due to column 1 containing a string on row 1 and a lower type (int32) in the rest of the 10100 sample rows
  =====
  Sampled 10100 rows (handled \n inside quoted fields) at 101 jump points
  Bytes from first data row on line 2 to the end of last row: 2597586091
  Line length: mean=2718.84 sd=-nan min=311 max=381192
  Estimated number of rows: 2597586091 / 2718.84 = 955401
  Initial alloc = 1910802 rows (955401 + 100%) using bytes/max(mean-2*sd,min) clamped between [1.1*estn, 2.0*estn]
  =====
[08] Assign column names
[09] Apply user overrides on column types
  After 0 type and 68 drop user overrides : 00000000000000000000000000000000000000000000000000000000000000000000
[10] Allocate memory for the datatable
  Allocating 0 column slots (68 - 68 dropped) with 1910802 rows
[11] Read the data
  jumps=[0..956), chunk_size=2717140, total_size=2597586091


|--------------------------------------------------|
|==================================================|
Read 1085693 rows x 0 columns from 2.419GB (2597586970 bytes) file in 00:03.995 wall clock time
[12] Finalizing the datatable
  Type counts:
        68 : drop      '0'
=============================
   0.000s (  0%) Memory map 2.419GB file
   0.612s ( 15%) sep=',' ncol=68 and header detection
   0.000s (  0%) Column type detection using 10100 sample rows
   0.000s (  0%) Allocation of 1910802 rows x 68 cols (0.000GB) of which 1085693 ( 57%) rows used
   3.383s ( 85%) Reading 956 chunks (0 swept) of 2.591MB (each chunk 1135 rows) using 4 threads
   +    3.159s ( 79%) Parse to row-major thread buffers (grown 0 times)
   +    0.000s (  0%) Transpose
   +    0.223s (  6%) Waiting
   0.000s (  0%) Rereading 0 columns due to out-of-sample type exceptions
   3.995s        Total
Error in ans[[1L]] : subscript out of bounds
In addition: Warning message:
In data.table::fread("/workspace/data/blocked-view/nyc_building_object/nyc_building_object_20191231.csv",  :
  Column name 'character' not found in column name header (case sensitive), skipping.
> > > 
> 
> 
> 
>  