filearray 0.2.0
- Additional
audo_set_headers to function
filearray_load_or_create to avoid automatically setting
headers, with default being TRUE for compatibility
concerns
filearray 0.1.9
- Fixed
CRAN check issue brought by testthat
update, which requires bit64 when checking
int64 arrays. Added bit64 to
Suggests field to mitigate this check error
filearray 0.1.8
- Fixed a bug where
C++ errors are not correctly thrown
due to a recent Rcpp update. This bug may cause erroneous
code to execute ignoring try-catch statement and imbalanced protecting
stacks (fwhich, mapreduce)
filearray 0.1.7
- Removed non-API R C interface
- Allows
subsetAssign to assign when value length is 1
(thanks @talegari issue #9)
- Allows more flexible
fwhich function with functional
val input and options to include corresponding values as
part of return (thanks @talegari issue
#10)
- Fixed
mapreduce bug when partition length is way larger
than the buffer size, causing buffer to stop updating
- Fixed other
C++ issues, such as unused buffer
allocation in subset-assign, and min_ offset in
sub_vec_range. These issues are not considered bugs since
they don’t affect the results, but the performance is slightly increased
after fix.
- Replaced
dipsaus with more updated
ravetools in the vignette performance profiling
- Updated examples to get rid of warning messages and out-dated
arguments.
filearray 0.1.6
- Removed
c++11 from system requirement and
Makevars
- Used
TinyThreads instead of OpenMP to get
parallel working on OSX
- Added
as_filearray method, and support optional
float
- Added array proxy class, allowing arrays to lazy-evaluate simple
operators
- Allows user-defined temporary file array path
- Fixed
fmap issues, using better guesses for default
.input_size
- Fixed a memory bug caused when partition margin has elements greater
than 1 and when
FARR_subset_sequential is used
- Used
fastmap to avoid environment look-up
fa_eval_ops allows dimension names
- Larger default buffer size to allow
2^20 in single
partition
- Disabled single indexing
- Fixed
endian issue on big-endian
platforms
filearray 0.1.5
- Fixed a bug when trying to read array data sequentially. The bug is
caused by buffer size being greater than the array length, making in a
pointer that controls the partition number exceed the end of vector,
resulting in undefined behavior. The functions affected are:
fmap, fmap2. The bug has been fixed and passed
valgrind memory check.
filearray 0.1.4
- Fixed a bug when allocated memory is one byte short than requested.
The bug would crash R when triggered in certain cases.
- Removed limit to the maximum number of partitions when writing. The
previous implementation creates and opens related file descriptors all
at once before writing. This setup will raise errors when the number of
connections reach to certain limit, often defined by the operating
systems. This update only opens the connection on demand. The
performance might be impacted when writing to disk, but in return, the
program will be more robust
- Fixed
subset function environment not resolved
correctly when using formula
- Added
filearray_load_or_create as an alternative to
filearray_checkload by automatically replace existing
obsolete array files if the headers, dimensions, or data types don’t
match. Also on_missing argument is provided to allow array
initialization if new array is created.
filearray 0.1.3
- Automatically detect whether symbolic-link works and show
warnings
- Warnings can be suppressed
- Allow extra headers to be set in
meta file
- Added header signature method
- Fixed symbolic-link issues on
Windows when partition
sizes are 0
- Added check-load function
filearray_checkload to
validate header
- Fixed collapse method when
dimnames are set
- Fixed an unprotected variable in
C++ code
filearray_bind can use cache if the header signatures
agree
filearray_bind can choose to force overwrite
- Added package
digest to Imports
- Fixed a typo and several small bugs
filearray 0.1.2
- Removed
flush in saving data to let system decide when
to flush to hard drive
- Allowed array to expand along the partition margin
- Fixed dimension name getting dropped under certain situations
- Use 2 cores by default when
R CMD check is
detected
filearray 0.1.1
- Added
OpenMP flag in the MakeVars
- Fixed critical bugs that could cause
segfaults
- Can store
complex and float data
types
- Re-implemented read/write functions to use memory map
- Allowed
dimnames to be set
- Added generics
subset to subset using
dimnames
- Added vignette to compare performance
- Added speed comparisons in
README.md
- Added
collapse to calculate marginal summation with
little memory overhead
- Added
fmap, fmap2 to apply functions to
one or multiple file arrays with little memory overhead (also very
fast)
- Fixed ‘unprotected’ issues warned by
rchk
filearray 0.1.0
- Added a
NEWS.md file to track changes to the
package.
- Initial implementation