readDWD.hyras,
readDWD.asczip, checkUpdatesdataDWD: fileIndex warning now also visible for long
vectorsselectDWD: handles files removed from FTP but still in
indexreadDWD.multia: new argument tryenc to try different
encodingsreadDWD.data: convert timestamp to as.DatereadDWD.meta: reflect DWD changes (Abgabe column,
standard_format beschreibung file)readDWD.nc: flip the map uprightindexFTP: more options and checks, reflect removal of
tree.htmlnearbyStations: new arguments mindex and currentcheckIndex: checks + messages improved, false positives
excludedreadDWD.grib2: pack option rgdal removed.raster/rgdal/sp code replaced
with terra codedataDWD: dir default set to
locdir()findID+selectDWD: new argument
failempty to stop instead of warn if name does not matchreadDWD.grib2: rgdal retirement warning addeddataDWD + readDWD: new argument
hr to auto-merge historical and recent filescreateIndex: speed and correctness improvedrunLocalTests: tests expanded, internally
restructuredreadDWD: new argument quietreadplotDWDlocdir (will replace fixed “DWDdata” folder in
dataDWD)readDWD.derivreadDWD.rklimreadDWD.pdfvalidFileTypes (charstring vector) ## improvementsselectDWD: is completely rewritten and now vectorizes
expandinglydataDWD: new argument method, new default for
overwritemetaInfo: accepts custom indexreadDWD.radar: new argument dividebytenreadDWD.grib2: new argument packreadVars: new argument quiet (for
updateIndexes)readDWD.grib2: initial releaseprojectRasterDWD: new argument adjust05dataDWD: new default: dbin=TRUE ##
enhancements / bug fixesreadDWD.data: fread checks for system command
unzip, prints final value in messagedataDWD: unfound URL messages also link to website
fileIndex in German localeupdateRdwd: version and date comparison improved, print
local version if newer than on githubcreateIndex: improved recognition of
“Beschreibung_Stationen” meta filesdwdparams + updateIndexes:
missing/duplicate ‘Kurz’ entry messages improvedreadDWD: subfunction names in elegant message outside
the loop to avoid interrupted progbars.indexFTP + dirDWD: trailing slashes
removed with regexpfileType: more informative message for failed type
determinationDEU: now derived from NUTS regions and with new CRS
(along with EUR)runLocalTests: improved logfiles, false positive
messages removed ## website changesdataDWD: argument file renamed to url
to avoid confusion with local file namesreadDWD: fread default set to NA. This is an
experiment, see issue #22readDWD: now has argument type (determined by
new function fileType) to replace the ever growing list of
typesdataDWD, readDWD, selectDWD:
order of arguments changed to reflect importanceplotRadar: gains arguments axes, las,
zlim, col, mar, keeppar.
main now defaults to (and correctly keeps) x@title.selectDWD: gains argument remove_dupli to
ignore DWD file upload errorsreadDWD.*: All subfunctions message their identity and
have a quiet argumentrdwdquiet()readDWD.meta: station and bundesland names are now char
instead of factor (since R 4.0.0)indexFTP: new argument fast to read file tree
with data.tablecreateIndex: gains argument checklogrunLocalTests: new arguments for
devtools::check and checkIndexreadVars: params now an explicit argument
(defaults to dwdparams) ## enhancements / bug fixesEUR: extends further east for plots with large width
compared to heightupdateRdwd: unloads package before installation and
informs about the need to re-loadcheckIndex: new check for duplicate meta files, writes
to logfile (append, no overwrite), nicer path print, logs modification
time of index fileslldist: fix error that occurred when a df with a single
row was givenrunLocalTests: warning logfile cleared before writing,
checkIndex results included, false positives removed, on
githubreadDWD.*)metaInfo: from/to columns date conversion
correctedindexFTP + dataDWD: up to date and
centralized sleep informationdataDWD: Download failure message improved, refer to
fileIndex section on homepage if applicable.readDWD.nc: ncdf warning suppressedselectDWD: combines all warnings within the loop to a
single message ## website changesplotRadar used for nice mapsquiet=TRUE all the timeprojectRasterDWD: latlon=T/F replaced with
targetprojreadDWD.binary: output list element renamed to ‘dat’
(from ‘data’) for consistency with other functionsdataDWD: new argument dbinupdateRdwd, plotRadar ##
enhancements / bug fixesreadDWD.data: now correctly reads 10 minute
timestampsreadDWD.meta: column widths identified more elegantly
and safelyindexFTP: warn about requests to https instead of ftp
servers, new argument exclude.latest.binaddBorders: added sp to ‘Suggests’, moved
DEU + EUR to inst/extdata to handle CRAN
build+check on systems without sp installed ## website changesreadRadarFile expanded + moved to own package
(dwdradar) with proper tests and better warningsreadDWD.binary: untarring improvedprojectRasterDWD: default extents + projs added for
seasonal + ncreadDWD: order and documentation of method selection
improvedmetaIndex + fileIndex: date columns are
now of class DatedataDWD: force can now be number of hours
after which to re-downloadreadDWD.radar + readDWD.nc +
readDWD.standcheckSuggestedPackagesEUR + addBordersformatIndexrunLocalTestsupdateIndexes (not exported)readDWD subfunctions now have their own
documentation ## Important changes:dataDWD: arguments to readDWD removed (can
be passed with …)dataDWD: gains joinbf argument to join
base and relative url pathreadDWD: can expand DWD abbreviations in column names
(varnames=TRUE)readDWD: source code structure is improved.readDWD.multia: ignores EndOfFile characters in
multiannual data on UnixreadDWD.raster: accepts gunzip arguments,
reads faster on second callsreadDWD.data: informatively handles empty filesreadDWD.binary+raster+asc: overlay Germany maps in
example plotsreadDWD.binary: unzips into a given exdir (and
reads faster on second calls)readDWD.binary: transforms output to a raster
stackselectDWD: suggests only available data in interactive
optionselectDWD and nearbyStations: fail
informatively for typical errorsfileIndex: loses the unnnecessary leading slashesindexFTP: uses tree of files at new FTP server ## New
user-visible functions + objects:newColumnNamesdwdparams (renamed from
parameter_abreviations)gridbasegridIndexprojectRasterDWDlocaltestdir (though mainly for internal usage) ## New
unexported functions:readDWD.ascreadRadarfile + bin2num + FORTRAN
codecheckIndexFirst major version increase!
selectDWD got a very noticable performance boost and an
interactive res/var/per selection.dataDWD: dots now passed to
readDWD, download errors checked and returned as
informative warningreadDWD: reading functions added for binary, raster and
multi_annual files, MESS_DATUM POSIXct column added in monthly data,
list output now namedindexFTP: now removes duplicates from file list, sped
up in default 1min/prec usagereadVars: parameter abbreviations completed, output now
visibleselectDWD: order of arguments changed, interactive
res/var/per selection enabled, computing speed extremely
increasedlocaltests.R heavily expanded, examples reduced and
refinednearbyStations examplereadMeta,
dwdbase (central package base url)dataDWD: argument force can now be NA to
download files older than 24 hoursindexFTP: got much smarter in discerning files from
foldersreadVars, along with
parameter_abreviationsselectDWDdataDWD,readDWD,selectDWD:
file ending checks more elegantcreateIndex: updated to handle the new filesreadDWD: readDWD.data and readDWD.meta are now separate
(non-exported) functionsreadDWD: fread default is now FALSEdataDWD: fread and overwrite
arguments addedindexFTP: ftp blockage chance reduced, data loss
avoided, progress bar addedmetaInfo: tells about non-public filescreateIndex + readDWD: read meta files in
German locale to handle Umlauterenamed: indexDWD -> indexFTP
added: lldist, maxlldist,
nearbyStations
no longer exported in NAMESPACE: rowDisplay,
dirDWD
removed: fileDWD, geoIndexAll
geoIndexfileDWD
and dirDWDmetaInfo: printout greatly improvedrowDisplaygeoIndexAllmapDWD (to reduce package size)Initial release of the package, development can be seen at https://github.com/brry/rdwd/compare/master@{2016-10-19}...master@{2017-01-24}
- selectDWD: uses index information to find files matching
a path or station criteria. - With the returned path/file names,
dataDWD and readDWD download and read data. -
dirDWD and fileDWD: control that no file will
be overwritten and path messages are useful. - indexDWD:
lists all the files on the FTP server with DWD data. -
createIndex: uses that list to create
fileIndex, metaIndex and
geoIndex. - mapDWD: is an interactive leaflet
map also useful to explore datasets.
Note: dataDWD and readDWD were started in
June 2016 within my misc package berryFunctions, from which they will be
deleted after rdwd is on CRAN