4.10.0 - February 25, 2026

• Regularize, cleanup, and refactor various AWS features, especially WRT regularizing AWS-related constants. See Github 3229 for more information.
• Add extra failure handling to the daos inferencing. See Github 3238 for more information.
• Regularize, cleanup, and refactor various AWS features, especially WRT regularizing AWS-related constants. See Github 3229 for more information.
• Add compatibility with HDF5 2.0.0. See Github #3247 for more information.
• Introduce consolidated metadata Github #3225 via mode=consolidated or NCZARR_CONSOLIDATED
• Fix the H5FD_class_t problems. See Github 3202 for more information.
• Begin the consolidation of global state into two files: libdispatch/dglobal.c and include/ncglobal.h. See Github 3197 for more information.
• Modify the way xarray attribute sets are handled. See Github 3218 for more information.
• Fix Issue with Numcodecs encoding problems where integer filter parameters are being encoded as strings. See Github 3201 for more information.
• Clean up minor problems with DAP2/DAP4 code. See Github #3215 for more information.
• Cleanup RELEASE_NOTES.md. See Github 3190 for more information.
• Rebuild the S3-related code and other changes necessary to build cleanly on github actions. See Github #3159 for more information.
• Fix the problems around ncdap_test/test_manyurls.c. See Github 3182 for more information.
• Fix bug in ncdump when printing FQNs (Issue 3184). See Github 3185 for more information.
• Update macOS github runners from macos-13 to macos-14, due to deprecation.
• Fix an error compiling netCDF with AWS-S3-SDK support using cmake. See Github 3155 for more information.
• Add new environmental logging variable for netCDF4 related logging subsystem, NC4LOGGING. If libnetcdf is compiled with logging enabled, logs can be enabled at runtime by setting this environmental variable to the desired log level.
• Update ncjson.[ch] and ncproplist.[ch]. Also fix references to old API. Also fix include/netcdf_ncjson.h and include/netcdf_proplist.h builds. See Github #3086 for more information.
• Refactor drc.c to move many of its purely utility functions into dutil.c. Also change the NC_mktmp signature. Change other files to match. See Github #3094 for more information.
• Provide an auxiliary function, ncaux_parse_provenance(), that allows users to parse the _NCProperties attribute into a collection of character pointers. See Github #3088 for more information.
• Fix a namespace problem in tinyxml2.cpp. Note that this is a visual studio problem hence use of _MSC_VER. Also turn off DAP4 tests against Hyrax server until DAP4 spec problems are fixed. See Github #3089 for more information.

What's Changed

• Merge v4.9.3 wellspring changes back upstream. by @WardF in #3084
• Provide an auxilliary function that allows users to parse the _NCProperties attribute. by @DennisHeimbigner in #3088
• Correct issue with .exe installer generation. by @WardF in #3096
• Correct a syntax error in previous packaging fix. by @WardF in #3097
• Fix SIGFPE with -0.0 values and quantization by @czender in #3093
• Give config.h a higher precedence. by @drwells in #3100
• Fix reported memory leak by @WardF in #3102
• Fix bug in copying compound types with variable length fields. by @DennisHeimbigner in #3111
• Step 1 in splitting PR 3068 by @DennisHeimbigner in #3086
• Create docker_regression_testing.yml by @WardF in #3116
• Add a one-off test for java. by @WardF in #3117
• Step 2 in splitting PR 3068 by @DennisHeimbigner in #3089
• Updated copyright by @WardF in #3119
• Fix various problems with S3 related code by @DennisHeimbigner in #3090
• Broken S3 implementation for netcdf files on non-AWS + Authenticated buckets by @mannreis in #3098
• Modify provenance check "_IsNetcdf4" to check for existence of "_NCProperties" by @DennisHeimbigner in #3125
• Fix pointer type on 64-bit Windows by @WardF in #3140
• Rebase of #3138 by @WardF in #3142
• Remove strlcpy from libdispatch by @weiznich in #3138
• Updates for versioned H5Dread_chunk by @brtnfld in #3143
• Change order of operations so that data is not referenced after being freed. by @WardF in #3146
• Fix Segmentation Fault when testing URLs with no path by @mannreis in #3095
• Only conditionally copy test files by @magnusuMET in #3133
• hdf5open.c: Handle null dataspace gracefully by @Dave-Allured in #3135
• CMake: correct the byterange flag by @jmckenna in #3131
• CMake: handle _INCLUDE_DIR not leveraged at compile time by @jmckenna in #3132
• CMake: Bring nczarr dependency when enabling S3 in line with autotools by @WardF in #3149
• Create PR to support refactor of drc.c code. by @DennisHeimbigner in #3094
• Patch #3090 - Fix and test S3 enabled builds by @mannreis in #3122
• Update Software list with contribution. by @WardF in #3152
• Fix integer overflow vulnerability in NC string memory allocation by @dkjsone in #3153
• Remove unneeded dependency by @WardF in #3158
• Address logging via environmental variable issues. by @WardF in #3160
• Add failover default AWS region aws_default_region "us-east-1" by @WardF in #3164
• Added NC4LOGGING to RELEASE_NOTES.md by @WardF in #3166
• Xattr header detection fix.wif by @WardF in #3167
• nc4hdf.c: Fix overwrite with zero-length attribute by @Dave-Allured in #3169
• CMake Builder Docs: document m4 dependency by @johnwparent in #3173
• Fix an issue with using AWS S3 SDK and Cmake. by @WardF in #3174
• Updated Github MacOS runners from macos-13 to macos-14 by @WardF in #3180
• Fix bug in ncdump when printing dimension FQN by @DennisHeimbigner in #3185
• Fix the problems around ncdap_test/test_manyurls.c. by @DennisHeimbigner in #3182
• General Cleanup to provide a clean base for future PRs. by @DennisHeimbigner in #3159
• Cleanup RELEASE_NOTES.md by @DennisHeimbigner in #3190
• ticket #TSP-8629412 bug fix by @dkjsone in #3191
• ncgen unsigned suffix fix by @jatkinson1000 in #3189
• run_zero_len_att_test.sh: Improve error message by @Dave-Allured in #3170
• Fix S3 internal configuration error by @gsjaardema in #3175
• Fix UBSan warnings about out-of-range assignment by @seanm in #3210
• Clean up minor issues in DAP2+DAP4 code by @DennisHeimbigner in #3215
• Added codespell config file, fixed a bunch of spelling mistakes by @seanm in #3211
• Fixed UBSan warnings about left shifts into the sign bit by @seanm in #3207
• Fix Issue with Numcodecs encoding problems by @DennisHeimbigner in #3201
• Initial basic editorconfig support by @seanm in #3212
• Fixed UBSan warnings about offsetting a NULL pointer by @seanm in #3206
• Modify the way xarray attribute sets are handled. by @DennisHeimbigner in https://github...

Known Issues

Parallel operation using mpich 4.2.0 (the default on Ubuntu 24.04) results in 'unexpected results' when running nc_test4/run_par_test.sh. This can be fixed by removing mpich and associated libraries and development packages and installing mpich 4.2.2 by hand, or by using openmpi provided via apt.

Release Notes

• Extend the netcdf API to support programmatic changes to the plugin search path. See Github #3034 for more information.

What's Changed

• "Simplify" XGetopt usage by @DennisHeimbigner in #2678
• Fix bug in szip handling. by @DennisHeimbigner in #2679
• Add documentation for logging by @edwardhartnett in #2677
• v4.9.2 Wellspring branch by @WardF in #2660
• Combine DAP4 test server fixes, resolve a couple conflicts. by @WardF in #2681
• Cleanup DAP4 testing by @DennisHeimbigner in #2555
• Fix DAP4 remotetest server by @DennisHeimbigner in #2558
• Fix issue #2674 by @uweschulzweida in #2675
• Check at nc_open if file appears to be in NCZarr/Zarr format. by @DennisHeimbigner in #2658
• Fix a syntax issue in CMakeLists.txt by @WardF in #2693
• hdf5open: check for the H5L info structure version directly by @mathstuf in #2695
• Improve S3 documentation, testing and support by @DennisHeimbigner in #2686
• Fix potential dead store by @ZhipengXue97 in #2644
• CI: Test --without-plugin-dir on Cygwin by @DWesl in #2659
• Fix handling of CURLOPT_CAINFO and CURLOPT_CAPATH by @DennisHeimbigner in #2690
• Adding a workaround for older versions of cmake by @WardF in #2703
• Remove obsolete code by @DennisHeimbigner in #2680
• Improve performance of the nc_reclaim_data and nc_copy_data functions. by @DennisHeimbigner in #2699
• CMakeLists.txt use ON vs yes, indent by @poelmanc in #2663
• Fix some dependency conditions between some ncdump tests. by @DennisHeimbigner in #2682
• awsincludes: remove executable permissions by @mathstuf in #2689
• Fix some problems with Earthdata authorization. by @DennisHeimbigner in #2709
• Provide a single option to disable all network access and testing. by @DennisHeimbigner in #2708
• Fix building on macOS by @skosukhin in #2710
• Update tinyxml and allow its use under OS/X. by @DennisHeimbigner in #2711
• Suppress filters on variables with non-fixed-size types. by @DennisHeimbigner in #2716
• Remove fortran bootstrap option by @WardF in #2707
• Add support for HDF5 transient types by @ZedThree in #2655
• Modify PR 2655 to ensure transient types have names. by @DennisHeimbigner in #2724
• Fix memory leak by @DennisHeimbigner in #2725
• Enable/Disable some plugins at configure time by @WardF in #2722
• Add capability to enable/disable compression libraries by @gsjaardema in #2712
• Release notes: Minor. Add historical tag, and spell fix. by @Dave-Allured in #2684
• Fix potential null dereference by @ZhipengXue97 in #2646
• Fix a crash when accessing a corrupted classic file. by @DennisHeimbigner in #2732
• Explicitly suppress variable length type compression by @DennisHeimbigner in #2730
• Cleanup the handling of cache parameters. by @DennisHeimbigner in #2734
• Fix a number of minor bugs by @DennisHeimbigner in #2726
• Fix major bug in the NCZarr cache management by @DennisHeimbigner in #2737
• Fix --has-quantize in autotools-generated nc-config. by @WardF in #2749
• Fix an issue with unescaped paths in the build system by @weiznich in #2756
• Mitigate S3 test interference + Unlimited Dimensions in NCZarr by @DennisHeimbigner in #2755
• Fix cmake s3 support.wif by @WardF in #2741
• CMake: Ensure all libraries link against MPI if needed by @ZedThree in #2758
• CMake: Change header in check for HDF5 zlib/szip support by @ZedThree in #2757
• Updated static software.html page with reference to met.3d by @WardF in #2760
• Revert a change made in d3c2cf2 that is proving confounding in MSYS2 bash by @WardF in #2769
• Address Windows and MacOS s3 issues by @WardF in #2759
• Fix bug with displaying log messages by @ZedThree in #2767
• Add ctest script to CI. by @WardF in #2778
• CI: Have nc-autotools use source distribution instead of repository by @DWesl in #2601
• Added stanza to workflow actions so that pushed changes cancel tests by @WardF in #2779
• netCDFConfig: find HDF5 if needed by @mathstuf in #2751
• Cleanup a number of issues. by @DennisHeimbigner in #2763
• CMake: Don't add uninstall target and CPack config if not top-level by @ZedThree in #2776
• Replace exec_program with execute_process by @WardF in #2784
• Fix Proxy problem for DAP2 by @DennisHeimbigner in #2764
• Remove stray character in cmake lfs tests for nczarr. by @WardF in #2786
• Renamed mmap variable, which conflicts with mmap() function on FreeBSD by @seanm in #2790
• Make ncZarr-specific deps and options dependent on ncZarr being enabled. by @WardF in #2793
• Fix most float conversion warnings by @ZedThree in #2782
• Fixed various UBSan warnings about invalid bit shifting by @seanm in #2787
• disable test that depends on ncpathcvt in cmake build w/o utilities by @tbussmann in #2795
• Update internal tinyxml2 code to the latest version by @DennisHeimbigner in #2771
• Remove the execinfo capability by @DennisHeimbigner in #2789
• Fixed various UBSan warnings about working with NULL pointers by @seanm in #2803
• Improve fetch performance of DAP4 by @DennisHeimbigner in #2765
• Fixed misaligned memory access flagged by UBSan by @seanm in #2800
• Tweaking PR to work with Visual Studio by @WardF in #2788
• CMake: Use helper libraries for nczarr tests by @ZedThree in #2783
• Fixed various UBSan warnings about working with NULL pointers by @seanm in #2802
• Fix some important bugs in various files by @DennisHeimbigner in #2813
• Removed a use of sprintf that required changing a function signature by @seanm in #2743
• sprintf -> snprintf by @seanm in #2691
• chore: unset executable flag by @e-kwsm in #2745
• Fix nc-config generated by cmake. by @WardF in #2825
• Do not compile test program unless required by @magnusuMET in #2761
• CMake: Add improvements to MPI support by @johnwparent in #2595
• Catching up on PRs by @WardF in #2826
• Minor fix to doxygen documentation by @gsjaardema in #2450
• Enable compilation with C89 compiler by @gsjaardema in #2379
• count argument in H5Sselect_hyperslab by @wkliao in #2296
• Changed link to netCDF-Fortran documentation. by @WardF in #2830
• Avoid segfault if opening file failed by @rouault in #2427
• Add clarification fo...

The NSF Unidata netCDF team is happy to announce the second release candidate for netCDF-C v4.9.3. This release will include a lot of quality of life improvements and bug fixes, as well as improved support for ncZarr. We expect to release a second release candidate, with a focus on improved documentation, and a quick-start guide for our Zarr support with S3 and other cloud-based object stores.

The second release candidate will be out shortly; the final, full release will occur as quickly as possible, but that will depend on issues which arise through testing of this release candidate. Assuming no major issues are reported, we hope to have the final release of v4.9.3 out by the end of December. Thanks all for your patience, contributions and help!

What's Changed

• Add stanza for Release Candidate 1 in Release Notes by @WardF in #2934
• Provide Documentation for the .rc File Mechanism and API by @DennisHeimbigner in #2956
• Now use H5Literate2() instead of H5Literate() when its available by @edwardhartnett in #2958
• Some debugging output was left enabled by accident. by @DennisHeimbigner in #2970
• fix ncuriparse error,Correctly remove leading and trailing whitespace by @ShawayL in #2971
• add autotools build instructions, add parallel I/O build and plugin info to CMake build document by @edwardhartnett in #2964
• Expand logic around H5Literate2 data structure use. by @WardF in #2977
• fixed --with-plugin-dir option to match cmake behavior by @edwardhartnett in #2973
• updated README with install documentation by @edwardhartnett in #2975
• added NETCDF_MPIEXEC option to CMake by @edwardhartnett in #2979
• Fix bug in run_newformat.sh by @DennisHeimbigner in #2978
• Take into account that attach_dimscales can fail when dimensions and variables are named inconsistently by @Alexander-Barth in #2968
• Add zstd test and fix plugin build for CMake/Cygwin by @edwardhartnett in #2985
• fixed message commands in CMakeLists.txt, and ncdump dependency problems for tst_nccopy4 in CMake build by @edwardhartnett in #2983
• added documentation for start/count/stride mandating same size arrays as data variable by @edwardhartnett in #2981
• [S3] Parse AWS configuration with support for profile section by @mannreis in #2969
• Clean up some - vs _ in some comments by @gsjaardema in #2988
• added documentation about reading an unknown netCDF/HDF5 file in tutorial, and some other documentation fixes by @edwardhartnett in #2986
• Add two missing includes by @weiznich in #2991
• turned on some commented out test code by @edwardhartnett in #2993
• now install m4 on macos in CI by @edwardhartnett in #2998
• Bump incorrect minimum HDF5 version to 1.8.15. by @WardF in #3009
• fixed some autoreconf warnings by @edwardhartnett in #3008
• adding more zstd testing by @edwardhartnett in #2996
• Bump minimum required version of hdf5 in CMakeLists.txt by @WardF in #3011
• H5FDunregister plus tests by @WardF in #3014
• test to catch the HDF5 H5FDUnregister() problem... by @edwardhartnett in #3012
• Address ordering issue with HTTP VFD, H5FDunregister by @WardF in #3013
• parallel zstd test which works for cmake and autotools by @edwardhartnett in #3005
• HDF5 testing for parallel I/O including zstd (when present) by @edwardhartnett in #3002
• Check for libcurl should only happen if DAP and/or ncZarr are enabled. by @WardF in #3018
• Added information re: mpich version 4.2.0 and related 'error' messages. by @WardF in #3023
• Add legacy macro option by @WardF in #3030
• Fix in support of #3007 by @WardF in #3035
• If libZstd isn't found, turn off netcdf_enable_filter_zstd by @WardF in #3036
• Modify nc-config --libs and --static arguments by @WardF in #3037
• Fix failing building with custom libzip by @mannreis in #3040
• Cleanup the blosc testing in nc_test4 and nczarr_test. by @DennisHeimbigner in #3046
• Replace PR #3046 by @DennisHeimbigner in #3047
• fixing some autoconf problems by @edwardhartnett in #3022
• autoconf cleanup by @edwardhartnett in #3019
• Extend the netcdf API to support programmatic changes to the plugin search path by @DennisHeimbigner in #3034
• Update nc-config in support of changes made in #3034 by @WardF in #3049
• Various clang warning fixes by @seanm in #3050

New Contributors

• @ShawayL made their first contribution in #2971

Full Changelog: v4.9.3-rc1...v4.9.3-rc2

The NSF Unidata netCDF team is happy to announce the first release candidate for netCDF-C v4.9.3. This release will include a lot of quality of life improvements and bug fixes, as well as improved support for ncZarr. We expect to release a second release candidate, with a focus on improved documentation, and a quick-start guide for our Zarr support with S3 and other cloud-based object stores.

The second release candidate will be out shortly; the final, full release will occur as quickly as possible, but that will depend on issues which arise through testing of this release candidate. The more broadly it is tested, the quicker we'll be able to get the full release out. Thanks all for your patience and your help!

What's Changed

• "Simplify" XGetopt usage by @DennisHeimbigner in #2678
• Fix bug in szip handling. by @DennisHeimbigner in #2679
• Add documentation for logging by @edwardhartnett in #2677
• Combine DAP4 test server fixes, resolve a couple conflicts. by @WardF in #2681
• Cleanup DAP4 testing by @DennisHeimbigner in #2555
• Fix DAP4 remotetest server by @DennisHeimbigner in #2558
• Fix issue #2674 by @uweschulzweida in #2675
• Check at nc_open if file appears to be in NCZarr/Zarr format. by @DennisHeimbigner in #2658
• Fix a syntax issue in CMakeLists.txt by @WardF in #2693
• hdf5open: check for the H5L info structure version directly by @mathstuf in #2695
• Improve S3 documentation, testing and support by @DennisHeimbigner in #2686
• Fix potential dead store by @ZhipengXue97 in #2644
• CI: Test --without-plugin-dir on Cygwin by @DWesl in #2659
• Fix handling of CURLOPT_CAINFO and CURLOPT_CAPATH by @DennisHeimbigner in #2690
• Adding a workaround for older versions of cmake by @WardF in #2703
• Remove obsolete code by @DennisHeimbigner in #2680
• Improve performance of the nc_reclaim_data and nc_copy_data functions. by @DennisHeimbigner in #2699
• CMakeLists.txt use ON vs yes, indent by @poelmanc in #2663
• Fix some dependency conditions between some ncdump tests. by @DennisHeimbigner in #2682
• awsincludes: remove executable permissions by @mathstuf in #2689
• Fix some problems with Earthdata authorization. by @DennisHeimbigner in #2709
• Provide a single option to disable all network access and testing. by @DennisHeimbigner in #2708
• Fix building on macOS by @skosukhin in #2710
• Update tinyxml and allow its use under OS/X. by @DennisHeimbigner in #2711
• Suppress filters on variables with non-fixed-size types. by @DennisHeimbigner in #2716
• Remove fortran bootstrap option by @WardF in #2707
• Add support for HDF5 transient types by @ZedThree in #2655
• Modify PR 2655 to ensure transient types have names. by @DennisHeimbigner in #2724
• Fix memory leak by @DennisHeimbigner in #2725
• Enable/Disable some plugins at configure time by @WardF in #2722
• Add capability to enable/disable compression libraries by @gsjaardema in #2712
• Release notes: Minor. Add historical tag, and spell fix. by @Dave-Allured in #2684
• Fix potential null dereference by @ZhipengXue97 in #2646
• Fix a crash when accessing a corrupted classic file. by @DennisHeimbigner in #2732
• Explicitly suppress variable length type compression by @DennisHeimbigner in #2730
• Cleanup the handling of cache parameters. by @DennisHeimbigner in #2734
• Fix a number of minor bugs by @DennisHeimbigner in #2726
• Fix major bug in the NCZarr cache management by @DennisHeimbigner in #2737
• Fix --has-quantize in autotools-generated nc-config. by @WardF in #2749
• Fix an issue with unescaped paths in the build system by @weiznich in #2756
• Mitigate S3 test interference + Unlimited Dimensions in NCZarr by @DennisHeimbigner in #2755
• Fix cmake s3 support.wif by @WardF in #2741
• CMake: Ensure all libraries link against MPI if needed by @ZedThree in #2758
• CMake: Change header in check for HDF5 zlib/szip support by @ZedThree in #2757
• Updated static software.html page with reference to met.3d by @WardF in #2760
• Revert a change made in d3c2cf2 that is proving confounding in MSYS2 bash by @WardF in #2769
• Address Windows and MacOS s3 issues by @WardF in #2759
• Fix bug with displaying log messages by @ZedThree in #2767
• Add ctest script to CI. by @WardF in #2778
• CI: Have nc-autotools use source distribution instead of repository by @DWesl in #2601
• Added stanza to workflow actions so that pushed changes cancel tests by @WardF in #2779
• netCDFConfig: find HDF5 if needed by @mathstuf in #2751
• Cleanup a number of issues. by @DennisHeimbigner in #2763
• CMake: Don't add uninstall target and CPack config if not top-level by @ZedThree in #2776
• Replace exec_program with execute_process by @WardF in #2784
• Fix Proxy problem for DAP2 by @DennisHeimbigner in #2764
• Remove stray character in cmake lfs tests for nczarr. by @WardF in #2786
• Renamed mmap variable, which conflicts with mmap() function on FreeBSD by @seanm in #2790
• Make ncZarr-specific deps and options dependent on ncZarr being enabled. by @WardF in #2793
• Fix most float conversion warnings by @ZedThree in #2782
• Fixed various UBSan warnings about invalid bit shifting by @seanm in #2787
• disable test that depends on ncpathcvt in cmake build w/o utilities by @tbussmann in #2795
• Update internal tinyxml2 code to the latest version by @DennisHeimbigner in #2771
• Remove the execinfo capability by @DennisHeimbigner in #2789
• Fixed various UBSan warnings about working with NULL pointers by @seanm in #2803
• Improve fetch performance of DAP4 by @DennisHeimbigner in #2765
• Fixed misaligned memory access flagged by UBSan by @seanm in #2800
• Tweaking PR to work with Visual Studio by @WardF in #2788
• CMake: Use helper libraries for nczarr tests by @ZedThree in #2783
• Fixed various UBSan warnings about working with NULL pointers by @seanm in #2802
• Fix some important bugs in various files by @DennisHeimbigner in #2813
• Removed a use of sprintf that required changing a function signature by @seanm in #2743
• sprintf -> snprintf by @seanm in #2691
• chore: unset executable flag by @e-kwsm in #2745
• Fix nc-config generated by cmake. by @WardF in #2825
• Do not compile test program unless required by @magnusuMET in #2761
• CMake: Add improvements to MPI support by @johnwparent in #2595
• Catching up on PRs by @WardF in #2826
• Minor fix to doxygen documentation by @gsjaardema in #2450
• Enable compilation with C89 compiler by @gsjaardema in #2379
• count argument in H5Sselect_hyperslab by @wkliao in #2296
• Changed link to netCDF-Fortran documentation. by @WardF in #2830
• Avoid segfault if opening file failed by @rouault in https://github.com/Unidata/netcdf-c/pull...

4.9.2 - March 14, 2023

This is a maintenance release which adds support for HDF5 version 1.14.0, in addition to a handful of other changes and bug fixes.

• [Enhancement] Update H5FDhttp.[ch] to work with HDF5 version 1.14.0. See Github #2615.
• Update nc-config to remove inclusion from automatically-detected nf-config and ncxx-config files, as the wrong files could be included in the output. This is in support of GitHub #2274.
• Update H5FDhttp.[ch] to work with HDF5 version 1.13.2 and later. See Github #2635.
• [Bug Fix] Update DAP code to enable CURLOPT_ACCEPT_ENCODING by default. See Github #2630.
• [Bug Fix] Fix byterange failures for certain URLs. See Github #2649.
• [Bug Fix] Fix 'make distcheck' error in run_interop.sh. See Github #2631.
• [Enhancement] Update nc-config to remove inclusion from automatically-detected nf-config and ncxx-config files, as the wrong files could be included in the output. This is in support of GitHub #2274.

Automatically Generated Changes

What's Changed

• Incorporate fix for errno check when fd < 0 by @WardF in #2610
• Modify H5FDhttp.c to work with HDF5 1.14.0 by @DennisHeimbigner in #2615
• Update nc-config by @WardF in #2619
• Unit Testing, Performance Testing infrastructure options. by @WardF in #2628
• Fix a distcheck failure with nczarr_test/run_interop.sh by @DennisHeimbigner in #2631
• A small, but meaningful start, to addressing undefined behavior by @WardF in #2633
• Avoid optionaly depends on zip for NCZarr by @mwestphal in #2592
• Fix dest for non-m4 path by @magnusuMET in #2623
• Cleaning up a few stray issues by @WardF in #2641
• Fix macro usage by @skosukhin in #2618
• Missing goto fail by @gsjaardema in #2607
• Fix byterange handling of some URLS by @DennisHeimbigner in #2649
• Enable ACCEPT_ENCODING on DAP requests by @DennisHeimbigner in #2630
• Extend the dispatch table for H5FD back to version 1.13.2 by @DennisHeimbigner in #2635
• Add hdf5 1.14.0 to GitHub CI. by @WardF in #2661

New Contributors

• @mwestphal made their first contribution in #2592

Full Changelog: v4.9.1...v4.9.2

Known Issues

• A test in the main branch of netcdf-cxx4 is broken by this rc; this will bear further investigation, but not being treated as a roadblock for the release candidate.
• The new document, netcdf-c/docs/filter_quickstart.md is in rough-draft form.
• Race conditions exist in some of the tests when run concurrently with large numbers of processors

What's Changed from v4.9.0 (automatically generated)

• Fix nc_def_var_fletcher32 operation by @DennisHeimbigner in #2403
• Merge relevant info updates back into main by @WardF in #2387
• Add manual GitHub actions triggers for the tests. by @WardF in #2404
• Use env variable USERPROFILE instead of HOME for windows and mingw. by @DennisHeimbigner in #2405
• Make public a limited API for programmatic access to internal .rc tables by @DennisHeimbigner in #2408
• Fix typo in CMakeLists.txt by @georgthegreat in #2412
• Fix choice of HOME dir by @DennisHeimbigner in #2416
• Check for libxml2 development files by @WardF in #2417
• Updating Doxyfile.in with doxygen-1.8.17, turned on WARN_AS_ERROR, added doxygen build to CI run by @edwardhartnett in #2377
• updated release notes by @edwardhartnett in #2392
• increase read block size from 1 KB to 4 MB by @wkliao in #2319
• fixed RELEASE_NOTES.md by @edwardhartnett in #2423
• Fix pnetcdf tests in cmake by @WardF in #2437
• Updated CMakeLists to avoid corner case cmake error by @WardF in #2438
• Add --disable-quantize to configure by @WardF in #2439
• Fix the way CMake handles -DPLUGIN_INSTALL_DIR by @DennisHeimbigner in #2430
• fix and test quantize mode for NC_CLASSIC_MODEL by @edwardhartnett in #2445
• Guard _declspec(dllexport) in support of #2446 by @WardF in #2460
• Ensure that netcdf_json.h does not interfere with ncjson. by @DennisHeimbigner in #2448
• Prevent cmake writing to source dir by @magnusuMET in #2463
• more quantize testing and adding pre-processor constant NC_MAX_FILENAME to nc_tests.h by @edwardhartnett in #2457
• Provide a default enum const when fill value does not match any enum constant by @DennisHeimbigner in #2462
• Fix support for reading arrays of HDF5 fixed size strings by @DennisHeimbigner in #2466
• fix musl build by @magnusuMET in #1701
• Fix AWS SDK linking errors by @dzenanz in #2470
• Address jump-misses-init issue. by @WardF in #2488
• Remove stray merge conflict markers by @WardF in #2493
• Add support for Zarr string type to NCZarr by @DennisHeimbigner in #2492
• Fix some problems with PR 2492 by @DennisHeimbigner in #2497
• Fix some bugs in the blosc filter wrapper by @DennisHeimbigner in #2461
• Add option to control accessing external servers by @DennisHeimbigner in #2491
• Changed attribute case in documentation by @WardF in #2482
• Adding all-error-codes.md back in to distribution documentation. by @WardF in #2501
• Update hdf5 version in github actions. by @WardF in #2504
• Minor update to doxygen function documentation by @gsjaardema in #2451
• Fix some addtional errors in NCZarr by @DennisHeimbigner in #2503
• Cleanup szip handling some more by @DennisHeimbigner in #2421
• Check for zstd development headers in autotools by @WardF in #2507
• Add new options to nc-config by @WardF in #2509
• Cleanup built test sources in nczarr_test by @DennisHeimbigner in #2508
• Fix inconsistency in netcdf_meta.h by @WardF in #2512
• Small fix in nc-config.in by @WardF in #2513
• For loop initial declarations are only allowed in C99 mode by @gsjaardema in #2517
• Fix some dependencies in tst_nccopy3 by @WardF in #2518
• Update plugins/Makefile.am by @WardF in #2519
• Fix prereqs in ncdump/tst_nccopy4 in order to avoid race conditions. by @WardF in #2520
• Move construction of VERSION file to end of the build by @DennisHeimbigner in #2527
• Add draft filter quickstart guide by @WardF in #2531
• Turn off extraneous debug output by @DennisHeimbigner in #2537
• typo fix by @wkliao in #2538
• replace 4194304 with READ_BLOCK_SIZE by @wkliao in #2539
• Rename variable to avoid function name conflict by @ibaned in #2550
• Add Cygwin CI and stop installing unwanted plugins by @DWesl in #2529
• Merge subset of v4.9.1 files back into main development branch by @WardF in #2530
• Add a Filter quickstart guide document by @WardF in #2524
• Fix race condition in ncdump (and other) tests. by @DennisHeimbigner in #2552
• Make dap4 reference dap instead of hard-wired to be disabled. by @WardF in #2553
• Suppress nczarr_test/tst_unknown filter test by @DennisHeimbigner in #2557
• Add fenceposting for HAVE_DECL_ISINF and HAVE_DECL_ISNAN by @WardF in #2559
• Add an old static file. by @WardF in #2575
• Fix infinite loop in file inferencing by @DennisHeimbigner in #2574
• Merge Wellspring back into development branch by @WardF in #2560
• Allow ncdump -t to handle variable length string attributes by @srherbener in #2584
• Fix an issue I introduced with make distcheck by @WardF in #2590
• make UDF0 not require NC_NETCDF4 by @jedwards4b in #2586
• Expose user-facing documentation related to byterange DAP functionality. by @WardF in #2596
• Fix Memory Leak by @DennisHeimbigner in #2598
• CI: Change autotools CI build to out-of-tree build. by @DWesl in #2577
• Update github action configuration scripts. by @WardF in #2600
• Update the filter quickstart guide. by @WardF in #2602
• Fix symbol export on Windows by @WardF in #2604

New Contributors

• @georgthegreat made their first contribution in #2412
• @dzenanz made their first contribution in #2470
• @DWesl made their first contribution in #2529
• @srherbener made their first contribution in #2584
• @jedwards4b made their first contribution in #2586

Full Changelog: v4.9.0...v4.9.1

Known Issues

• A test in the main branch of netcdf-cxx4 is broken by this rc; this will bear further investigation, but not being treated as a roadblock for the release candidate.
• The new document, netcdf-c/docs/filter_quickstart.md is in rough-draft form.
• Race conditions exist in some of the tests when run concurrently.

Changes

• Fixed issue with libnetcdf-feedstock at Conda-Forge.

Other Changes (automatically generated)

• Turn off extraneous debug output by @DennisHeimbigner in #2537
• typo fix by @wkliao in #2538
• replace 4194304 with READ_BLOCK_SIZE by @wkliao in #2539
• Rename variable to avoid function name conflict by @ibaned in #2550
• Add Cygwin CI and stop installing unwanted plugins by @DWesl in #2529
• Merge subset of v4.9.1 files back into main development branch by @WardF in #2530
• Fix race condition in ncdump (and other) tests. by @DennisHeimbigner in #2552
• Make dap4 reference dap instead of hard-wired to be disabled. by @WardF in #2553
• Suppress nczarr_test/tst_unknown filter test by @DennisHeimbigner in #2557
• Add fenceposting for HAVE_DECL_ISINF and HAVE_DECL_ISNAN by @WardF in #2559

New Contributors

• @DWesl made their first contribution in #2529

Full Changelog: v4.9.1-rc1...v4.9.1-rc2

v4.9.1-rc1

This is the first release candidate for netCDF-C v4.9.1. This is primarily a maintenance release.

Known Issues

• A test in the main branch of netcdf-cxx4 is broken by this rc; this will bear further investigation, but not being treated as a roadblock for the release candidate.
• The new document, netcdf-c/docs/filter_quickstart.md is in rough-draft form.

Notable Changes (Manually Recorded)

• [Enhancement][Documentation] Add Plugins Quick Start Guide. See GitHub #2524 for more information.
• [Enhancement] Add new entries in netcdf_meta.h, NC_HAS_BLOSC and NC_HAS_BZ2. See Github #2511 and Github #2512 for more information.
• [Enhancement] Add new options to nc-config: --has-multifilters, --has-stdfilters, --has-quantize, --plugindir. See Github #2509 for more information.
• [Bug Fix] Fix some errors detected in PR 2497. PR #2497 . See Github #2503.
• [Bug Fix] Split the remote tests into two parts: one for the remotetest server and one for all other external servers. Also add a configure option to enable the latter set. See Github #2491.
• [Bug Fix] Fix blosc plugin errors. See Github #2461.
• [Bug Fix] Fix support for reading arrays of HDF5 fixed size strings. See Github #2466.
• [Bug Fix] Fix some errors detected in PR #2492 . See Github #2497.
• [Enhancement] Add support for Zarr (fixed length) string type in nczarr. See Github #2492.
• [Bug Fix] Split the remote tests into two parts: one for the remotetest server and one for all other external servers. Also add a configure option to enable the latter set. See Github #2491.
• [Bug Fix] Fix support for reading arrays of HDF5 fixed size strings. See Github #2462.
• [Bug Fix] Provide a default enum const when fill value does not match any enum constant for the value zero. See Github #2462.
• [Bug Fix] Fix the json submodule symbol conflicts between libnetcdf and the plugin specific netcdf_json.h. See Github #2448.
• [Bug Fix] Fix quantize with CLASSIC_MODEL files. See Github #2405.
• [Enhancement] Add --disable-quantize option to configure.
• [Bug Fix] Fix CMakeLists.txt to handle all acceptable boolean values for -DPLUGIN_INSTALL_DIR. See Github #2430.
• [Bug Fix] Fix tst_vars3.c to use the proper szip flag. See Github #2421.
• [Enhancement] Provide a simple API to allow user access to the internal .rc file table: supports get/set/overwrite of entries of the form "key=value". See Github #2408.
• [Bug Fix] Use env variable USERPROFILE instead of HOME for windows and mingw. See Github #2405.
• [Bug Fix] Fix the nc_def_var_fletcher32 code in hdf5 to properly test value of the fletcher32 argument. See Github #2403.

Changes since v4.9.0 (Automatically Generated by GitHub)

• Fix nc_def_var_fletcher32 operation by @DennisHeimbigner in #2403
• Merge relevant info updates back into main by @WardF in #2387
• Add manual GitHub actions triggers for the tests. by @WardF in #2404
• Use env variable USERPROFILE instead of HOME for windows and mingw. by @DennisHeimbigner in #2405
• Make public a limited API for programmatic access to internal .rc tables by @DennisHeimbigner in #2408
• Fix typo in CMakeLists.txt by @georgthegreat in #2412
• Fix choice of HOME dir by @DennisHeimbigner in #2416
• Check for libxml2 development files by @WardF in #2417
• Updating Doxyfile.in with doxygen-1.8.17, turned on WARN_AS_ERROR, added doxygen build to CI run by @edwardhartnett in #2377
• updated release notes by @edwardhartnett in #2392
• increase read block size from 1 KB to 4 MB by @wkliao in #2319
• fixed RELEASE_NOTES.md by @edwardhartnett in #2423
• Fix pnetcdf tests in cmake by @WardF in #2437
• Updated CMakeLists to avoid corner case cmake error by @WardF in #2438
• Add --disable-quantize to configure by @WardF in #2439
• Fix the way CMake handles -DPLUGIN_INSTALL_DIR by @DennisHeimbigner in #2430
• fix and test quantize mode for NC_CLASSIC_MODEL by @edwardhartnett in #2445
• Guard _declspec(dllexport) in support of #2446 by @WardF in #2460
• Ensure that netcdf_json.h does not interfere with ncjson. by @DennisHeimbigner in #2448
• Prevent cmake writing to source dir by @magnusuMET in #2463
• more quantize testing and adding pre-processor constant NC_MAX_FILENAME to nc_tests.h by @edwardhartnett in #2457
• Provide a default enum const when fill value does not match any enum constant by @DennisHeimbigner in #2462
• Fix support for reading arrays of HDF5 fixed size strings by @DennisHeimbigner in #2466
• fix musl build by @magnusuMET in #1701
• Fix AWS SDK linking errors by @dzenanz in #2470
• Address jump-misses-init issue. by @WardF in #2488
• Remove stray merge conflict markers by @WardF in #2493
• Add support for Zarr string type to NCZarr by @DennisHeimbigner in #2492
• Fix some problems with PR 2492 by @DennisHeimbigner in #2497
• Fix some bugs in the blosc filter wrapper by @DennisHeimbigner in #2461
• Add option to control accessing external servers by @DennisHeimbigner in #2491
• Changed attribute case in documentation by @WardF in #2482
• Adding all-error-codes.md back in to distribution documentation. by @WardF in #2501
• Update hdf5 version in github actions. by @WardF in #2504
• Minor update to doxygen function documentation by @gsjaardema in #2451
• Fix some addtional errors in NCZarr by @DennisHeimbigner in #2503
• Cleanup szip handling some more by @DennisHeimbigner in #2421
• Check for zstd development headers in autotools by @WardF in #2507
• Add new options to nc-config by @WardF in #2509
• Cleanup built test sources in nczarr_test by @DennisHeimbigner in #2508
• Fix inconsistency in netcdf_meta.h by @WardF in #2512
• Small fix in nc-config.in by @WardF in #2513
• For loop initial declarations are only allowed in C99 mode by @gsjaardema in #2517
• Fix some dependencies in tst_nccopy3 by @WardF in #2518
• Update plugins/Makefile.am by @WardF in #2519
• Fix prereqs in ncdump/tst_nccopy4 in order to avoid race conditions. by @WardF in #2520
• Move construction of VERSION file to end of the build by @DennisHeimbigner in #2527
• Add draft filter quickstart guide by @WardF in #2531

New Contributors

• @georgthegreat made their first contribution in #2412
• @dzenanz made their first contribution in #2470

Full Changelog: v4.9.0...v4.9.1-rc1

NOTE: CMAKE-BASED BUILDS see #2390 to get the correct library version. For now, you will need to either remove a stray } at line 39 in CMakeLists.txt, or you will need to use the configure script instead of cmake. Our sincere apologies!

Release Notes

This file contains a high-level description of this package's evolution. Releases are in reverse chronological order (most recent first). Note that, as of netcdf 4.2, the netcdf-c++ and netcdf-fortran libraries have been separated into their own libraries.

4.9.0 - June 10, 2022

• [Enhancement] Improve filter installation process to avoid use of an extra shell script. See Github #2348.
• [Bug Fix] Get "make distcheck" to work See Github #/2343.
• [Enhancement] Allow the read/write of JSON-valued Zarr attributes to allow
  for domain specific info such as used by GDAL/Zarr. See Github #2278.
• [Enhancement] Turn on the XArray convention for NCZarr files by default. WARNING, this means that the mode should explicitly specify nczarr" or "zarr" even if "xarray" or "noxarray" is specified. See Github #2257.
• [Enhancement] Update the documentation to match the current filter capabilities See Github #2249.
• [Enhancement] Support installation of pre-built standard filters into user-specified location. See Github #2318.
• [Enhancement] Improve filter support. More specifically (1) add nc_inq_filter_avail to check if a filter is available, (2) add the notion of standard filters, (3) cleanup szip support to fix interaction with NCZarr. See Github #2245.
• [Enhancement] Switch to tinyxml2 as the default xml parser implementation. See Github #2170.
• [Bug Fix] Require that the type of the variable in nc_def_var_filter is not variable length. See Github #/2231.
• [File Change] Apply HDF5 v1.8 format compatibility when writing to previous files, as well as when creating new files. The superblock version remains at 2 for newly created files. Full backward read/write compatibility for netCDF-4 is maintained in all cases. See Github #2176.
• [Enhancement] Add ability to set dataset alignment for netcdf-4/HDF5 files. See Github #2206.
• [Bug Fix] Improve UTF8 support on windows so that it can use utf8 natively. See Github #2222.
• [Enhancement] Add complete bitgroom support to NCZarr. See Github #2197.
• [Bug Fix] Clean up the handling of deeply nested VLEN types. Marks nc_free_vlen() and nc_free_string as deprecated in favor of ncaux_reclaim_data(). See Github #2179.
• [Bug Fix] Make sure that netcdf.h accurately defines the flags in the open/create mode flags. See Github #2183.
• [Enhancement] Improve support for msys2+mingw platform. See Github #2171.
• [Bug Fix] Clean up the various inter-test dependencies in ncdump for CMake. See Github #2168.
• [Bug Fix] Fix use of non-aws appliances. See Github #2152.
• [Enhancement] Added options to suppress the new behavior from Github #2135. The options for cmake and configure are, respectively -DENABLE_LIBXML2 and --(enable/disable)-libxml2. Both of these options defaul to 'on/enabled'. When disabled, the bundled ezxml XML interpreter is used regardless of whether libxml2 is present on the system.
• [Enhancement] Support optional use of libxml2, otherwise default to ezxml. See Github #2135 -- H/T to Egbert Eich.
• [Bug Fix] Fix several os related errors. See Github #2138.
• [Enhancement] Support byte-range reading of netcdf-3 files stored in private buckets in S3. See Github #2134
• [Enhancement] Support Amazon S3 access for NCZarr. Also support use of the existing Amazon SDK credentials system. See Github #2114
• [Bug Fix] Fix string allocation error in H5FDhttp.c. See Github #2127.
• [Bug Fix] Apply patches for ezxml and for selected oss-fuzz detected errors. See Github #2125.
• [Bug Fix] Ensure that internal Fortran APIs are always defined. See Github #2098.
• [Enhancement] Support filters for NCZarr. See Github #2101
• [Bug Fix] Make PR 2075 long file name be idempotent. See Github #2094.

What's Changed

• added 1.12.1 to hdf5 versions built by GitHub actions by @edwardhartnett in #2082
• cmake: extract the HDF5 version when finding HDF5 manually by @mathstuf in #2076
• v4.8.1 Wellspring changes to merge back upstream by @WardF in #2075
• Update Doxygen documentation by @WardF in #2092
• Make Issue #2077 work when build is repeated. by @DennisHeimbigner in #2094
• 2091 + Github Action to test by @WardF in #2093
• Adding missing file ncdap_test/manyurls.h by @DennisHeimbigner in #2091
• added info about logging to build summary, fixed info about byterange in build summary by @edwardhartnett in #2087
• Revamping the HDF5_VERSION logic. by @WardF in #2095
• Add filter support to NCZarr by @DennisHeimbigner in #2101
• Make the fortran cache API always be defined. by @DennisHeimbigner in #2098
• Remove netcdf-c/debug directory as no longer needed. by @DennisHeimbigner in #2099
• Make sure HDF5_C_LIBRARY and HDF5_HL_LIBRARY set by @gsjaardema in #2116
• Adding nc_def_var_quantize()/nc_inq_var_quantize() - second attempt by @edwardhartnett in #2088
• Fix handling of enum constants nested in compound types. by @DennisHeimbigner in #2109
• Fix a stack-read-overflow in ncindexlookup() by @rouault in #2113
• Patch errors by @DennisHeimbigner in #2125
• Attribute creation order on/off by @gsjaardema in #2056
• Avoid infinite loop for finding large prime values by @gsjaardema in #2126
• Fix bug in the default HDF5 byte-range reader by @DennisHeimbigner in #2127
• Remove duplicate line by @gsjaardema in #2131
• Significantly Improve Amazon S3 Cloud Storage Support by @DennisHeimbigner in #2114
• Fix additional S3 support issues by @DennisHeimbigner in #2134
• Typo in previous PR by @DennisHeimbigner in #2137
• Fix a number of OS specific bugs by @DennisHeimbigner in #2138
• libxml2 capability by @WardF in #2139
• Allow optional use of libxml2 by @DennisHeimbigner in #2135
• Refactor Z library detection by @gsjaardema in #2121
• Temporarily disable dap remote tests by @DennisHeimbigner in #2163
• Disable by default dap-remote-tests for CMake by @DennisHeimbigner in #2164
• Restore default enable for enable-dap-remote-testsc by @DennisHeimbigner in #2167
• Cleanup the CMake inter-test dependencies by @DennisHeimbigner in #2168
• tst_misc.sh: Fix hang in make check by @Dave-Allured in #2172
• Support MSYS2/Mingw platform by @DennisHeimbigner in #2171
• Make sure mode flags are properly defined in netcdf.h by @DennisHeimbigner in #2183
• Avoid redefinition of strcasecmp under mingw-w64 by @mjwoods in #2106
• Fix various problem around VLEN's by @DennisHeimbigner in #2179
• Granular BitGroom feature for netcdf-c by @czender in #2130
• Fix a few memory leaks and erroneous logic in nczarr_test/testfilter_misc by @hmaarrfk in #2180
• Now setting deflate_level of 0 is interpreted to mean no deflate. by @edwardhartnett in https://github.com/U...

4.8.1 - August 18, 2021

• [Bug Fix] Fix multiple bugs in libnczarr. See Github #2066.
• [Enhancement] Support windows network paths (e.g. \svc...). See Github #2065.
• [Enhancement] Convert to a new representation of the NCZarr meta-data extensions: version 2. Read-only backward compatibility is provided. See Github #2032.
• [Bug Fix] Fix dimension_separator bug in libnczarr. See Github #2035.
• [Bug Fix] Fix bugs in libdap4. See Github #2005.
• [Bug Fix] Store NCZarr fillvalue as a singleton instead of a 1-element array. See Github #2017.
• [Bug Fixes] The netcdf-c library was incorrectly determining the scope of dimension; similar to the type scope problem. See Github #2012 for more information.
• [Bug Fix] Re-enable DAP2 authorization testing. See Github #2011.
• [Bug Fix] Fix bug with windows version of mkstemp that causes failure to create more than 26 temp files. See Github #1998.
• [Bug Fix] Fix ncdump bug when printing VLENs with basetype char. See Github #1986.
• [Bug Fixes] The netcdf-c library was incorrectly determining the scope of types referred to by nc_inq_type_equal. See Github #1959 for more information.
• [Bug Fix] Fix bug in use of XGetopt when building under Mingw. See Github #2009.
• [Enhancement] Improve the error reporting when attempting to use a filter for which no implementation can be found in HDF5_PLUGIN_PATH. See Github #2000 for more information.
• [Bug Fix] Fix make distcheck issue in nczarr_test/ directory. See Github #2007.
• [Bug Fix] Fix bug in NCclosedir in dpathmgr.c. See Github #2003.
• [Bug Fix] Fix bug in ncdump that assumes that there is a relationship between the total number of dimensions and the max dimension id. See Github #2004.
• [Bug Fix] Fix bug in JSON processing of strings with embedded quotes. See Github #1993.
• [Enhancement] Add support for the new "dimension_separator" enhancement to Zarr v2. See Github #1990 for more information.
• [Bug Fix] Fix hack for handling failure of shell programs to properly handle escape characters. See Github #1989.
• [Bug Fix] Allow some primitive type names to be used as identifiers depending on the file format. See Github #1984.
• [Enhancement] Add support for reading/writing pure Zarr storage format that supports the XArray _ARRAY_DIMENSIONS attribute. See Github #1952 for more information.
• [Update] Updated version of bzip2 used in filter testing/functionality, in support of Github #1969.
• [Bug Fix] Corrected HDF5 version detection logic as described in Github #1962.