Skip to content

Releases: fish-pace/point-collocation

point-collocation: helper package for point matchups

31 Mar 16:55
435b79a

Choose a tag to compare

What's Changed

Documentation

  • Add GitHub Action to test example notebooks and scripts
  • Fix example test failures: skip bare pip-install cells and guard empty plan

Enhancements

  • add xoak-haversine for points near poles
  • Add more guards against geolocation ambiguity
  • Prevent crash on datatree merge=None
  • Add auto-switch messaging
  • Report time dimension in geolocation output
  • Add multi-time integration tests

API change related to coords specification

  • Unify axis mapping with coord_spec
  • Fix coord_spec: simplify structure
  • Allow spec of lat/lon in open_method, add conflict detection
  • Make sure to promote coords
  • Improve datatree geolocation detection and messaging
  • Add optional 1D matching axes

point-collocation: helper package for point matchups

17 Mar 15:22
8480e10

Choose a tag to compare

What's Changed

Bugs:

  • Fix pc.plan() crash when earthaccess granules have empty data_links()
  • Suppress dask progress bar output when opening HE5 files with chunks={}
  • Fix crash when geolocation has NaN (DSCOVR EPIC / HE5 fill values)
  • Properly show geolocation detection error when auto detection fails

Enhancements/Changes:

  • Remove show_variables() and replace with open_dataset()
  • add geolocation detection output to open_dataset()

Docs:

  • Add DISCOVR EPIC example
  • Add "Open in Colab" badge to each rendered notebook
  • reorder notebooks and clean up formatting
  • replace show_variables() with open_dataset()

point-collocation: helper package for point matchups

13 Mar 23:17

Choose a tag to compare

What's Changed

This update is related to making xarray NDPointIndex the default for non-gridded datasets, cleaning up the show_variables() function, some docs cleanup, and restructuring the dependencies.

Feature:

  • Add spatial_method="ndpoint" and spatial_method="auto" (smart default): xarray NDPointIndex with scipy, make xoak optional
  • Restructure pyproject.toml dependencies after this change
  • earthaccess is integral to the package. Change dependency to required
  • Revise pc_id approach: honor user-supplied pc_id, retain extra columns, sort output
  • Remove Dataset Detail from show_variables() and remove use of h5py

Docs:

  • Docs: Fix xarray Dataset rendering in MkDocs (double-output and broken grid layout)
  • Update docs and examples after above changes

point-collocation: helper package for point matchups

13 Mar 00:54
058db51

Choose a tag to compare

What's Changed

Features:

  • Improve docs: dynamic Examples sidebar on home page
  • Improve docs: styled DataFrame tables
  • Added more product examples expecially for grouped netcdfs (ICESat-2 and TEMPO)
  • Improve open_dataset function: remove open_dataset_kwargs, add silent param, integer index
  • Make open_dataset respect the open_method dict

point-collocation: helper package for point matchups

12 Mar 10:41
e51a036

Choose a tag to compare

This fixed a few bugs but major change was a revamp of the open_method logic to allow the user to specify what groups to merge and to allow dict profiles for different products. The geometry arg was removed as it was unneeded. What was needed was a specification of how to get to an xarray Dataset with lat/lon coords.

What's Changed

Bugs:

  • Fix NaN values when xarray Dataset variable has a time dimension by @Copilot in #82
  • Fix memory leak in geometry="grid" matchup: call gc.collect() per granule
  • Switch granule URL resolution to use result.data_links() instead of UMM parsing which led to some links being wrong

Features:

  • Allow collection_id and doi as alternatives to short_name for earthaccess search
  • Use cf_xarray for lat/lon coordinate detection with name-based fallback
  • Suppress xarray timedelta FutureWarning across all dataset open paths
  • Revamp open_method API: replace geometry with flexible open_method pipeline to allow user to specify the groups to merg
  • Allow open_dataset + merge which is faster than open_datatree + merge
  • Use h5py in plan.show_variables() as it is faster

point-collocation: helper package for point matchups

10 Mar 02:15

Choose a tag to compare

This is a helper package for the earthaccess Python package that does fast point matchups without memory explosion.

What's Changed

Bugs:

  • Fix spatial_method="xoak" with geometry="grid".

Optimization changes:

  • Pre-slice grid dataset to minimal spatial extent before xoak k-d tree indexing
  • Fix steady memory growth (~200 MB/granule) with geometry="swath"
  • Fix memory not being released between granules when batch_size is large
  • Fix memory not released after swath matchup with large batch_size

Features:

  • Add pc_id, granule_lat/lon/time columns to matchup output; update silent/batch_size defaults

point-collocation: helper package for earthaccess

06 Mar 01:25
b0cb6e4

Choose a tag to compare

This is a helper package for matching lat/lon/time points to level 2 and level 3 NASA EarthData. Uses the earthaccess package.

point-collocation: helper package for point matchups

06 Mar 23:50
bd241b0

Choose a tag to compare

This is a helper package for matching lat/lon/time points to level 2 and level 3 NASA EarthData. Uses the earthaccess package.