Skip to content

feat: add dataset publishing#42

Merged
olevski merged 8 commits intomainfrom
feat-add-dataset-publishing
Apr 13, 2026
Merged

feat: add dataset publishing#42
olevski merged 8 commits intomainfrom
feat-add-dataset-publishing

Conversation

@olevski
Copy link
Copy Markdown
Member

@olevski olevski commented Feb 26, 2026

This adds commands under rnk dataset deposit for managing uploading data to zenodo or listing active deposits in zenodo.

For now we have only zenodo, but we can expand to other providers in the future.

Handling credentials is a bit rudimentary - via an environment variable. But it is sufficient for now and we can expand it later on. If you generate an API key from zenodo then you can use that.

Here are the added commands:

Usage: rnk dataset deposit [OPTIONS] <COMMAND>

Commands:
  cp    Copies the data from a location into a data deposit
  ls    List all depositions for the specific provider
  lsf   List all files in a specific deposit

@olevski olevski requested review from a team as code owners February 26, 2026 13:52
@olevski olevski marked this pull request as draft February 26, 2026 13:52
@olevski olevski force-pushed the feat-add-dataset-publishing branch from 8b6c13f to 15cf328 Compare March 2, 2026 09:44
@olevski olevski force-pushed the feat-add-dataset-publishing branch from 0283036 to 8327eb2 Compare March 19, 2026 10:18
@olevski olevski marked this pull request as ready for review March 19, 2026 10:21
@olevski olevski force-pushed the feat-add-dataset-publishing branch 2 times, most recently from b6fe8cf to 45f53a2 Compare March 19, 2026 13:38
@olevski olevski force-pushed the feat-add-dataset-publishing branch from 45f53a2 to 8843959 Compare April 2, 2026 12:09
@olevski olevski force-pushed the feat-add-dataset-publishing branch from 8843959 to f952c50 Compare April 9, 2026 21:51
Comment thread src/cli/cmd/dataset.rs Outdated
Comment thread src/cli/cmd/dataset/deposit.rs
Comment thread src/cli/cmd/dataset/zenodo_api.rs
Comment thread src/cli/cmd/dataset/zenodo_api.rs
Comment thread src/cli/cmd/dataset/deposit.rs Outdated
Comment thread src/cli/cmd/dataset/deposit.rs Outdated
Comment thread src/cli/cmd/dataset/zenodo.rs Outdated
// If the source path is a dir the first entry of the walk is the same dir that was
// passed
continue;
}
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does this hold on all platforms? maybe comparing to source_path is safer?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added a comment with the link to the docs.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But also I added an && to check that the source paht is a dir too.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now it is like this:

            if f_ind == 0 && source_path.is_dir() && path_std.is_dir() {
                // If the source path is a dir the first entry of the walk is the same dir that was
                // passed
                // See https://docs.rs/walkdir/latest/walkdir/struct.WalkDir.html#method.new
                continue;
            }

Comment thread src/cli/cmd/dataset/zenodo.rs Outdated
@olevski olevski requested a review from Panaetius April 10, 2026 14:26
@olevski olevski merged commit d8b0ee8 into main Apr 13, 2026
5 checks passed
@olevski olevski deleted the feat-add-dataset-publishing branch April 13, 2026 07:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants