Skip to content

Use DataprocCommandRunner to run "pip install"#187

Open
tim-u wants to merge 3 commits intomainfrom
dp-pip-with-output
Open

Use DataprocCommandRunner to run "pip install"#187
tim-u wants to merge 3 commits intomainfrom
dp-pip-with-output

Conversation

@tim-u
Copy link
Copy Markdown
Contributor

@tim-u tim-u commented May 7, 2026

No description provided.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the dpip magic to use a remote command runner for package installation, utilizing pyarrow to decode the resulting output stream. The changes include a modularization of the dpip method and updated unit tests. Feedback focuses on improving code maintainability by replacing magic strings with constants, simplifying string joining logic, and reducing code duplication in the test suite.

Comment thread google/cloud/dataproc_magics/magics.py Outdated
Comment thread google/cloud/dataproc_magics/magics.py Outdated
Comment thread google/cloud/dataproc_magics/magics.py Outdated
Comment thread tests/unit/dataproc_magics/test_magics.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant