chroe: refactor ArrowDataFrame.with_columns
#7478
Annotations
2 errors
Run release-drafter/release-drafter@v6
Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"}
{
name: 'HttpError',
id: '11815437645',
status: 422,
response: {
url: 'https://api.github.com/repos/narwhals-dev/narwhals/releases/176561850',
status: 422,
headers: {
'access-control-allow-origin': '*',
'access-control-expose-headers': 'ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset',
connection: 'close',
'content-length': '210',
'content-security-policy': "default-src 'none'",
'content-type': 'application/json; charset=utf-8',
date: 'Wed, 13 Nov 2024 10:32:09 GMT',
'referrer-policy': 'origin-when-cross-origin, strict-origin-when-cross-origin',
server: 'github.com',
'strict-transport-security': 'max-age=31536000; includeSubdomains; preload',
vary: 'Accept-Encoding, Accept, X-Requested-With',
'x-accepted-github-permissions': 'contents=write',
'x-content-type-options': 'nosniff',
'x-frame-options': 'deny',
'x-github-api-version-selected': '2022-11-28',
'x-github-media-type': 'github.v3; format=json',
'x-github-request-id': '0407:4BA51:4CD1E48:4D60E22:67348029',
'x-ratelimit-limit': '5000',
'x-ratelimit-remaining': '4884',
'x-ratelimit-reset': '1731496324',
'x-ratelimit-resource': 'core',
'x-ratelimit-used': '116',
'x-xss-protection': '0'
},
data: {
message: 'Validation Failed',
errors: [
{
resource: 'Release',
code: 'invalid',
field: 'target_commitish'
}
],
documentation_url: 'https://docs.github.com/rest/releases/releases#update-a-release',
status: '422'
}
},
request: {
method: 'PATCH',
url: 'https://api.github.com/repos/narwhals-dev/narwhals/releases/176561850',
headers: {
accept: 'application/vnd.github.v3+json',
'user-agent': 'probot/12.2.5 octokit-core.js/3.5.1 Node.js/20.13.1 (linux; x64)',
authorization: 'token [REDACTED]',
'content-type': 'application/json; charset=utf-8'
},
body: '{"body":"## Changes\\n\\n## ✨ Enhancements\\n\\n- feat: add `DataFrame.pivot` for pandas like and Polars backend (#546)\\n\\n## 🐞 Bug fixes\\n\\n- fix: pandas and arrow `to_dummies` with nulls (#1040)\\n\\n## 🛠️ Other improvements\\n\\n- test: unxfail `test_to_dummies_drop_first_na` for cudf (#1364)\\n- chore: More typing in _polars (#1363)\\n- chore: Improve typing in _polars/utils (#1358)\\n- chore: add issue_deprecation_warning to generate_unique_token function (#1359)\\n\\nThank you to all our contributors for making this release possible!\\n@FBruzzesi, @MUKESHRAJMAHENDRAN, @MarcoGorelli and @raisadz\\n","draft":true,"prerelease":false,"make_latest":"true","name":"Narwhals v1.13.5","tag_name":"untagged-a7560488ad26559bf327","target_commitish":"refs/pull/1345/merge"}',
request: {}
},
event: {
id: '11815437645',
name: 'pull_request',
payload: {
action: 'edited',
changes: {
body: {
from: '## What type of PR is this? (check all applicable)\r\n' +
'\r\n' +
'- [x] 💾 Refactor\r\n' +
'- [ ] ✨ Feature\r\n' +
'- [ ] 🐛 Bug Fix\r\n' +
'- [x] 🔧 Optimization\r\n' +
'- [ ] 📝 Documentation\r\n' +
'- [ ] ✅ Test\r\n' +
'- [ ] 🐳 Other\r\n' +
'\r\n' +
'## Checklist\r\n' +
'\r\n' +
'- [x] Code follows style guide (ruff)\r\n' +
'- [x] Tests added \r\n' +
'- [x] Documented the changes\r\n' +
'\r\n' +
'## If you have comments or can explain your changes, please do so below.\r\n' +
'\r\n' +
'While profiling for plotly, py-spy indicates that we spend a lot of time in `validate_dataframe
|
Run release-drafter/release-drafter@v6
HttpError: Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"}
at /home/runner/work/_actions/release-drafter/release-drafter/v6/dist/index.js:8462:21
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Job.doExecute (/home/runner/work/_actions/release-drafter/release-drafter/v6/dist/index.js:30793:18)
{
name: 'AggregateError',
event: {
id: '11815437645',
name: 'pull_request',
payload: {
action: 'edited',
changes: {
body: {
from: '## What type of PR is this? (check all applicable)\r\n' +
'\r\n' +
'- [x] 💾 Refactor\r\n' +
'- [ ] ✨ Feature\r\n' +
'- [ ] 🐛 Bug Fix\r\n' +
'- [x] 🔧 Optimization\r\n' +
'- [ ] 📝 Documentation\r\n' +
'- [ ] ✅ Test\r\n' +
'- [ ] 🐳 Other\r\n' +
'\r\n' +
'## Checklist\r\n' +
'\r\n' +
'- [x] Code follows style guide (ruff)\r\n' +
'- [x] Tests added \r\n' +
'- [x] Documented the changes\r\n' +
'\r\n' +
'## If you have comments or can explain your changes, please do so below.\r\n' +
'\r\n' +
'While profiling for plotly, py-spy indicates that we spend a lot of time in `validate_dataframe_comparand` for pyarrow case. This is called only in `with_columns` methods.\r\n' +
'\r\n' +
'This PR proposed two changes:\r\n' +
'\r\n' +
'- Creates constant array via `np.full` in `validate_dataframe_comparand` instead of `[const] * length`\r\n' +
'- Changes the logic in `with_columns` to use pyarrow native methods to insert a column value. I expect this to be faster than the current approach of concatenating the already existing columns with the new ones - caveat is if the number of new columns is order(s) of magnitude greater than the existing ones. In _majority_ of scenarios I would expect this to not be the case, but this is the reason I am opening this as **RFC**\r\n'
}
},
number: 1345,
organization: {
avatar_url: 'https://avatars.githubusercontent.com/u/169070048?v=4',
description: 'Narwhals developers',
events_url: 'https://api.github.com/orgs/narwhals-dev/events',
hooks_url: 'https://api.github.com/orgs/narwhals-dev/hooks',
id: 169070048,
issues_url: 'https://api.github.com/orgs/narwhals-dev/issues',
login: 'narwhals-dev',
members_url: 'https://api.github.com/orgs/narwhals-dev/members{/member}',
node_id: 'O_kgDOChPN4A',
public_members_url: 'https://api.github.com/orgs/narwhals-dev/public_members{/member}',
repos_url: 'https://api.github.com/orgs/narwhals-dev/repos',
url: 'https://api.github.com/orgs/narwhals-dev'
},
pull_request: {
_links: {
comments: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/issues/1345/comments'
},
commits: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/pulls/1345/commits'
},
html: {
href: 'https://github.com/narwhals-dev/narwhals/pull/1345'
},
issue: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/issues/1345'
},
review_comment: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/pulls/comments{/number}'
},
review_comments: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/pulls/1345/comments'
},
self: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/pulls/1345'
},
statuses: {
href: 'https://api.github.com/repos/narwhals-dev/narwhals/statuses/ae9791ae90d1db2ac0bdc2f8915a664a44d639e7'
}
},
active_lock_reason: null,
additions: 33,
assignee: null,
assignees: [],
author_asso
|
Loading