Support Poetry v2 dependency format

[rarkins]

Discussed in #33455

^{Originally posted by ryancausey January 7, 2025}

Tell us more.

Poetry v2 has updated their pyproject.toml specification to support the "project" section in the pyproject.toml specification.

This means that there are now more potential locations where dependencies can be defined within a pyproject.toml file:

1. project.dependencies
2. project.optional-dependencies
3. tool.poetry.dependencies
4. tool.poetry.group.< name >.dependencies

The other rub is that the project.dependencies list doesn't support all of the dependency specifiers that one of the dependency locations under too.poetry does: https://python-poetry.org/docs/dependency-specification/

It would be nice to have renovate support this new dependency location and formats under the project heading.

Minimal reproduction: https://github.com/ryancausey/poetry-v2-support-reproduction

[rarkins]

the project section is defined by PEP 621. So shouldn't it be already supported? docs.renovatebot.com/modules/manager/pep621

Renovate has separate "managers" for poetry and pep621. If Poetry v2's behavior is now fully aligned with pep621 then we can consider if it's possible to merge these managers and remove the poetry-specific one. Each different lock file variant of pep621 needs separate work, i.e. when Renovate docs say it supports pep621 it doesn't mean "and every possible implementation of lock file now and in the future" - work needs to be done for each different lock file.

[ryancausey]

The poetry docs still indicate there are scenarios where the dependencies under the tool.poetry section should be used, so I don't believe its behavior is fully aligned with pep621 in all cases. https://python-poetry.org/docs/dependency-specification/

In either case, the poetry.lock file is not listed as a supported lock file format under the pep621 manager.

[ryancausey]

It should also be noted, you can ignore the new pep621 syntax and continue to place all dependencies in the tool.poetry section by adding "dependencies" to the project.dynamic list.