Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Euporie extremely slow for long outputs (10K+ lines) #131

Open
spencer-scw opened this issue Feb 22, 2025 · 1 comment
Open

Euporie extremely slow for long outputs (10K+ lines) #131

spencer-scw opened this issue Feb 22, 2025 · 1 comment

Comments

@spencer-scw
Copy link

I ran a cell that (accidentally) printed out tens of thousands of lines of output, and this immediately slowed Euporie to a crawl. I don't see any options for limiting/trimming output length, and I was forced to open the notebook in another editor to clear the output before I could proceed. Is there a feature or setting that can mitigate this?

@joouha
Copy link
Owner

joouha commented Feb 25, 2025

Hi - thanks for reporting.

I've made some optimizations which makes euporie a bit more usable with long outputs: it's now still usable with 1,000,000 lines of output in a cell, and with only 100,000 lines I experience no slow-down.

I've also added a new setting called text_output_limit, which can be used to limit the amount of text output which is displayed. I've set the default to 1,000,000 characters (I'll see how this goes).

These changes are in the dev branch for now. If you want to try it out, you can use uv to test without installing by running the following:

uvx --from git+https://github.com/joouha/euporie.git@dev euporie-notebook --text-output-limit=10 my-notebook.ipynb

I hope that helps!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants