New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用spark查询1.3亿数据 executor 报 OOM #2

Open

1095661190 opened this issue Jul 26, 2023 · 2 comments

1095661190 commented Jul 26, 2023

spark executor 4G
sql语句
select default.bitmap_count(default.to_bitmap(id)) as user_num from table

1095661190 closed this as completed

Author

1095661190 commented Jul 26, 2023

1095661190 reopened this

Owner

lihuigang commented Jul 26, 2023

这个把 spark executor 内存调大就可以了，处理1.3亿的数据压力还是有点大

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment