Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preview names of topics to be created by a query #803

Open
blueedgenick opened this issue Feb 27, 2018 · 0 comments
Open

Preview names of topics to be created by a query #803

blueedgenick opened this issue Feb 27, 2018 · 0 comments

Comments

@blueedgenick
Copy link
Contributor

Both persistent and transient queries can cause the automatic creation of one or several new topics as part of their execution (output topic, internal topics for re-keys and changelogs). In many environments it will be the case that the user actually issuing the sql does not have topic-creation rights on the brokers, in which case some kind of "pre-flight check" tool (or other facility) would be very useful to give a list of which topic names would be created if this query were executed. Think: like the --dry-run option to many git commands. This could be either a command-line tool to do the checks for a file of sql statements or some actual SQL syntax addition.
This is even more important in the case of a broker environment where topics holding sensitive data are secured by ACLs as those ACLs will need to be manually set on the internal topics of each query to avoid accidental data leakage.

Additionally, even if the user has the ability to create topics, it is also useful to be able to track down the topics owned by a given query (could be part of explain query output in this case) in order to either ensure they were properly cleaned up or to track down the answer to questions such as "what is xxx topic on my cluster which is generating yyy traffic?".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants