Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Claude and Connector SDK experiment blog #81

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

alsnkline
Copy link
Collaborator

@alsnkline alsnkline commented Mar 1, 2025

Files associated with my Claude and Connector SDK experiment.
Referenced in a blog draft available Connector SDK Creation with Anthropic's Claude
Publish date still to be discussed - DO NOT MERGE until agreed.

Copy link

height bot commented Mar 1, 2025

Link Height tasks by mentioning a task ID in the pull request title or commit messages, or description and comments with the keyword link (e.g. "Link T-123").

💡Tip: You can also use "Close T-X" to automatically close a task when the pull request is merged.

@alsnkline
Copy link
Collaborator Author

alsnkline commented Mar 1, 2025

Not sure I like the folder name I came up with.
I could also publish this under my personal repo - but then it wouldn't be as directly tied to Fivetran.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm wondering whether this will work or not, as the file in inside a sub-directory.
@alsnkline can you please test once whether we need this file at the root level or it will work in sub-dirs?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

claude_test_20250228 doesn't sound very good, lets rename this directory?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't need these

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't keep this file in this repo, maybe remove it?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was thinking it would allow someone to explore a warehouse.db without having to regenerate.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was thinking it would allow someone to explore a warehouse.db without having to regenerate.
maybe I should add a readme.txt to explain these files roles

Comment on lines 234 to 235
if __name__ == "__main__":
connector.debug()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add the standard config.json file opening case here?

Chat GPT can be effectively used to help you create working connector SDK code. This was achieved by passing it examples from this repo as well as the full [technical reference](https://fivetran.com/docs/connector-sdk/technical-reference) documentation. Chat GPT when tested required some manual adjustments of code.

# Claude
Claude proved capable of creating a connector that ran first time and populated a 4 table schema. There were extra unnecessary requirements included in the requirements.txt file and the `__main__` didn't include the code needed to run the connector using my IDE run button. We [created a blog](link_to_blog) about our experiences and include the code as Claude generated it. We have also included the `warehouse.db` and `state.json` files so you can easily review the output of the first sync even though these files are only temp files created during testing and are not required for a connector SDK.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

don't forget to link the blog before merging

Copy link
Collaborator

@fivetran-sadiemartin fivetran-sadiemartin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me, but we should definitely have @5tran-alexil review the language (not sure it's best practice to refer to ourselves in the first person?). This wouldn't be a blocker for me in terms of getting it out, though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants