Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(prompt_path): path issue if pandasai used outside of pandas env #909

Merged
merged 1 commit into from
Jan 30, 2024

Conversation

ArslanSaleem
Copy link
Collaborator

@ArslanSaleem ArslanSaleem commented Jan 30, 2024

Summary by CodeRabbit

  • Refactor
    • Improved the flexibility in template loading for the base prompt functionality, allowing for dynamic location of template files.

@ArslanSaleem ArslanSaleem requested a review from gventuri January 30, 2024 08:13
Copy link
Contributor

coderabbitai bot commented Jan 30, 2024

Walkthrough

The recent update to the pandasai library introduces an enhancement to the BasePrompt class, focusing on the method of template file path resolution. By leveraging the os and pathlib modules, this improvement allows for more dynamic and flexible template loading, streamlining the process and making it adaptable to various environments and directory structures.

Changes

File Path Summary of Changes
pandasai/prompts/base.py Updated BasePrompt class to dynamically locate template file paths using os and pathlib modules.

🐇✨
In the code's woven burrow, paths unwind,
Where templates dwell, easier to find.
A hop, a skip, in digital embrace,
Our rabbit's work, through cyberspace.
✨🐇

Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share

Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>.
    • Generate unit-tests for this file.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit tests for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai generate interesting stats about this repository from git and render them as a table.
    • @coderabbitai show all the console.log statements in this repository.
    • @coderabbitai read src/utils.ts and generate unit tests.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (invoked as PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger a review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • The JSON schema for the configuration file is available here.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/coderabbit-overrides.v2.json

CodeRabbit Discord Community

Join our Discord Community to get help, request features, and share feedback.

Copy link
Contributor

@sourcery-ai sourcery-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Type: Bug fix

PR Summary: The pull request addresses an issue with the resolution of template paths in the BasePrompt class, ensuring that the path is correctly determined when pandasai is used outside of its native environment.

Decision: Comment

📝 Type: 'Bug fix' - not supported yet.
  • Sourcery currently only approves 'Typo fix' PRs.
✅ Issue addressed: this change correctly addresses the issue or implements the desired feature.
No details provided.
✅ Small diff: the diff is small enough to approve with confidence.
No details provided.

General suggestions:

  • Consider using consistent path handling by sticking to either os.path or pathlib methods throughout the codebase to avoid confusion and potential bugs.
  • Verify that the path_to_template is explicitly converted to a string before being used, as this can prevent issues in environments where pathlib.Path objects are not automatically converted to strings.
  • Review other parts of the codebase for similar path handling logic to ensure consistency and reliability across different modules and classes.

Thanks for using Sourcery. We offer it for free for open source projects and would be very grateful if you could help us grow. If you like it, would you consider sharing Sourcery on your favourite social media? ✨

Share Sourcery

Help me be more useful! Please click 👍 or 👎 on each comment to tell me if it was helpful.

env = Environment(loader=FileSystemLoader("pandasai/prompts/templates"))
# find path to template file
current_dir_path = Path(__file__).parent
path_to_template = os.path.join(current_dir_path, "templates")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion (llm): Using os.path.join with pathlib.Path objects is mixing path handling libraries. Consider using Path methods for consistency and clarity.

# find path to template file
current_dir_path = Path(__file__).parent
path_to_template = os.path.join(current_dir_path, "templates")
env = Environment(loader=FileSystemLoader(path_to_template))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

issue (llm): Ensure that the path_to_template is a string when passed to FileSystemLoader, as pathlib.Path objects are not implicitly converted to strings in all environments.

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

❗ No coverage uploaded for pull request base (release/v2.0@d626b27). Click here to learn what that means.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@               Coverage Diff               @@
##             release/v2.0     #909   +/-   ##
===============================================
  Coverage                ?   86.12%           
===============================================
  Files                   ?       91           
  Lines                   ?     3077           
  Branches                ?        0           
===============================================
  Hits                    ?     2650           
  Misses                  ?      427           
  Partials                ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@gventuri
Copy link
Collaborator

@coderabbitai review

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review Status

Actionable comments generated: 2

Configuration used: CodeRabbit UI

Commits Files that changed from the base of the PR and between d626b27 and cb7c6ea.
Files selected for processing (1)
  • pandasai/prompts/base.py (2 hunks)
Additional comments: 2
pandasai/prompts/base.py (2)
  • 4-5: The addition of os and pathlib modules is appropriate for the task of dynamically locating the template file path. This change supports the objective of making template loading more flexible and adaptable to different environments.
  • 25-28: Ensure that the directory structure and the presence of the "templates" directory within the expected location are validated or documented. This change assumes the "templates" directory exists relative to the script's location, which might not always be the case in different deployment scenarios.

Comment on lines +26 to +28
current_dir_path = Path(__file__).parent
path_to_template = os.path.join(current_dir_path, "templates")
env = Environment(loader=FileSystemLoader(path_to_template))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The logic to dynamically locate the template file path using os and pathlib is correctly implemented. However, consider using pathlib exclusively for path operations to maintain consistency and leverage its more modern and object-oriented approach over os.path.

- path_to_template = os.path.join(current_dir_path, "templates")
+ path_to_template = current_dir_path / "templates"

Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.

Suggested change
current_dir_path = Path(__file__).parent
path_to_template = os.path.join(current_dir_path, "templates")
env = Environment(loader=FileSystemLoader(path_to_template))
current_dir_path = Path(__file__).parent
path_to_template = current_dir_path / "templates"
env = Environment(loader=FileSystemLoader(path_to_template))

The approach to finding the template path and loading it is sound, but it's important to handle potential exceptions that could arise from file not found or access errors when attempting to load the template. Consider adding error handling around the template loading logic to provide more informative error messages to the user or to log such incidents for debugging purposes.

try:
    env = Environment(loader=FileSystemLoader(path_to_template))
    self.prompt = env.get_template(self.template_path)
except TemplateNotFound as e:
    # Handle or log the error appropriately
    raise CustomException(f"Template not found: {self.template_path}") from e

Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.

Suggested change
current_dir_path = Path(__file__).parent
path_to_template = os.path.join(current_dir_path, "templates")
env = Environment(loader=FileSystemLoader(path_to_template))
current_dir_path = Path(__file__).parent
path_to_template = os.path.join(current_dir_path, "templates")
try:
env = Environment(loader=FileSystemLoader(path_to_template))
self.prompt = env.get_template(self.template_path)
except TemplateNotFound as e:
# Handle or log the error appropriately
raise CustomException(f"Template not found: {self.template_path}") from e

@gventuri gventuri merged commit ebeb9f2 into release/v2.0 Jan 30, 2024
9 checks passed
gventuri added a commit that referenced this pull request Feb 29, 2024
* refactor: clean code in smart_dataframe and smart_datalake (#814)

* refactor: extract import from file method

* refactor: extract df head methods

* refactor: move connector config in the relative connector file

* refactor: csv and pandas files are now treated as a connector

* chore: remove verbose getters and setters

* refactor: remove load and save feature

* refactor: create dataframe proxy

* chore: simplify agent

* chore: simplify datalake

* refactor: simplify smart datalake

* refactor: centralize context in lakes

* refactor: move lake callbacks to dedicate class

* fix: load connector before generating cache hex

* fix: only allow direct sql to SQLConnectors

* fix: check sql connector was not working

* fix(connector): update connector validation at the start

* fix(direct_sql): fix some leftovers

* fix: merged change revert built-in shadowing

---------

Co-authored-by: ArslanSaleem <[email protected]>

* refactor(query_tracker): clean code and create error handling pipeling (#875)

* refactor(smart_datalake): clean chat method of smart datalake

* refactor(smartlake_pipeline): minor cleanups and comments

* refactor(query_tracker): refactor query tracker input and output

* refactor(query_tracker): adding error pipeline

* refactor(query_tracker): some rename and delete extras

* refactor(query_tracker): remove comments

* Merge Main Changes to v1.6 (#878)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>

* refactor: remove inheritance of pandas methods in the SmartDataframe

* refactor: remove shortcuts

* refactor: smart df cannot chat anymore

* refactor: remove unused validate method from sdf

* refactor: add name and description to connectors

* refactor: remove custom prompts

* refactor: remove synthetic pipelines

* refactor: remove custom instructions

* refactor: remove starcoder and falcon

* refactor: move df head to connectors

* refactor: remove sdf

* refactor: remove leftovers logic units

* refactor: rename SmartDataLake to AgentCore

* refactor: rename DataLake pipeline to Chat

* refactor: remove agent core, moving the logic to agent

* refactor: refactor the prompt templates using Jinja2

* feat(Agent): train agent docs or question/answers (#895)

* feat(VectorStore): adding chromadb vector store for RAG

* test(agent_train): adding more test cases and error handling

* refact(agent_train): add logging to chroma db

* feat(RAG): use trained data from vector db in prompt (#896)

* feat(VectorStore): adding chromadb vector store for RAG

* test(agent_train): adding more test cases and error handling

* refact(agent_train): add logging to chroma db

* feat(RAG): use trained vector in prompt

* Merge v1.6 into to v2.0 (#900)

* refactor(Prompt): adding more context for dataframe and multiple types of serialization (#880)

* refactor(prompt): update dataframe serialization in prompt

* tests(prompt): fix and adding new tests

* fix(prompt): adding type to dataframe serialize function

* refactor(prompt): add field descriptions in yml prompt

* fix(prompt): direct_sql still using old dataframe table

* refactor(direct_sql): add instruction and note for using relevant table only

* refactor(query_tracker): clean output of query tracker format (#888)

* feat(GoogleBigQuery): adding google big query connector (#886)

* feat(VectorStore): adding chromadb vector store for RAG

* test(agent_train): adding more test cases and error handling

* refact(agent_train): add logging to chroma db

* feat(RAG): use trained vector in prompt

* Merge v1.6 to v2.0

* feat: execute_sql_query_usage creating error prompt if execute_sql_que… (#898)

* feat/execute_sql_query_usage creating error prompt if execute_sql_query is not used when direct_sql is set to true

* fix/comment added before raising exception

---------

Co-authored-by: Milind Lalwani <[email protected]>

* fix(prompt_path): path issue if pandasai used outside of pandas env (#909)

* feat(agent): adding optional pipeline call (#916)

s

* feat(system prompt): use system in llm prompts (#925)

* fix(code_manager): minor fixes in code manager

* feat(system_prompt): adding system prompts to be added in llm call

* fix(code_manager): minor fixes in code manager (#923)

Co-authored-by: Gabriele Venturi <[email protected]>

* feat/update method in vector db added

* feat/get by id method added

* feat(multiturn-conv): update prompts and use api's for multiturn (#928)

* fix(code_manager): minor fixes in code manager

* feat(system_prompt): adding system prompts to be added in llm call

* feat(multi-turn-conv): adding support for multi turn conversation

* feat(multi-turn): add missing files

* feat(BambooVectorStore): adding bamboo vector to store and retrieve t… (#935)

* feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud

* rename test class name

* feat(BambooLLM): add bamboo llm wrapper (#940)

* feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud

* rename test class name

* feat(bamboo_llm): adding bamboo llm interface

* fix: clean up few commented and leftover changes

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

* fix(plot): always pass one lib for plotting in updated prompt

* Merge to release 2.0 (#945)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

* fix(code manager): parsing of called functions (#883)

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned

* fix(code manager): parsing of called functions

* fmt

* fix: open charts return on format plot (#881)

Co-authored-by: Long Le <[email protected]>

* feat(project): add Makefile, re-lint project, restructure tests (#884)

* feat(project): add Makefile, re-lint project, restructure tests

* unused imports

* Release v1.5.17

* docs:pdate examples.md (#887)

Minor fix of exmaples.md

* refactor: TypeVar for IResponseParser (#889) (#890)

* refactor: TypeVar for IResponseParser (#889)

* (refactor): introduce TypeVar for IResponseParser implementation in
  output_logic_unit.py
* (fix): add missing call of super().__init__() in ProcessOutput class

* refactor: TypeVar for IResponseParser (#889)

* (style): linter fail at output_logic_unit.py

* [fix] logging chart saving only if code contains chart (#897)

Co-authored-by: Lorenzobattistela <[email protected]>

* fix(airtable): use personal access token instead of api key
Api key has been deprecated: https://airtable.com/developers/web/api/authentication

* feat: add df summarization shortcut (#901)

* fix: badge for "Open in Colab" (#903)

* feat: add support Google Gemini API in LLMs (#902)

* Updating shortcuts to include df summarization

* Updating support for google gemini models

* Make google-generativeai package optional

* fix: upgrade google-ai

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* Release v1.5.18

* docs: update Google Colab Badge (#914)

The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge.

* docs: Rectify code examples by adding missing statements (#915)

Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website.

Updated code example is taken from the root README.md and tested.

* feat: add support for modin (#907)

* feat: add support for modin

* fix(ci): dev deps

* update docs

* add some tests

* upate contributing guidelines

* fix helpers

* fix docs example

* update pandasai/smart_dataframe/__init__.py

* Release v1.5.19

* feat: update OpenAI pricing

* chore: add Flask openai example (#941)

* 'Refactored by Sourcery'

* chore: add Flask html example

* chore: add Flask openai example

* sourcery refactor integration tests

* fix: Flask package install set to optional

---------

Co-authored-by: Sourcery AI <>

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* fix: query tracker track code execution

* fix: add skills in query tracker and rag to return one sample by default

* fix(skills): add skills to query tracker and by default rag to return 1 message (#947)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

* fix(code manager): parsing of called functions (#883)

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned

* fix(code manager): parsing of called functions

* fmt

* fix: open charts return on format plot (#881)

Co-authored-by: Long Le <[email protected]>

* feat(project): add Makefile, re-lint project, restructure tests (#884)

* feat(project): add Makefile, re-lint project, restructure tests

* unused imports

* Release v1.5.17

* docs:pdate examples.md (#887)

Minor fix of exmaples.md

* refactor: TypeVar for IResponseParser (#889) (#890)

* refactor: TypeVar for IResponseParser (#889)

* (refactor): introduce TypeVar for IResponseParser implementation in
  output_logic_unit.py
* (fix): add missing call of super().__init__() in ProcessOutput class

* refactor: TypeVar for IResponseParser (#889)

* (style): linter fail at output_logic_unit.py

* [fix] logging chart saving only if code contains chart (#897)

Co-authored-by: Lorenzobattistela <[email protected]>

* fix(airtable): use personal access token instead of api key
Api key has been deprecated: https://airtable.com/developers/web/api/authentication

* feat: add df summarization shortcut (#901)

* fix: badge for "Open in Colab" (#903)

* feat: add support Google Gemini API in LLMs (#902)

* Updating shortcuts to include df summarization

* Updating support for google gemini models

* Make google-generativeai package optional

* fix: upgrade google-ai

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* Release v1.5.18

* docs: update Google Colab Badge (#914)

The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge.

* docs: Rectify code examples by adding missing statements (#915)

Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website.

Updated code example is taken from the root README.md and tested.

* feat: add support for modin (#907)

* feat: add support for modin

* fix(ci): dev deps

* update docs

* add some tests

* upate contributing guidelines

* fix helpers

* fix docs example

* update pandasai/smart_dataframe/__init__.py

* Release v1.5.19

* feat: update OpenAI pricing

* chore: add Flask openai example (#941)

* 'Refactored by Sourcery'

* chore: add Flask html example

* chore: add Flask openai example

* sourcery refactor integration tests

* fix: Flask package install set to optional

---------

Co-authored-by: Sourcery AI <>

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

* fix(plot): always pass one lib for plotting in updated prompt

* fix: query tracker track code execution

* fix: add skills in query tracker and rag to return one sample by default

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* fix: function call check and query tracker tracking

* fixes/in release2.0 (#951)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

* fix(code manager): parsing of called functions (#883)

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned

* fix(code manager): parsing of called functions

* fmt

* fix: open charts return on format plot (#881)

Co-authored-by: Long Le <[email protected]>

* feat(project): add Makefile, re-lint project, restructure tests (#884)

* feat(project): add Makefile, re-lint project, restructure tests

* unused imports

* Release v1.5.17

* docs:pdate examples.md (#887)

Minor fix of exmaples.md

* refactor: TypeVar for IResponseParser (#889) (#890)

* refactor: TypeVar for IResponseParser (#889)

* (refactor): introduce TypeVar for IResponseParser implementation in
  output_logic_unit.py
* (fix): add missing call of super().__init__() in ProcessOutput class

* refactor: TypeVar for IResponseParser (#889)

* (style): linter fail at output_logic_unit.py

* [fix] logging chart saving only if code contains chart (#897)

Co-authored-by: Lorenzobattistela <[email protected]>

* fix(airtable): use personal access token instead of api key
Api key has been deprecated: https://airtable.com/developers/web/api/authentication

* feat: add df summarization shortcut (#901)

* fix: badge for "Open in Colab" (#903)

* feat: add support Google Gemini API in LLMs (#902)

* Updating shortcuts to include df summarization

* Updating support for google gemini models

* Make google-generativeai package optional

* fix: upgrade google-ai

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* Release v1.5.18

* docs: update Google Colab Badge (#914)

The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge.

* docs: Rectify code examples by adding missing statements (#915)

Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website.

Updated code example is taken from the root README.md and tested.

* feat: add support for modin (#907)

* feat: add support for modin

* fix(ci): dev deps

* update docs

* add some tests

* upate contributing guidelines

* fix helpers

* fix docs example

* update pandasai/smart_dataframe/__init__.py

* Release v1.5.19

* feat: update OpenAI pricing

* chore: add Flask openai example (#941)

* 'Refactored by Sourcery'

* chore: add Flask html example

* chore: add Flask openai example

* sourcery refactor integration tests

* fix: Flask package install set to optional

---------

Co-authored-by: Sourcery AI <>

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

* fix(plot): always pass one lib for plotting in updated prompt

* fix: query tracker track code execution

* fix: add skills in query tracker and rag to return one sample by default

* fix: function call check and query tracker tracking

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* update comparison operator (#953)

* docs: improve readme and license

* lint: fix lint in examples

* docs: add deploy methods in the documentation

* refactor: rename to ChromaDB

* feat: make BambooVector the default vectorstore

* lint: fix lint in examples

* docs: add docs for training, agent description

* docs: add video for training LLM

---------

Co-authored-by: ArslanSaleem <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>
gventuri added a commit that referenced this pull request Mar 8, 2024
* Release v2.0

* refactor: clean code in smart_dataframe and smart_datalake (#814)

* refactor: extract import from file method

* refactor: extract df head methods

* refactor: move connector config in the relative connector file

* refactor: csv and pandas files are now treated as a connector

* chore: remove verbose getters and setters

* refactor: remove load and save feature

* refactor: create dataframe proxy

* chore: simplify agent

* chore: simplify datalake

* refactor: simplify smart datalake

* refactor: centralize context in lakes

* refactor: move lake callbacks to dedicate class

* fix: load connector before generating cache hex

* fix: only allow direct sql to SQLConnectors

* fix: check sql connector was not working

* fix(connector): update connector validation at the start

* fix(direct_sql): fix some leftovers

* fix: merged change revert built-in shadowing

---------

Co-authored-by: ArslanSaleem <[email protected]>

* refactor(query_tracker): clean code and create error handling pipeling (#875)

* refactor(smart_datalake): clean chat method of smart datalake

* refactor(smartlake_pipeline): minor cleanups and comments

* refactor(query_tracker): refactor query tracker input and output

* refactor(query_tracker): adding error pipeline

* refactor(query_tracker): some rename and delete extras

* refactor(query_tracker): remove comments

* Merge Main Changes to v1.6 (#878)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>

* refactor: remove inheritance of pandas methods in the SmartDataframe

* refactor: remove shortcuts

* refactor: smart df cannot chat anymore

* refactor: remove unused validate method from sdf

* refactor: add name and description to connectors

* refactor: remove custom prompts

* refactor: remove synthetic pipelines

* refactor: remove custom instructions

* refactor: remove starcoder and falcon

* refactor: move df head to connectors

* refactor: remove sdf

* refactor: remove leftovers logic units

* refactor: rename SmartDataLake to AgentCore

* refactor: rename DataLake pipeline to Chat

* refactor: remove agent core, moving the logic to agent

* refactor: refactor the prompt templates using Jinja2

* feat(Agent): train agent docs or question/answers (#895)

* feat(VectorStore): adding chromadb vector store for RAG

* test(agent_train): adding more test cases and error handling

* refact(agent_train): add logging to chroma db

* feat(RAG): use trained data from vector db in prompt (#896)

* feat(VectorStore): adding chromadb vector store for RAG

* test(agent_train): adding more test cases and error handling

* refact(agent_train): add logging to chroma db

* feat(RAG): use trained vector in prompt

* Merge v1.6 into to v2.0 (#900)

* refactor(Prompt): adding more context for dataframe and multiple types of serialization (#880)

* refactor(prompt): update dataframe serialization in prompt

* tests(prompt): fix and adding new tests

* fix(prompt): adding type to dataframe serialize function

* refactor(prompt): add field descriptions in yml prompt

* fix(prompt): direct_sql still using old dataframe table

* refactor(direct_sql): add instruction and note for using relevant table only

* refactor(query_tracker): clean output of query tracker format (#888)

* feat(GoogleBigQuery): adding google big query connector (#886)

* feat(VectorStore): adding chromadb vector store for RAG

* test(agent_train): adding more test cases and error handling

* refact(agent_train): add logging to chroma db

* feat(RAG): use trained vector in prompt

* Merge v1.6 to v2.0

* feat: execute_sql_query_usage creating error prompt if execute_sql_que… (#898)

* feat/execute_sql_query_usage creating error prompt if execute_sql_query is not used when direct_sql is set to true

* fix/comment added before raising exception

---------

Co-authored-by: Milind Lalwani <[email protected]>

* fix(prompt_path): path issue if pandasai used outside of pandas env (#909)

* feat(agent): adding optional pipeline call (#916)

s

* feat(system prompt): use system in llm prompts (#925)

* fix(code_manager): minor fixes in code manager

* feat(system_prompt): adding system prompts to be added in llm call

* fix(code_manager): minor fixes in code manager (#923)

Co-authored-by: Gabriele Venturi <[email protected]>

* feat/update method in vector db added

* feat/get by id method added

* feat(multiturn-conv): update prompts and use api's for multiturn (#928)

* fix(code_manager): minor fixes in code manager

* feat(system_prompt): adding system prompts to be added in llm call

* feat(multi-turn-conv): adding support for multi turn conversation

* feat(multi-turn): add missing files

* feat(BambooVectorStore): adding bamboo vector to store and retrieve t… (#935)

* feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud

* rename test class name

* feat(BambooLLM): add bamboo llm wrapper (#940)

* feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud

* rename test class name

* feat(bamboo_llm): adding bamboo llm interface

* fix: clean up few commented and leftover changes

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

* fix(plot): always pass one lib for plotting in updated prompt

* Merge to release 2.0 (#945)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

* fix(code manager): parsing of called functions (#883)

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned

* fix(code manager): parsing of called functions

* fmt

* fix: open charts return on format plot (#881)

Co-authored-by: Long Le <[email protected]>

* feat(project): add Makefile, re-lint project, restructure tests (#884)

* feat(project): add Makefile, re-lint project, restructure tests

* unused imports

* Release v1.5.17

* docs:pdate examples.md (#887)

Minor fix of exmaples.md

* refactor: TypeVar for IResponseParser (#889) (#890)

* refactor: TypeVar for IResponseParser (#889)

* (refactor): introduce TypeVar for IResponseParser implementation in
  output_logic_unit.py
* (fix): add missing call of super().__init__() in ProcessOutput class

* refactor: TypeVar for IResponseParser (#889)

* (style): linter fail at output_logic_unit.py

* [fix] logging chart saving only if code contains chart (#897)

Co-authored-by: Lorenzobattistela <[email protected]>

* fix(airtable): use personal access token instead of api key
Api key has been deprecated: https://airtable.com/developers/web/api/authentication

* feat: add df summarization shortcut (#901)

* fix: badge for "Open in Colab" (#903)

* feat: add support Google Gemini API in LLMs (#902)

* Updating shortcuts to include df summarization

* Updating support for google gemini models

* Make google-generativeai package optional

* fix: upgrade google-ai

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* Release v1.5.18

* docs: update Google Colab Badge (#914)

The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge.

* docs: Rectify code examples by adding missing statements (#915)

Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website.

Updated code example is taken from the root README.md and tested.

* feat: add support for modin (#907)

* feat: add support for modin

* fix(ci): dev deps

* update docs

* add some tests

* upate contributing guidelines

* fix helpers

* fix docs example

* update pandasai/smart_dataframe/__init__.py

* Release v1.5.19

* feat: update OpenAI pricing

* chore: add Flask openai example (#941)

* 'Refactored by Sourcery'

* chore: add Flask html example

* chore: add Flask openai example

* sourcery refactor integration tests

* fix: Flask package install set to optional

---------

Co-authored-by: Sourcery AI <>

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* fix: query tracker track code execution

* fix: add skills in query tracker and rag to return one sample by default

* fix(skills): add skills to query tracker and by default rag to return 1 message (#947)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

* fix(code manager): parsing of called functions (#883)

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned

* fix(code manager): parsing of called functions

* fmt

* fix: open charts return on format plot (#881)

Co-authored-by: Long Le <[email protected]>

* feat(project): add Makefile, re-lint project, restructure tests (#884)

* feat(project): add Makefile, re-lint project, restructure tests

* unused imports

* Release v1.5.17

* docs:pdate examples.md (#887)

Minor fix of exmaples.md

* refactor: TypeVar for IResponseParser (#889) (#890)

* refactor: TypeVar for IResponseParser (#889)

* (refactor): introduce TypeVar for IResponseParser implementation in
  output_logic_unit.py
* (fix): add missing call of super().__init__() in ProcessOutput class

* refactor: TypeVar for IResponseParser (#889)

* (style): linter fail at output_logic_unit.py

* [fix] logging chart saving only if code contains chart (#897)

Co-authored-by: Lorenzobattistela <[email protected]>

* fix(airtable): use personal access token instead of api key
Api key has been deprecated: https://airtable.com/developers/web/api/authentication

* feat: add df summarization shortcut (#901)

* fix: badge for "Open in Colab" (#903)

* feat: add support Google Gemini API in LLMs (#902)

* Updating shortcuts to include df summarization

* Updating support for google gemini models

* Make google-generativeai package optional

* fix: upgrade google-ai

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* Release v1.5.18

* docs: update Google Colab Badge (#914)

The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge.

* docs: Rectify code examples by adding missing statements (#915)

Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website.

Updated code example is taken from the root README.md and tested.

* feat: add support for modin (#907)

* feat: add support for modin

* fix(ci): dev deps

* update docs

* add some tests

* upate contributing guidelines

* fix helpers

* fix docs example

* update pandasai/smart_dataframe/__init__.py

* Release v1.5.19

* feat: update OpenAI pricing

* chore: add Flask openai example (#941)

* 'Refactored by Sourcery'

* chore: add Flask html example

* chore: add Flask openai example

* sourcery refactor integration tests

* fix: Flask package install set to optional

---------

Co-authored-by: Sourcery AI <>

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

* fix(plot): always pass one lib for plotting in updated prompt

* fix: query tracker track code execution

* fix: add skills in query tracker and rag to return one sample by default

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* fix: function call check and query tracker tracking

* fixes/in release2.0 (#951)

* fix(output_type): handle errors for wrong output type (#866)

* fix(output_type): handle errors for output type

* fix: leftovers

* fix: test case to mock format-response

* fix: upgrade duckdb

* Release v1.5.15

* fix(sql): use only added tables of connector (#869)

* fix(sql): use only added tables of connector

* leftover file

* chore: rephrase the error message

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* fix(sql): fix test cases and improve output error message

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* feat/integration_testing test cases created (#873)

* feat/integration_testing test cases created based Loan Payments data

* feat/integration_testing four more datasets added

* fix/moved csv datasets to integration folder

* fix/changed pytest command to run only in tests folder

* fix/changed pytest command to run only in tests folder

---------

Co-authored-by: Milind Lalwani <[email protected]>

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876)

* fix: rephrase query (#872)

* Fixed Agent rephrase_query Error

* Fixed Agent rephrase_query Error

* add encoding

---------

Co-authored-by: Pranab Pathak <[email protected]>

* Release v1.5.16

* fix(code manager): parsing of called functions (#883)

* feat(helpers): add gpt-3.5-turbo-1106 fine-tuned

* fix(code manager): parsing of called functions

* fmt

* fix: open charts return on format plot (#881)

Co-authored-by: Long Le <[email protected]>

* feat(project): add Makefile, re-lint project, restructure tests (#884)

* feat(project): add Makefile, re-lint project, restructure tests

* unused imports

* Release v1.5.17

* docs:pdate examples.md (#887)

Minor fix of exmaples.md

* refactor: TypeVar for IResponseParser (#889) (#890)

* refactor: TypeVar for IResponseParser (#889)

* (refactor): introduce TypeVar for IResponseParser implementation in
  output_logic_unit.py
* (fix): add missing call of super().__init__() in ProcessOutput class

* refactor: TypeVar for IResponseParser (#889)

* (style): linter fail at output_logic_unit.py

* [fix] logging chart saving only if code contains chart (#897)

Co-authored-by: Lorenzobattistela <[email protected]>

* fix(airtable): use personal access token instead of api key
Api key has been deprecated: https://airtable.com/developers/web/api/authentication

* feat: add df summarization shortcut (#901)

* fix: badge for "Open in Colab" (#903)

* feat: add support Google Gemini API in LLMs (#902)

* Updating shortcuts to include df summarization

* Updating support for google gemini models

* Make google-generativeai package optional

* fix: upgrade google-ai

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* Release v1.5.18

* docs: update Google Colab Badge (#914)

The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge.

* docs: Rectify code examples by adding missing statements (#915)

Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website.

Updated code example is taken from the root README.md and tested.

* feat: add support for modin (#907)

* feat: add support for modin

* fix(ci): dev deps

* update docs

* add some tests

* upate contributing guidelines

* fix helpers

* fix docs example

* update pandasai/smart_dataframe/__init__.py

* Release v1.5.19

* feat: update OpenAI pricing

* chore: add Flask openai example (#941)

* 'Refactored by Sourcery'

* chore: add Flask html example

* chore: add Flask openai example

* sourcery refactor integration tests

* fix: Flask package install set to optional

---------

Co-authored-by: Sourcery AI <>

* chore: restore smart dataframe and smartdatalake functionalities

* fix ruff formatting

* fix: yahoo connector

* fix: file import sorting

* fix: import sorting

* fix: module import

* ignore integration_tests

* fix: ruff

* ruff fix

* remove integration folder

* fix: ci workflow

* fix: modin

* fix: ruff imports

* fix(plot): always pass one lib for plotting in updated prompt

* fix: query tracker track code execution

* fix: add skills in query tracker and rag to return one sample by default

* fix: function call check and query tracker tracking

---------

Co-authored-by: Gabriele Venturi <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* update comparison operator (#953)

* docs: improve readme and license

* lint: fix lint in examples

* docs: add deploy methods in the documentation

* refactor: rename to ChromaDB

* feat: make BambooVector the default vectorstore

* lint: fix lint in examples

* docs: add docs for training, agent description

* docs: add video for training LLM

---------

Co-authored-by: ArslanSaleem <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>

* feat: fix poetry.lock

* fix: update domain name (#970)

* docs: improve docs about training

* fix(agent): langchain LLM instantiation (#977)

* fix(agent): langchain LLM instantiation

* replace object with mock

* feat: add support for Gemini API

* Release v2.0.2

* fix(llm): Google Gemini signature and memory usage (#980)

* Release v2.0.3

* Release v2.0.3

* build: fix issue

* build: fix ci for windows (#1005)

* fix: add number result to memory as string (#997)

Co-authored-by: Gabriele Venturi <[email protected]>

* fix: remove logger refs from SmartDataframe (#985)

* Remove logger from smart_dataframe constructor

* Remove logger from SmartDatalake args definition

---------

Co-authored-by: Gabriele Venturi <[email protected]>

* chore(code_manager): filter code for redeclaration of pd.DataFrame from head (#1003)

* feat(CockroachDBConnector): add support for cockroachdb

* fix: cockroach db connector

* fix: import polars (#1009)

* Update polars dependency

Move polars dependency into init to make it optional

* fix: polars import

* fix: fix linter

---------

Co-authored-by: PVA <[email protected]>

* Release v2.0.4

* Release v2.0.5

---------

Co-authored-by: ArslanSaleem <[email protected]>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: milind-sinaptik <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Massimiliano Pronesti <[email protected]>
Co-authored-by: Pranab1011 <[email protected]>
Co-authored-by: Pranab Pathak <[email protected]>
Co-authored-by: Milind Lalwani <[email protected]>
Co-authored-by: Lh Long <[email protected]>
Co-authored-by: Long Le <[email protected]>
Co-authored-by: PVA <[email protected]>
Co-authored-by: Ihor <[email protected]>
Co-authored-by: Lorenzo Battistela <[email protected]>
Co-authored-by: Lorenzobattistela <[email protected]>
Co-authored-by: Sparsh Jain <[email protected]>
Co-authored-by: Devashish Datt Mamgain <[email protected]>
Co-authored-by: Hemant Sachdeva <[email protected]>
Co-authored-by: aloha-fim <[email protected]>
Co-authored-by: Cheng Wai <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants