Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

merge main to refactor/builders_and_dataframes #148

Merged
merged 168 commits into from
Oct 31, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
168 commits
Select commit Hold shift + click to select a range
2b56a2f
BUG #110
MRyderOC Feb 24, 2023
e627dcb
BUG #111
MRyderOC Feb 24, 2023
dd49a64
BUG #112
MRyderOC Feb 24, 2023
bd79d8f
lint fix
MRyderOC Feb 24, 2023
6a7c857
BUG #114
MRyderOC Mar 15, 2023
d965ddb
more readable code
MRyderOC Mar 15, 2023
6bea27a
docs correction
MRyderOC Mar 24, 2023
98143ab
revert changes for update_webhook
MRyderOC Mar 27, 2023
5c2a450
Merge pull request #113 from GoogleCloudPlatform/bug/misc
kmaphoenix Mar 27, 2023
4e64e03
patch to v1.6.1
kmaphoenix Mar 27, 2023
92b33e9
correct arg assignment for copy entity method
kmaphoenix Apr 3, 2023
7c4b9bc
Merge pull request #118 from GoogleCloudPlatform/fix/copy_util_create…
kmaphoenix Apr 3, 2023
4aa431d
patch to v1.6.2
kmaphoenix Apr 3, 2023
38c13d4
refactor for backwards comp
kmaphoenix Apr 14, 2023
adff442
fix: quota project id not being implemented correctly
kmaphoenix Apr 14, 2023
6cb10a5
linting
kmaphoenix Apr 14, 2023
930479c
Merge pull request #120 from GoogleCloudPlatform/fix/set_region
kmaphoenix Apr 14, 2023
e3829f9
update to v1.6.3
kmaphoenix Apr 14, 2023
483ee46
add force for delete page
MRyderOC Apr 27, 2023
593cd67
decorator for api calls added
MRyderOC Apr 28, 2023
089c05c
A method to show number of api calls added
MRyderOC Apr 28, 2023
d5a65e9
decorator added for intents
MRyderOC Apr 29, 2023
516784d
decorator added for agents, flows, pages, webhooks, route groups, and…
MRyderOC May 2, 2023
734068b
Merge pull request #124 from GoogleCloudPlatform/bug/force_delete_page
kmaphoenix May 8, 2023
1d3144d
breakdown api calls for each method
MRyderOC May 9, 2023
a6fc700
Bump pyyaml from 5.3.1 to 5.4
dependabot[bot] May 11, 2023
35c41f4
Merge pull request #125 from GoogleCloudPlatform/dependabot/pip/pyyam…
kmaphoenix May 11, 2023
62bd05d
api call related methods changed for reusability in tools
MRyderOC May 26, 2023
dcae059
api_call decorator added for the rest of the core modules
MRyderOC May 31, 2023
cbcaf88
get_api_calls updated
MRyderOC Jun 6, 2023
8fcef2c
revert changes for core.sessions
MRyderOC Jun 13, 2023
ea8c788
update the api_call_counter_decorator and get_api_calls_details due t…
MRyderOC Jun 13, 2023
f5dc104
add include_conversation_turns to the list_test_cases
MRyderOC Jun 13, 2023
50a2a72
fix: refactor list_agents for clarity
kmaphoenix Jun 17, 2023
0021815
fix: resolving patch conflict
kmaphoenix Jun 17, 2023
274aa8c
fix: linting and merge conflict resolution
kmaphoenix Jun 17, 2023
bfe7993
Merge branch 'main' into feature/api_call_counter
kmaphoenix Jun 17, 2023
f2c9a18
Merge pull request #133 from GoogleCloudPlatform/feature/api_call_cou…
kmaphoenix Jun 17, 2023
ed0e06c
Merge branch 'main' into feature/include_convo_turn_in_test_cases
kmaphoenix Jun 17, 2023
000abc8
Merge pull request #132 from GoogleCloudPlatform/feature/include_conv…
kmaphoenix Jun 17, 2023
d5cf67b
feat: add language code arg to several methods
kmaphoenix Jun 17, 2023
67fdedc
Merge pull request #134 from GoogleCloudPlatform/fix/multilingual_req…
kmaphoenix Jun 17, 2023
28ef21b
fix: deprecate reliance on diag_info
kmaphoenix Jun 21, 2023
686e972
Merge pull request #136 from GoogleCloudPlatform/fix/deprecate_diag_info
kmaphoenix Jun 21, 2023
1c9f813
update v1.7.0
kmaphoenix Jun 21, 2023
0f0f526
pylint depracation issue resolved
MRyderOC Jul 7, 2023
f93e531
more readable code for convert_tr_target_page
MRyderOC Jul 7, 2023
9e09063
docs fix
MRyderOC Jul 7, 2023
89ff592
change df.append to pd.concat due to deprecation warning
MRyderOC Jul 31, 2023
9292e21
Merge pull request #137 from GoogleCloudPlatform/misc/improvement
kmaphoenix Aug 17, 2023
e651ff7
fix: revert change to location_id arg
kmaphoenix Aug 17, 2023
b9a8526
Merge pull request #139 from GoogleCloudPlatform/fix/list_agents_loca…
kmaphoenix Aug 17, 2023
5ace003
Create agent_checker_util.py
SeanScripts Dec 9, 2022
91688f4
Update notes
SeanScripts Dec 9, 2022
332517d
Add utility ID conversion functions
SeanScripts Dec 9, 2022
824007d
Add function get_test_case_results
SeanScripts Dec 9, 2022
444ad71
Add maps
SeanScripts Dec 9, 2022
df4b671
Simplify conversions
SeanScripts Dec 9, 2022
c6b3271
Add docstrings
SeanScripts Dec 9, 2022
da3a4f1
Include imports
SeanScripts Dec 9, 2022
8a4d730
Fix references and missing imports
SeanScripts Dec 9, 2022
d70e7c4
Create functions for finding reachable pages
SeanScripts Dec 9, 2022
9c76cdf
Fix tabbing and imports
SeanScripts Dec 9, 2022
5ac69a8
Implement get_page
SeanScripts Dec 9, 2022
a8efb12
Get flow and page data
SeanScripts Dec 9, 2022
8414538
Fix page data
SeanScripts Dec 9, 2022
e158d61
Fix find_unreachable_pages function and dependencies
SeanScripts Dec 9, 2022
0bda9bb
Clean up agent_checker_util.py
SeanScripts Dec 9, 2022
5ea1851
Lint fixes
SeanScripts Dec 9, 2022
bdfa66f
Optimize agent data loading
SeanScripts Dec 14, 2022
feb6b8b
Clean up excess indents in find_reachable_pages_rec with a couple of …
SeanScripts Dec 16, 2022
b02781f
Minor linting
SeanScripts Dec 16, 2022
6c925a5
More minor linting
SeanScripts Dec 16, 2022
8416c0a
Use early return to remove one indentation layer in find_reachable_pa…
SeanScripts Dec 16, 2022
6c4fecd
Clean up repeated code with new function get_new_presets
SeanScripts Dec 16, 2022
3af4212
Lint fixes
SeanScripts Dec 16, 2022
45a5dff
Debug data mapping
SeanScripts Dec 16, 2022
6217286
Correct negation logic error
SeanScripts Dec 16, 2022
6816535
Fix typo in function name
SeanScripts Dec 16, 2022
e997b51
Add functions find_all_reachable_pages and find_all_unreachable_pages
SeanScripts Dec 16, 2022
743020c
Create function find_reachable_intents
SeanScripts Dec 28, 2022
b6644dc
Create functions find_all_(un)reachable_intents
SeanScripts Dec 28, 2022
6646ac4
Fix function name typo
SeanScripts Dec 28, 2022
268d267
Prevent checking transitions to other flows as if they are pages
SeanScripts Dec 28, 2022
cd46afc
Debug find_all_reachable_intents
SeanScripts Dec 28, 2022
2b97bf0
Move get_test_case_results_df to TestCases
SeanScripts Dec 29, 2022
40152c9
Switch to parameter dictionary
SeanScripts Jan 4, 2023
c8c4437
Fix some bugs with parameter dict and simplify error checking
SeanScripts Jan 4, 2023
7a80ce5
Fix logic error in parameter dict
SeanScripts Jan 5, 2023
2d99b5e
Create additional recursion helper function
SeanScripts Jan 5, 2023
2625b33
Create helper function for meta-pages
SeanScripts Jan 5, 2023
ec4de15
Lint fixes
SeanScripts Jan 5, 2023
9f554e0
Clean up style and make compatible with Python 3.8
SeanScripts Jan 9, 2023
f4a4109
Continue cleaning up style
SeanScripts Jan 9, 2023
f6ed7f8
Lint fixes
SeanScripts Jan 9, 2023
7db4f35
Clean up and add delays for API limits
SeanScripts Jan 30, 2023
3bc51a7
Use flow display name instead of optional choice to use flow ID
SeanScripts Jan 30, 2023
51eb98b
Fix bug introduced before when trying to refactor is_initial
SeanScripts Jan 31, 2023
d61af59
Optimize API calls
SeanScripts Feb 9, 2023
27cdf8d
Clean up conditions and fix map init bug
SeanScripts Feb 9, 2023
0e08b80
Lint fixes
SeanScripts Feb 9, 2023
657f7ee
Clean up test cases and create process_test_cases function
SeanScripts Feb 9, 2023
ba5c20e
Change exception types
SeanScripts Feb 9, 2023
b11dc4a
Simplify convert_page for v1.6 and remove unused functions in agent_c…
SeanScripts Feb 9, 2023
eee3d99
Add agent checker util unit tests
SeanScripts Jul 10, 2023
96916f1
Return page list instead of set; update test fixtures
SeanScripts Jul 10, 2023
51a95a4
Lint fixes
SeanScripts Jul 10, 2023
6470738
Finish rebase and lint fixes
SeanScripts Jul 10, 2023
601101f
fix: refactor to match import standards
kmaphoenix Aug 19, 2023
f510f0b
chore: resort code
kmaphoenix Aug 19, 2023
f98ddd3
fix: refactor process_test_case
kmaphoenix Aug 19, 2023
1500f71
fix: refactor get_test_case_results_df
kmaphoenix Aug 19, 2023
9a36968
fix: Lint fixes
kmaphoenix Aug 19, 2023
a6a27d2
fix: make agent_id required init arg
kmaphoenix Aug 20, 2023
47e68d5
feat: Implement additional export_agent options
kmaphoenix Aug 20, 2023
83fcd48
feat: add get_flow_page_map method
kmaphoenix Aug 21, 2023
1fcf35c
chore: update gitignore
kmaphoenix Aug 21, 2023
f6bffdd
feat: adding agent_extract feature for offline processing
kmaphoenix Aug 21, 2023
dbbf9fe
feat: add test case parsing
kmaphoenix Aug 22, 2023
96f98e2
fix: linting
kmaphoenix Aug 22, 2023
3e4934c
feat: Implement graph structure
kmaphoenix Aug 22, 2023
5a66d8b
feat: refactor graph recursion into extract class for finding graph d…
kmaphoenix Aug 24, 2023
8d26316
fix: re sort AgentData class; add new fields and types
kmaphoenix Aug 24, 2023
cc75794
fix: lint fixes
kmaphoenix Aug 24, 2023
63e1356
fix: formatting
kmaphoenix Aug 24, 2023
c117219
feat: add processing for intents; cleanup old code
kmaphoenix Aug 25, 2023
81a7859
fix: add logging; handle lros; add lang_code support
kmaphoenix Aug 25, 2023
be7fd26
fix: added dir cleanup to avoid local file conflicts
kmaphoenix Aug 25, 2023
5f035d7
fix: fixed display_name parsing for Intents/Entity Types
kmaphoenix Aug 25, 2023
c739920
fix: add lang_code support; fix class type outputs
kmaphoenix Aug 25, 2023
66f7578
feat: implement recursion method for finding reachable pages in graph
kmaphoenix Aug 25, 2023
f676476
fix: lint fixes
kmaphoenix Aug 25, 2023
66361c7
chore: reverting tests due to testing refactor coming soon
kmaphoenix Aug 25, 2023
a750daf
fix: modify active_intents type for downstream processing
kmaphoenix Aug 25, 2023
85aa288
feat: refactor df code; implement get_unreachable_intents
kmaphoenix Aug 25, 2023
67cf893
fix: lint fixes
kmaphoenix Aug 25, 2023
da42187
chore: comment cleanup; unused code cleanup
kmaphoenix Aug 27, 2023
c4edde8
fix: linting
kmaphoenix Aug 27, 2023
77187bd
Merge pull request #104 from GoogleCloudPlatform/feature/agent_checking
kmaphoenix Aug 28, 2023
ad8d01c
fix: remove duplication of START_PAGE rows
kmaphoenix Aug 28, 2023
055452a
chore: set fixed versions for some libraries
kmaphoenix Aug 28, 2023
1bdba41
fix: creds inheritence not being passed correctly
kmaphoenix Aug 28, 2023
6ea847d
feat: add evals class to expose nlu evlas notebook
kmaphoenix Aug 28, 2023
a46f261
fix: rename file; refactor code to be more streamlined
kmaphoenix Sep 11, 2023
97e05e8
feat: add sample input dataset
kmaphoenix Sep 11, 2023
c5ba92a
fix: replace print statements with logging.info
kmaphoenix Sep 11, 2023
afe3ee1
fix: replace default input schema columns
kmaphoenix Sep 11, 2023
4f7a41e
fix: clean up dataframe schemas; drop unused code
kmaphoenix Sep 11, 2023
b479d3f
chore: cleanup unused code
kmaphoenix Sep 11, 2023
a8022a0
feat: add support for CSV as input; refactor code
kmaphoenix Sep 11, 2023
ee5a357
fix: lint fixes
kmaphoenix Sep 11, 2023
e550394
feat: add notebook for demonstrating NLU pipeline
kmaphoenix Sep 11, 2023
88c7fbe
fix: adjust output columns
kmaphoenix Sep 11, 2023
95c6fff
fix: update sample link
kmaphoenix Sep 11, 2023
8585749
Merge pull request #143 from GoogleCloudPlatform/feat/nlu_evals
kmaphoenix Sep 11, 2023
0e81f49
chore: update v1.8.0
kmaphoenix Sep 11, 2023
3c14751
fix: typo on local path
kmaphoenix Sep 11, 2023
13fead6
fix: bump version to 1.8.1
kmaphoenix Sep 11, 2023
40cb7fc
Add Evaluation Tool for generative conversations
ADiegoCAlonso Oct 8, 2023
743875d
Move notebook to its own folder
ADiegoCAlonso Oct 17, 2023
a9809df
Add notebook without colab dependencies
ADiegoCAlonso Oct 18, 2023
6680c14
fix: Move get_agent_answer to Sessions class
kmaphoenix Oct 18, 2023
2e177ee
fix: remove unused code; updates for Sessions
kmaphoenix Oct 18, 2023
a277f55
fix: remove unused code; add Sessions updates
kmaphoenix Oct 18, 2023
4fa35d9
Merge pull request #144 from GoogleCloudPlatform/feature/conversation…
kmaphoenix Oct 18, 2023
5bbc49d
feat: add new match_type for LLM
kmaphoenix Oct 19, 2023
d7f0d39
Merge pull request #146 from GoogleCloudPlatform/feat/llm_match_type
kmaphoenix Oct 19, 2023
37cf8cf
feat: update to v1.9.0
kmaphoenix Oct 19, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
.ipynb_checkpoints
*scratch.ipynb
*scratch.py
tmp/

# IPython
profile_default/
Expand Down
6 changes: 3 additions & 3 deletions .pylintrc
Original file line number Diff line number Diff line change
Expand Up @@ -421,6 +421,6 @@ valid-metaclass-classmethod-first-arg=mcs

# Exceptions that will emit a warning when being caught. Defaults to
# "Exception"
overgeneral-exceptions=StandardError,
Exception,
BaseException
overgeneral-exceptions=builtins.StandardError,
builtins.Exception,
builtins.BaseException
19 changes: 19 additions & 0 deletions data/nlu_evals_sample.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
flow_display_name,utterance,page_display_name,expected_intent,expected_parameters,description
Default Start Flow,I need to get my order status,START_PAGE,head_intent.order_status,,Demo Tests
Default Start Flow,Trying to check the status of my order,START_PAGE,head_intent.order_status,,Demo Tests
Default Start Flow,I hate this order status agent!,START_PAGE,head_intent.order_status,,Demo Tests
Default Start Flow,Wha'ts the point of ordering anything?,START_PAGE,NO_MATCH,,Demo Tests
Default Start Flow,I was looking at the order of operations yesterday but couldn't figure it out,START_PAGE,NO_MATCH,,Demo Tests
Default Start Flow,Thanks for getting my that status so quickly!,START_PAGE,head_intent.order_status,,Demo Tests
Default Start Flow,I need to make a payment,START_PAGE,head_intent.pay_arrangement,,Demo Tests
Default Start Flow,I'm trying to setup a new payment,START_PAGE,head_intent.pay_arrangement,,Demo Tests
Default Start Flow,Did you get the pavement,START_PAGE,NO_MATCH,,Demo Tests
Default Start Flow,I've been trying to pay my bill all day!,START_PAGE,head_intent.pay_arrangement,,Demo Tests
Default Start Flow,Why can't I get my bill paid at all online?,START_PAGE,head_intent.pay_arrangement,,Demo Tests
Default Start Flow,Why can't I get my bill paid at all online? Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?Why can't I get my bill paid at all online?,START_PAGE,head_intent.pay_arrangement,,Demo Tests
Date Collection,12/13/2022,Collect Date,-,"{'collected_date':
{ ""day"": 13, ""month"": 12, ""year"": 2022 }, 'formatted_date': '13/12/2022'}}",Demo Tests
Proper Names Demo,Patrick Marlow,names,-,"{'people_names':
{ ""original"": ""Patrick Marlow"", ""name"": ""Patrick Marlow"" }}",Demo Tests
Proper Names Demo,Andrew Smith,names,,"{'people_names':
{ ""original"": ""Andrew Smith"", ""name"": ""Andrew Smith"" }}",Demo Tests
Loading
Loading