Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Atis fewshot generation error #17

Open
niloofar17 opened this issue Oct 12, 2021 · 2 comments
Open

Atis fewshot generation error #17

niloofar17 opened this issue Oct 12, 2021 · 2 comments

Comments

@niloofar17
Copy link

Hi all,

I am facing a new error while generating the few shot dataset for ATIS, even though the structure is so similar and both are using the same dataloader. the only difference is the config to edit the all_domain as follows:
all_domain = [['atis_flight'], ['atis_airfare'],['atis_airline'],['atis_ground_service'],
['atis_quantity'], ['atis_city'], ['atis_flight', 'atis_airfare'],['atis_abbreviation'],
['atis_aircraft'],['atis_distance'],['atis_ground_fare'],['atis_capacity'],['atis_flight_time'],
['atis_meal'],['atis_aircraft', 'atis_flight', 'atis_flight_no'],['atis_flight_no'],['atis_restriction'],
['atis_airport'],['atis_airline', 'atis_flight_no'],['atis_cheapest'],['atis_ground_service', 'atis_ground_fare'],
['atis_day_name']]
*note: I used the function load_data in the raw_data_loader.py to get the unique intents to add to the list.

after running the gen_meta_data.sh I get this error:

Screenshot 2021-10-12 at 10 01 42

can you please tell me what should I do about it?
I also want to know if I can use this tool for dstc8-schema-guided-dialogue?

thank you in advance

@niloofar17
Copy link
Author

@AtmaHou can you please let me know if you know the solution. thank you in advance

@AtmaHou
Copy link
Owner

AtmaHou commented Oct 21, 2021

Hi all,

I am facing a new error while generating the few shot dataset for ATIS, even though the structure is so similar and both are using the same dataloader. the only difference is the config to edit the all_domain as follows: all_domain = [['atis_flight'], ['atis_airfare'],['atis_airline'],['atis_ground_service'], ['atis_quantity'], ['atis_city'], ['atis_flight', 'atis_airfare'],['atis_abbreviation'], ['atis_aircraft'],['atis_distance'],['atis_ground_fare'],['atis_capacity'],['atis_flight_time'], ['atis_meal'],['atis_aircraft', 'atis_flight', 'atis_flight_no'],['atis_flight_no'],['atis_restriction'], ['atis_airport'],['atis_airline', 'atis_flight_no'],['atis_cheapest'],['atis_ground_service', 'atis_ground_fare'], ['atis_day_name']] *note: I used the function load_data in the raw_data_loader.py to get the unique intents to add to the list.

after running the gen_meta_data.sh I get this error:

Screenshot 2021-10-12 at 10 01 42

can you please tell me what should I do about it? I also want to know if I can use this tool for dstc8-schema-guided-dialogue?

thank you in advance

I haven't encountered the exact same error.
It shows that you are sampling from an empty list, maybe you can check your label bucket and find if there are some label has no corresponding samples.

For dstc8, the tool itself is data-agnostic : )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants