https://www.semanticscholar.org/product/api#api-key-form", "code": "429"

[gao106]

when i try to run this command:python launch_scientist.py --model "deepseek-coder-v2-0724" --experiment nanoGPT --num-ideas 1**

Response Status Code: 429
Response Content: {"message": "Too Many Requests. Please wait and try again or apply for a key for higher rate limits. https://www.semanticscholar.org/product/api#api-key-form", "code": "429"}
Backing off 6.5 seconds after 4 tries calling function search_for_papers at 04:14:52
Response Status Code: 429
Response Content: {"message": "Too Many Requests. Please wait and try again or apply for a key for higher rate limits. https://www.semanticscholar.org/product/api#api-key-form", "code": "429"}
Backing off 12.0 seconds after 5 tries calling function search_for_papers at 04:14:59
Response Status Code: 429
Response Content: {"message": "Too Many Requests. Please wait and try again or apply for a key for higher rate limits. https://www.semanticscholar.org/product/api#api-key-form", "code": "429"}
Backing off 15.8 seconds after 6 tries calling function search_for_papers at 04:15:11
Response Status Code: 429

what should i do?

[conglu1997]

Please see: #78 Try see if the API works at all, and you have no firewall.

[gao106]

It seems the issue isn't related to the firewall. It appears that the program is accessing https://www.semanticscholar.org/product/api#api-key-form too frequently. Do you know where to change this address or adjust the strategy?

[conglu1997]

Requesting an API key would be the best strategy, alternatively one could consider other open scholarly archives such as DBLP! I believe Google Scholar can be challenging to access properly and can often block access.

[gao106]

Where can I make changes to switch to DBLP? Please let me know.

[Isaadahmed2]

I also need help for switching DBLP

[conglu1997]

The code for semantic scholar is here:

AI-Scientist/ai_scientist/generate_ideas.py

Line 284 in ed798a0

def search_for_papers(query, result_limit=10) -> Union[None, List[Dict]]:

. I should say, the easiest option is to just request a key.

[gao106]

Yeah,i konw .but it very hard to get a key.

[jli113]

I'm using Ubuntu 24.4, I run export S2_API_KEY="MY KEY" in the terminal, opened another terminal to run launch_scientist.py.
Still got 429.

[conglu1997]

export doesn't last between different terminal sessions.

[Isaadahmed2]

@jli113 how do you get a key?

[conglu1997]

https://www.semanticscholar.org/product/api#api-key-form

[micelvrice]

Has anyone been successful in their application? how long does it take, I submitted my application 3 days ago and still no response

https://www.semanticscholar.org/product/api#api-key-form

[Isaadahmed2]

@micelvrice same I have submitted the request like 3 days ago

[conglu1997]

Perhaps 1-2 weeks. Feel free to run without novelty checking or citations in the writeup in the meantime! Just comment out the necessary lines.

[Isaadahmed2]

@conglu1997 I have tried that but i am getting error ../../data path for train.bin is not there.

[conglu1997]

Have you run the prepare steps?

[Isaadahmed2]

@conglu1997 yes I have done all of them and the file is present there.

[conglu1997]

Can you try pull the most recent version of the code? We recently fixed a related issue.

[jobschang7]

Can you try pull the most recent version of the code? We recently fixed a related issue.

i tried the most recent version of the code. same problem.

[gao106]

@jobschang7 Requesting an API key would be the best strategy, HAHAHAHAHAH

[BradKML]

@gao106 registration can be a bit of a pain sometimes, if only there are tutorials that are more straightforward

[conglu1997]

Please see #135