Error when run 'run_evaluation.sh'

[SExpert12]

Hello,
I run 'run_evaluation.sh' with cmd
"sh leaderboard/scripts/run_evaluation.sh" as per repo.

But I encountered this error:

init statistics_manager
begin

========= Preparing RouteScenario_0 (repetition 0) =========

Setting up the agent
Downloading: "https://download.pytorch.org/models/resnet34-333f7ec4.pth" to /home/ryzen/.cache/torch/hub/checkpoints/resnet34-333f7ec4.pth
100%|██████████████████████████████████████| 83.3M/83.3M [00:23<00:00, 3.70MB/s]

Could not set up the required agent:

[Errno 2] No such file or directory: ''

Traceback (most recent call last):
File "leaderboard/leaderboard/leaderboard_evaluator.py", line 306, in _load_and_run_scenario
self.agent_instance = getattr(self.module_agent, agent_class_name)(args.agent_config)
File "/home/TCP-main/leaderboard/leaderboard/autoagents/autonomous_agent.py", line 45, in init
self.setup(path_to_conf_file)
File "/home/TCP-main/leaderboard/team_code/tcp_agent.py", line 54, in setup
ckpt = torch.load(path_to_conf_file)
File "/home/.local/lib/python3.8/site-packages/torch/serialization.py", line 997, in load
with _open_file_like(f, 'rb') as opened_file:
File "/home/.local/lib/python3.8/site-packages/torch/serialization.py", line 444, in _open_file_like
return _open_file(name_or_buffer, mode)
File "/home/.local/lib/python3.8/site-packages/torch/serialization.py", line 425, in init
super().init(open(name, mode))
FileNotFoundError: [Errno 2] No such file or directory: ''
Traceback (most recent call last):
File "leaderboard/leaderboard/leaderboard_evaluator.py", line 306, in _load_and_run_scenario
self.agent_instance = getattr(self.module_agent, agent_class_name)(args.agent_config)
File "/home/TCP-main/leaderboard/leaderboard/autoagents/autonomous_agent.py", line 45, in init
self.setup(path_to_conf_file)
File "/home/TCP-main/leaderboard/team_code/tcp_agent.py", line 54, in setup
ckpt = torch.load(path_to_conf_file)
File "/home/.local/lib/python3.8/site-packages/torch/serialization.py", line 997, in load
with _open_file_like(f, 'rb') as opened_file:
File "/home/.local/lib/python3.8/site-packages/torch/serialization.py", line 444, in _open_file_like
return _open_file(name_or_buffer, mode)
File "/home/.local/lib/python3.8/site-packages/torch/serialization.py", line 425, in init
super().init(open(name, mode))
FileNotFoundError: [Errno 2] No such file or directory: ''

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "leaderboard/leaderboard/leaderboard_evaluator.py", line 520, in main
leaderboard_evaluator.run(arguments)
File "leaderboard/leaderboard/leaderboard_evaluator.py", line 452, in run
self._load_and_run_scenario(args, config)
File "leaderboard/leaderboard/leaderboard_evaluator.py", line 342, in _load_and_run_scenario
self._register_statistics(config, args.checkpoint, entry_status, crash_message)
File "leaderboard/leaderboard/leaderboard_evaluator.py", line 275, in _register_statistics
current_stats_record = self.statistics_manager.compute_route_statistics(
File "/home/TCP-main/leaderboard/leaderboard/utils/statistics_manager.py", line 138, in compute_route_statistics
route_record.meta['total_steps'] = config.agent.step
AttributeError: 'NoneType' object has no attribute 'step'

How to resolve this?
Thanks.

[penghao-wu]

Make sure you set

TCP/leaderboard/scripts/run_evaluation.sh

Line 23 in 9ec4db0

export TEAM_CONFIG= PATH_TO_MODEL_CKPT

correctly.

[1585596474]

Make sure you set

TCP/leaderboard/scripts/run_evaluation.sh

Line 23 in 9ec4db0

export TEAM_CONFIG= PATH_TO_MODEL_CKPT

correctly.

Thank you for sharing your code.

I have trained the model, but I cannot find it. I have not modified any code. Can you tell me the default directory of saving the ckpt file?