Skip to content

Commit

Permalink
Refactor comms trace parser and deprecate support for basic and Kinet…
Browse files Browse the repository at this point in the history
…o traces (#155)

Summary:
Refactored the commsTraceParser to enhance readability and maintainability.
Removed deprecated support for parsing "basic" and "Kineto" traces; only Chakra host execution traces are now supported.
Added detailed logging to handle undecimal process group names with warnings instead of exceptions.
Modified _parse_proc_group_info and _parse_comms_op_node for improved processing of process group info and communication operations.
Updated comms_utils to support additional data types (signed char, unsigned char).
Adjusted the command-line interface to reflect the updated trace type options.


Test Plan: $ comm_replay --trace-type et --trace-path /home/sanshang/021_debug/000_code/param/trace/traces_megatronlm_gpt_43B_32ranks_pytnightly0703/execution_trace

Differential Revision: D61025278
  • Loading branch information
shengfukevin authored and facebook-github-bot committed Aug 9, 2024
1 parent edc5c69 commit 4c96222
Show file tree
Hide file tree
Showing 4 changed files with 219 additions and 277 deletions.
Loading

0 comments on commit 4c96222

Please sign in to comment.