Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fi] Allow bypassing response check #382

Closed
nasahlpa opened this issue Dec 1, 2024 · 0 comments
Closed

[fi] Allow bypassing response check #382

nasahlpa opened this issue Dec 1, 2024 · 0 comments
Assignees
@nasahlpa
Labels
Priority:P1

Comments

@nasahlpa
Copy link
Member

nasahlpa commented Dec 1, 2024

Currently, for FI experiments, we check whether the response from the device matches the expected response defined in the config file. However, for some tests, we return random data. Here, this simple check does not work and needs to be replaced by a more complex analysis. As this analysis depends on the actual test, we should add a feature to the FI scripts such that we can bypass this check and do the analysis afterwards.
@nasahlpa nasahlpa self-assigned this Dec 1, 2024
@nasahlpa nasahlpa mentioned this issue Dec 1, 2024
Merged
nasahlpa added a commit to nasahlpa/ot-sca that referenced this issue Dec 6, 2024
@nasahlpa
[fi] Bypass response check for certain tests
0a9450f 
For some tests (e.g., that return random data) comparing the response
with an expected response does not make sense. For these tests a
manual analysis needs to be conducted. This commit detects these tests
and bypass the response comparion.

Closes lowRISC#382

Signed-off-by: Pascal Nasahl <[email protected]>
nasahlpa added a commit to nasahlpa/ot-sca that referenced this issue Dec 6, 2024
@nasahlpa
[fi] Bypass response check for certain tests
e0265a9 
For some tests (e.g., that return random data) comparing the response
with an expected response does not make sense. For these tests a
manual analysis needs to be conducted. This commit detects these tests
and bypass the response comparion.

Closes lowRISC#382

Signed-off-by: Pascal Nasahl <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nasahlpa nasahlpa

Labels
Priority:P1
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@nasahlpa