[Tracking] Testing Not-Supported Feature

[hukoyu]

When failing LTP tests categorized, they were categorized into 4 categories:

1. Test Issues - Test Bugs:

• There is bug in the test code such as non-existing folder or user and so on
• Fix bug in test code and enable test

2. Test Issue – Test Using Not-Supported Feature

• Testing supported feature (syscall) in sgx-lkl but in the test code a not-supported feature is used
• Refactor test code without using not-supported feature and enable test

**3) Testing Not Supported Feature

• Sgx-lkl will not support these features due to limitations such as single process, single user
• We will disable these tests. They are not applicable since sgx-lkl doesn’t implement these features**

4. SGX-LKL Bug

• Tests are  legit and failures are genuine. Tests failing due to incomplete implementation or bug in sgx-lkl implementation.
• Fix bug in sgx-lkl and enable test

Currently there are 165 tests in "Testing Not Supported Feature" category that we will track with this issue.

[hukoyu]

These are tests that not supported by sgx-lkl and will not be enabled at all: (Count: 165)
Update Date: July 28, 2020

syslog-syslogtst
ptrace05
ptrace04
prctl06
eventfd01
fcntl07
fcntl11
fsync04
madvise08
madvise09
clone01, clone02, clone03, clone04, clone05, clone06, clone07, clone08
abort01
waitpid10
waitpid09
waitpid07
waitpid06
waitpid05
waitpid03
waitpid02
waitpid01
waitpid13
waitpid12
waitpid11
prctl-prctl06_execve
execveat-execveat_child
execveat-execveat_errno
execve-execve01_child
execv-execv01_child
setresuid04
unshare02
unshare01
pause03
pause01
fcntl22

There are 100 non supported tests that will add here soon...

Not supported per Peter:

acct02
ioperm01
iopl01
add_key01
delete_module02
migrate_pages01
modify_ldt01
msgctl01
ipc-msgget-msgget03
acct01
kcmp01
keyctl01
keyctl02
perf_event_open01
profil01
quotactl02
setns02
swapon03
userfaultfd01
pkey01
swapoff01
delete_module03
delete_module01
acct-acct02_helper