make update - gives error code 128 - /usr/src

[computeronix]

@fichtner

When I run make update - it gives error code 128 error and fails the script on /usr/src repro

It looks like I get further now but it now fails on /usr/src with the same error. Not sure if a similar fix is needed based on previous issue, not sure entirely what was fixed over last week, but as a heads up this is now where I am stuck at and not sure if anyone else is seeing this?

Previous issue: #454

Log:

Running build step: update
Passing arguments: (none)
Fetching /usr/core:
Updating branch stable/25.1 of /usr/core:
Already on 'stable/25.1'
Your branch is up to date with 'origin/stable/25.1'.
Already up to date.
Fetching /usr/plugins:
Updating branch stable/25.1 of /usr/plugins:
Already on 'stable/25.1'
Your branch is up to date with 'origin/stable/25.1'.
Already up to date.
Fetching /usr/ports:
Updating branch master of /usr/ports:
Already on 'master'
Your branch is up to date with 'origin/master'.
Already up to date.
Cloning /usr/src:
Cloning into '/usr/src'...
error: RPC failed; curl 92 HTTP/2 stream 5 was not closed cleanly: CANCEL (err 8)
error: 8386 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output
*** Error code 128

Stop.
make: stopped in /usr/tools

Thanks again for the help!

[computeronix]

b58c93f

Not sure if this was the commit that resolved the ports issue? If so is there another permissions issue with another file that does something similar with the src syncing?

Just taking a stab in the dark

[computeronix]

Attempted a manual run on the FreeBSD 14.2-RELEASE - Raspberry Pi4 and it failed too with the following

Command:
git clone -v https://github.com/opnsense/src /usr/src

Cloning into '/usr/src'...
POST git-upload-pack (175 bytes)
POST git-upload-pack (gzip 11517 to 5782 bytes)
error: RPC failed; curl 18 transfer closed with outstanding read data remaining
error: 6152 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output

[computeronix]

@fichtner

Was finally able to manually clone /usr/src on the device using the following manual command based on other's feedback from other github forums (https://github.com/orgs/community/discussions/145884):

Workaround:
sudo rm -rf /usr/src
sudo git -c core.compression=0 clone --depth 1 -b stable/25.1 https://github.com/opnsense/src.git /usr/src

result:
Cloning into '/usr/src'...
Updating files: 100% (99921/99921), done.

could you update the script to support this or allow this or check for or allow manual entry of this through an environment variable? Maybe if it fails with the above error on any of the git repros have it run through with the following options then re-run the previous command after?

"-c core.compression=0" "--depth 1" "-b recommended-branch"

Not sure if needed for all environments but this actually seemed to fix the issue

Now when i run sudo make update, it properly runs going forward 👍

result of sudo make update (just /usr/src section since that is focus)

Fetching /usr/src:
From https://github.com/opnsense/src

• [new tag] 15.1 -> 15.1
• [new tag] 15.1.10 -> 15.1.10
• [new tag] 15.1.11 -> 15.1.11
• [new tag] 15.1.12 -> 15.1.12
• [new tag] 15.1.2 -> 15.1.2
• [new tag] 15.1.4 -> 15.1.4
• [new tag] 15.1.6 -> 15.1.6
• [new tag] 15.1.7 -> 15.1.7
• [new tag] 15.1.8 -> 15.1.8
• [new tag] 15.1.9 -> 15.1.9
• [new tag] 15.7 -> 15.7
• [new tag] 15.7.10 -> 15.7.10
• [new tag] 15.7.12 -> 15.7.12
• [new tag] 15.7.18 -> 15.7.18
• [new tag] 15.7.20 -> 15.7.20
• [new tag] 15.7.24 -> 15.7.24
• [new tag] 15.7.25 -> 15.7.25
• [new tag] 15.7.4 -> 15.7.4
• [new tag] 15.7.6 -> 15.7.6
• [new tag] 15.7.8 -> 15.7.8
• [new tag] 16.1 -> 16.1
• [new tag] 16.1.14 -> 16.1.14
• [new tag] 16.1.16 -> 16.1.16
• [new tag] 16.1.18 -> 16.1.18
• [new tag] 16.1.2 -> 16.1.2
• [new tag] 16.1.3 -> 16.1.3
• [new tag] 16.1.6 -> 16.1.6
• [new tag] 16.1.8 -> 16.1.8
• [new tag] 16.1.9 -> 16.1.9
• [new tag] 16.7 -> 16.7
• [new tag] 16.7.1 -> 16.7.1
• [new tag] 16.7.11 -> 16.7.11
• [new tag] 16.7.2 -> 16.7.2
• [new tag] 16.7.5 -> 16.7.5
• [new tag] 16.7.7 -> 16.7.7
• [new tag] 16.7.a -> 16.7.a
• [new tag] 16.7.b -> 16.7.b
• [new tag] 16.7.r -> 16.7.r
• [new tag] 17.1 -> 17.1
• [new tag] 17.1.1 -> 17.1.1
• [new tag] 17.1.2 -> 17.1.2
• [new tag] 17.1.3 -> 17.1.3
• [new tag] 17.1.4 -> 17.1.4
• [new tag] 17.1.7 -> 17.1.7
• [new tag] 17.1.9 -> 17.1.9
• [new tag] 17.1.a -> 17.1.a
• [new tag] 17.1.b -> 17.1.b
• [new tag] 17.1.r1 -> 17.1.r1
• [new tag] 17.7 -> 17.7
• [new tag] 17.7.1 -> 17.7.1
• [new tag] 17.7.10 -> 17.7.10
• [new tag] 17.7.8 -> 17.7.8
• [new tag] 17.7.a -> 17.7.a
• [new tag] 17.7.b -> 17.7.b
• [new tag] 17.7.r -> 17.7.r
• [new tag] 17.7.r1 -> 17.7.r1
• [new tag] 18.1 -> 18.1
• [new tag] 18.1.11 -> 18.1.11
• [new tag] 18.1.5 -> 18.1.5
• [new tag] 18.1.6 -> 18.1.6
• [new tag] 18.1.8 -> 18.1.8
• [new tag] 18.1.a -> 18.1.a
• [new tag] 18.1.b -> 18.1.b
• [new tag] 18.1.r1 -> 18.1.r1
• [new tag] 18.7 -> 18.7
• [new tag] 18.7.1 -> 18.7.1
• [new tag] 18.7.10 -> 18.7.10
• [new tag] 18.7.2 -> 18.7.2
• [new tag] 18.7.3 -> 18.7.3
• [new tag] 18.7.4 -> 18.7.4
• [new tag] 18.7.6 -> 18.7.6
• [new tag] 18.7.9 -> 18.7.9
• [new tag] 18.7.a -> 18.7.a
• [new tag] 18.7.b -> 18.7.b
• [new tag] 18.7.r -> 18.7.r
• [new tag] 18.7.r1 -> 18.7.r1
• [new tag] 19.1 -> 19.1
• [new tag] 19.1.2 -> 19.1.2
• [new tag] 19.1.4 -> 19.1.4
• [new tag] 19.1.7 -> 19.1.7
• [new tag] 19.1.8 -> 19.1.8
• [new tag] 19.1.a -> 19.1.a
• [new tag] 19.1.b -> 19.1.b
• [new tag] 19.1.r1 -> 19.1.r1
• [new tag] 19.7 -> 19.7
• [new tag] 19.7.2 -> 19.7.2
• [new tag] 19.7.3 -> 19.7.3
• [new tag] 19.7.7 -> 19.7.7
• [new tag] 19.7.a -> 19.7.a
• [new tag] 19.7.b -> 19.7.b
• [new tag] 19.7.r -> 19.7.r
• [new tag] 19.7.r1 -> 19.7.r1
• [new tag] 20.1 -> 20.1
• [new tag] 20.1.2 -> 20.1.2
• [new tag] 20.1.4 -> 20.1.4
• [new tag] 20.1.6 -> 20.1.6
• [new tag] 20.1.7 -> 20.1.7
• [new tag] 20.1.a -> 20.1.a
• [new tag] 20.1.b -> 20.1.b
• [new tag] 20.7 -> 20.7
• [new tag] 20.7.1 -> 20.7.1
• [new tag] 20.7.2 -> 20.7.2
• [new tag] 20.7.3 -> 20.7.3
• [new tag] 20.7.4 -> 20.7.4
• [new tag] 20.7.6 -> 20.7.6
• [new tag] 20.7.8 -> 20.7.8
• [new tag] 20.7.a -> 20.7.a
• [new tag] 20.7.b -> 20.7.b
• [new tag] 20.7.b1 -> 20.7.b1
• [new tag] 20.7.b2 -> 20.7.b2
• [new tag] 20.7.r1 -> 20.7.r1
• [new tag] 21.1 -> 21.1
• [new tag] 21.1.1 -> 21.1.1
• [new tag] 21.1.3 -> 21.1.3
• [new tag] 21.1.4 -> 21.1.4
• [new tag] 21.1.5 -> 21.1.5
• [new tag] 21.1.6 -> 21.1.6
• [new tag] 21.1.7 -> 21.1.7
• [new tag] 21.1.8 -> 21.1.8
• [new tag] 21.1.9 -> 21.1.9
• [new tag] 21.1.a -> 21.1.a
• [new tag] 21.1.b -> 21.1.b
• [new tag] 21.1.r -> 21.1.r
• [new tag] 21.1.r1 -> 21.1.r1
• [new tag] 21.7 -> 21.7
• [new tag] 21.7.1 -> 21.7.1
• [new tag] 21.7.2 -> 21.7.2
• [new tag] 21.7.4 -> 21.7.4
• [new tag] 21.7.5 -> 21.7.5
• [new tag] 21.7.7 -> 21.7.7
• [new tag] 21.7.8 -> 21.7.8
• [new tag] 21.7.a -> 21.7.a
• [new tag] 21.7.b -> 21.7.b
• [new tag] 21.7.r -> 21.7.r
• [new tag] 21.7.r1 -> 21.7.r1
• [new tag] 21.7.r2 -> 21.7.r2
• [new tag] 22.1 -> 22.1
• [new tag] 22.1.1 -> 22.1.1
• [new tag] 22.1.2 -> 22.1.2
• [new tag] 22.1.4 -> 22.1.4
• [new tag] 22.1.5 -> 22.1.5
• [new tag] 22.1.8 -> 22.1.8
• [new tag] 22.1.9 -> 22.1.9
• [new tag] 22.1.b1 -> 22.1.b1
• [new tag] 22.1.b2 -> 22.1.b2
• [new tag] 22.1.b3 -> 22.1.b3
• [new tag] 22.1.r1 -> 22.1.r1
• [new tag] 22.1.r2 -> 22.1.r2
• [new tag] 22.7 -> 22.7
• [new tag] 22.7.12 -> 22.7.12
• [new tag] 22.7.2 -> 22.7.2
• [new tag] 22.7.3 -> 22.7.3
• [new tag] 22.7.5 -> 22.7.5
• [new tag] 22.7.7 -> 22.7.7
• [new tag] 22.7.9 -> 22.7.9
• [new tag] 22.7.b -> 22.7.b
• [new tag] 22.7.r1 -> 22.7.r1
• [new tag] 23.1 -> 23.1
• [new tag] 23.1.1 -> 23.1.1
• [new tag] 23.1.11 -> 23.1.11
• [new tag] 23.1.2 -> 23.1.2
• [new tag] 23.1.5 -> 23.1.5
• [new tag] 23.1.6 -> 23.1.6
• [new tag] 23.1.8 -> 23.1.8
• [new tag] 23.1.b -> 23.1.b
• [new tag] 23.1.r1 -> 23.1.r1
• [new tag] 23.7 -> 23.7
• [new tag] 23.7.1 -> 23.7.1
• [new tag] 23.7.10 -> 23.7.10
• [new tag] 23.7.2 -> 23.7.2
• [new tag] 23.7.4 -> 23.7.4
• [new tag] 23.7.7 -> 23.7.7
• [new tag] 23.7.8 -> 23.7.8
• [new tag] 23.7.d -> 23.7.d
• [new tag] 23.7.r1 -> 23.7.r1
• [new tag] 24.1 -> 24.1
• [new tag] 24.1.10 -> 24.1.10
• [new tag] 24.1.2 -> 24.1.2
• [new tag] 24.1.5 -> 24.1.5
• [new tag] 24.1.8 -> 24.1.8
• [new tag] 24.1.r -> 24.1.r
• [new tag] 24.1.r1 -> 24.1.r1
• [new tag] 24.7 -> 24.7
• [new tag] 24.7.1 -> 24.7.1
• [new tag] 24.7.10 -> 24.7.10
• [new tag] 24.7.12 -> 24.7.12
• [new tag] 24.7.13 -> 24.7.13
• [new tag] 24.7.2 -> 24.7.2
• [new tag] 24.7.3 -> 24.7.3
• [new tag] 24.7.4 -> 24.7.4
• [new tag] 24.7.5 -> 24.7.5
• [new tag] 24.7.6 -> 24.7.6
• [new tag] 24.7.8 -> 24.7.8
• [new tag] 24.7.b -> 24.7.b
• [new tag] 24.7.r1 -> 24.7.r1
• [new tag] 24.7.r2 -> 24.7.r2
• [new tag] 25.1 -> 25.1
• [new tag] 25.1.b -> 25.1.b
• [new tag] 25.1.r1 -> 25.1.r1

Updating branch stable/25.1 of /usr/src:
Already on 'stable/25.1'
Your branch is up to date with 'origin/stable/25.1'.
Already up to date.

[fichtner]

I'm not sure what you're looking at, but it has nothing to do withe the build system or tools. There is one MTU bug in 25.1 that could cause this if you happen to run your build host through a fresh OPNsene 25.1 to the Internet (traffic forwarding).