Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf: Optimization of ZIP streaming decompression #1057

Open
wants to merge 59 commits into
base: dev/exp
Choose a base branch
from
Open

perf: Optimization of ZIP streaming decompression #1057

wants to merge 59 commits into from

Commits on Aug 15, 2024

  1. Added support for ZIP compressed package streaming download 

    Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    238d5a1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/Scighost/Starward 

    Signed-off-by: scottxu <[email protected]>

# Conflicts:
#	src/Starward.Language/Lang.resx
#	src/Starward.Language/Lang.zh-CN.resx
    @iamscottxu
    iamscottxu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    038243a View commit details
    Browse the repository at this point in the history

  3. Fixed Chinese translation error for streaming download options 

    Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    248af32 View commit details
    Browse the repository at this point in the history

  4. Adjusted the conditions for automatic deletion of ZIP central directo… 

    …ry files.

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    60e59c1 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Fixed Chinese translation error for streaming `Default Game Installat… 

    …ion Path Description`

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    7eb4b97 View commit details
    Browse the repository at this point in the history

  2. remove an unnecessary judgment if(FileInfo.Exists)FileInfo.Delete; 

    Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ad36ad1 View commit details
    Browse the repository at this point in the history

  3. fixed a bug where the ZipStreamDownload resource file could not be found 

    Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ddceb6b View commit details
    Browse the repository at this point in the history

  4. HttpClientHandler has been deprecated and replaced SocketsHttpHandler 

    Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ab656c8 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'SocketsHttpHandler' into streamdownload

    @iamscottxu
    iamscottxu committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ccf9d53 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. fixed a bug where streaming download tasks could run in parallel and … 

    …cause unexpected behavior after a traditional download mode task was started

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    eff47d8 View commit details
    Browse the repository at this point in the history

  2. fixed a bug that could cause a download task to end prematurely when … 

    …a streaming download was retried

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    6f97c05 View commit details
    Browse the repository at this point in the history

  3. fixed a bug where exceptions might not be caught when streaming downl… 

    …oads

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    be2caed View commit details
    Browse the repository at this point in the history

  4. fixed a bug where exceptions during streaming downloads would be inco… 

    …rrectly caught as `TaskCanceledException`

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    ec1257d View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2024

  1. fixed a bug where an error occurred when an HttpServerNotSupportedPar… 

    …tialDownloadException was thrown

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    d161ba2 View commit details
    Browse the repository at this point in the history

  2. HTTP LastModified is no longer required to be present when streaming … 

    …ZIP downloads

Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    cbc0e68 View commit details
    Browse the repository at this point in the history

  3. resolve domain names in advance before streaming downloads 

    Signed-off-by: scottxu <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    28b8c7d View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. fixed a bug in ContentType validation when ZIP streaming download 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    5fb6513 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. fixed a bug where cancel exceptions were not caught when streaming do… 

    …wnloads

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    7fadea2 View commit details
    Browse the repository at this point in the history

  2. added Canceling status because streaming downloads take too long to c… 

    …ancel

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    cb7be67 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. disk space pre-allocation and read/write cache optimization for strea… 

    …ming download

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    81770d3 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. optimized the thread scheduling logic of streaming download mode, and… 

    … fixed the bug in which the progress was displayed incorrectly after the download was paused and restarted

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    cb8247a View commit details
    Browse the repository at this point in the history

  2. fixed a bug where central directory files were not closed after task … 

    …completion or cancellation when streaming downloads

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    50ea759 View commit details
    Browse the repository at this point in the history

  3. optimized the code for streaming download 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    4784d5e View commit details
    Browse the repository at this point in the history

  4. removed redundant code for streaming downloads 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    d97bc30 View commit details
    Browse the repository at this point in the history

  5. adjusted the code format 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    e1cc38a View commit details
    Browse the repository at this point in the history

  6. optimized the code of streaming download speed limiter 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    d2d7196 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2024

  1. Merge branch 'main' into streamdownload 

    Signed-off-by: OsakaRuma <[email protected]>

# Conflicts:
#	src/Starward.Language/Lang.es-ES.resx
#	src/Starward.Language/Lang.it-IT.resx
#	src/Starward.Language/Lang.ja-JP.resx
#	src/Starward.Language/Lang.ko-KR.resx
#	src/Starward.Language/Lang.ru-RU.resx
#	src/Starward.Language/Lang.th-TH.resx
    @iamscottxu
    iamscottxu committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    1def457 View commit details
    Browse the repository at this point in the history

  2. added "Cancelling" message 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    daa4bbd View commit details
    Browse the repository at this point in the history

  3. globally limit the maximum number of connections per server and optim… 

    …ize streaming download speed

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    f33702f View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Merge branch 'main' into streamdownload

    @iamscottxu
    iamscottxu committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    101e7b1 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. added missing ConfigureAwait 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    352d4c1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into streamdownload

    @iamscottxu
    iamscottxu committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    e2f0e4f View commit details
    Browse the repository at this point in the history

  3. streaming download: optimized the retry speed when network errors occur 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    a4db541 View commit details
    Browse the repository at this point in the history

  4. submit missing file 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    aa03f15 View commit details
    Browse the repository at this point in the history

  5. removed redundant code 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    61eeaa0 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. optimized the code of stream download 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    23aa9fd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'streamdownload' into streamdownload_optimization 

    Signed-off-by: OsakaRuma <[email protected]>

# Conflicts:
#	src/Starward.Core.ZipStreamDownload/FastZipStreamDownloadTask.partial.cs
    @iamscottxu
    iamscottxu committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    81c3f1d View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2024

  1. Merge branch 'main' into streamdownload

    @iamscottxu
    iamscottxu committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    cf4ce68 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'streamdownload' into streamdownload_optimization

    @iamscottxu
    iamscottxu committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    3e6b2e6 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. optimized the speed of DNS resolution during streaming downloads. 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    d7bce53 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. optimized the number of threads that need to be started when there ar… 

    …e few files in the compressed package during streaming download

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    6a7d922 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Merge branch 'main' into streamdownload

    @iamscottxu
    iamscottxu committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    dc09431 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2024

  1. fixed the bug that method CurrentTaskFinished was executed multiple… 

    … times by multiple threads (Scighost#1083) (Scighost#1082)

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    57da19b View commit details
    Browse the repository at this point in the history

  2. handling exception, deleted voice code 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    e64c24c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'bug_fix' into streamdownload 

    Signed-off-by: OsakaRuma <[email protected]>

# Conflicts:
#	src/Starward/Services/Download/InstallGameService.cs
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    640f41e View commit details
    Browse the repository at this point in the history

  4. fixed typo of variable name 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    631be21 View commit details
    Browse the repository at this point in the history

  5. fixed typo in variable name 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    cc0a99d View commit details
    Browse the repository at this point in the history

  6. Merge branch 'bug_fix' into streamdownload 

    Signed-off-by: OsakaRuma <[email protected]>

# Conflicts:
#	src/Starward/Services/Download/InstallGameService.cs
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    b9f2ebd View commit details
    Browse the repository at this point in the history

  7. fixed a bug where only the first step of the task could be run if the… 

    …re were multiple steps of the task when installing the game

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    9ad0944 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'bug_fix' into streamdownload

    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    671d245 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' into streamdownload

    @iamscottxu
    iamscottxu committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    a5b1980 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. fixed bug where task would not continue after streaming download comp… 

    …leted

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    7b8df5c View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Merge branch 'main' into streamdownload 

    Signed-off-by: OsakaRuma <[email protected]>

# Conflicts:
#	src/Starward.Language/Lang.de-DE.resx
#	src/Starward.Language/Lang.es-ES.resx
#	src/Starward.Language/Lang.it-IT.resx
#	src/Starward.Language/Lang.ja-JP.resx
#	src/Starward.Language/Lang.ko-KR.resx
#	src/Starward.Language/Lang.ru-RU.resx
#	src/Starward.Language/Lang.th-TH.resx
#	src/Starward.Language/Lang.vi-VN.resx
#	src/Starward/Services/Download/InstallGameManager.cs
#	src/Starward/Services/Download/InstallGameService.cs
    @iamscottxu
    iamscottxu committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    2ea68fe View commit details
    Browse the repository at this point in the history

  2. Added judgment to skip relevant code when streaming download without … 

    …using speed limiter.

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b72c87c View commit details
    Browse the repository at this point in the history

  3. because the "pausing" state was added, some codes were restored 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    1656da6 View commit details
    Browse the repository at this point in the history

  4. fixed a bug where speed limiting didn't work when streaming downloads 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    0674c97 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Merge branch 'dev/exp' into streamdownload 

    Signed-off-by: OsakaRuma <[email protected]>

# Conflicts:
#	src/Starward/Services/Download/InstallGameService.cs
    @iamscottxu
    iamscottxu committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    533129e View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Optimized the update logic during streaming download. First download … 

    …the list of files to be deleted, delete the files in the list, then download the files to a temporary folder, and finally move the files.

Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    e698cb1 View commit details
    Browse the repository at this point in the history

  2. removed redundant dependencies 

    Signed-off-by: OsakaRuma <[email protected]>
    @iamscottxu
    iamscottxu committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    875520d View commit details
    Browse the repository at this point in the history