Skip to content

Commit

Permalink
Add doc about moving datasets
Browse files Browse the repository at this point in the history
  • Loading branch information
srosset81 committed Oct 24, 2024
1 parent 5dbd36b commit 8d580e7
Show file tree
Hide file tree
Showing 3 changed files with 18 additions and 1 deletion.
1 change: 1 addition & 0 deletions website/docs/triplestore/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,3 +51,4 @@ services:
- [Migrating datasets](migrating-datasets)
- [Compacting datasets](compacting-datasets)
- [Moving datasets](moving-datasets)
11 changes: 11 additions & 0 deletions website/docs/triplestore/moving-datasets.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
title: Moving datasets
---

Fuseki use [sparse files](https://wiki.archlinux.org/title/Sparse_file) to store datasets. Basically it means datasets appear to take more space than what they are really taking.

If you want to move them to another server, you will need to ensure whatever method you use will take this into account, otherwise you may find yourself with 20-30 times more data than you initially had.

For example the `tar` tool has a `-S` option which will look if the files to compress are sparse files and, in that case, only bring into the archive the "real" part of the file. More information [here](https://www.gnu.org/software/tar/manual/html_node/sparse.html).

The `rsync` tool has a similar `-S` option which do the same. More information [here](https://gergap.wordpress.com/2013/08/10/rsync-and-sparse-files/).
7 changes: 6 additions & 1 deletion website/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -175,7 +175,12 @@ module.exports = {
'frontend/list-components',
'frontend/markdown-components'
],
triplestore: ['triplestore/index', 'triplestore/migrating-datasets', 'triplestore/compacting-datasets'],
triplestore: [
'triplestore/index',
'triplestore/migrating-datasets',
'triplestore/compacting-datasets',
'triplestore/moving-datasets'
],
contribute: {
'SemApps core': ['contribute/code', 'contribute/coding-conventions'],
Documentation: ['contribute/documentation', 'contribute/style-guide']
Expand Down

0 comments on commit 8d580e7

Please sign in to comment.