forked from moosefs/moosefs
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathNEWS
2732 lines (1844 loc) · 111 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
This file lists noteworthy changes in MooseFS.
* MooseFS 4.56.5-1 (2024-09-18)
- (cgi) changed links to knobs
* MooseFS 4.56.4-1 (2024-09-11)
- (master) fixed counters for chunks with both arch and trash flags
- (tools) fixed usage string in 'makesnapshot' tool
- (cgi) a lot of small improvements (auto refresh, color themes, etc.)
* MooseFS 4.56.3-1 (2024-08-14)
- (cgi) face lift
* MooseFS 4.56.2-1 (2024-08-13)
- (master) fixed temporarily removing chunkservers on ELECT and DEPUTY states (pro only)
* MooseFS 4.56.1-1 (2024-08-06)
- (man) added moosefs(7) man page
- (all) changed allocation for dynamic structures (makes stupid compilers happy)
- (client) fixed dns mutex issue (usage before init)
* MooseFS 4.56.0-1 (2024-07-10)
- (all) added instance configuration consistency tests (resolver + masters configs - pro only)
* MooseFS 4.55.3-1 (2024-06-24)
- (master+cs+metalogger) added debug infos to masterconn modules
- (mount) added resolver infos to .params
* MooseFS 4.55.2-1 (2024-06-20)
- (master) added log messages whenever a client tries to connect with wrong password or no password
* MooseFS 4.55.1-1 (2024-06-19)
- (master) fixed removing inode record in posix locks in master-follower when last lock is removed
- (master) fixed removing waiting locks on client disconnection (both modules: posix locks and flocks)
- (cli) fixed units in some chart data tables
* MooseFS 4.55.0-1 (2024-06-07)
- (master) added DEPUTY state (pro only)
* MooseFS 4.54.2-1 (2024-05-06)
- (mount) fixed fsname generation (subfolder with leading '/' issue)
* MooseFS 4.54.1-1 (2024-04-26)
- (mount) fixed supplementary groups cache (permission problems with samba)
- (mount) fixed order of options in case of overriding defaults from mfsmount.cfg
* MooseFS 4.54.0-1 (2024-04-04)
- (tools) fixed ignoring partially applied patches (case of entry changed from directory to file etc.)
* MooseFS 4.53.7-1 (2024-04-02)
- (tools) fixed buffer management in multithreaded version of mfspatch
- (tools) fixed job queue closing issue
- (cgi+cli) added detecting master in usurper state
- (tools) added/changed/fixed messages printed by mfspatch
* MooseFS 4.53.6-1 (2024-03-11)
- (master) fixed reporting storage class property "can be fulfilled" in cgi (downgraded redundancy level)
- (tools) printing socket errors to stderr instead of stdout
* MooseFS 4.53.5-1 (2024-03-08)
- (master) fixed memory leak in xattr (only during patch applying)
* MooseFS 4.53.4-1 (2024-02-23)
- (tools) added patch position handling to mfspatch tool
- (tools) added to mfspatch ignoring more errors when run in 'force' mode
- (tools) fixed symlink content test
* MooseFS 4.53.3-1 (2024-02-19)
- (tools) added multithreaded version of mfspatch tool
- (master) fixed applying 'ADDATTR' changelog
- (tools) fixed time printer in new time parser
* MooseFS 4.53.2-1 (2024-02-13)
- (tools) added reporting progress on signal in mfspatch tool
* MooseFS 4.53.1-1 (2024-02-09)
- (tools) added support for hardlinks in mfspatch tool
- (master) fixed parsing (min/max)trashretention in exports.cfg and added new time parser
* MooseFS 4.53.0-1 (2024-01-10)
- (master+tools+cgi+cli) added labels_mode overrides for all label expressions
- (master) added csipmap.cfg with non regular IP mappings for chunkservers
- (master) added support for strict/std modes in all EC cases
* MooseFS 4.52.1-1 (2023-11-30)
- (master) added support for STRICT and STANDARD label modes in EC
- (master) added special case of modification EC chunk in STRICT mode with no valid chunkservers for copies
* MooseFS 4.52.0-1 (2023-11-15)
- (all) removed 'supervisor' package (mfssupervisor added to master package)
- (supervisor) added mfssupervisor with limited functionality to community edition
- (cgi) use all charts in master chart comparison table
- (master) fixed times in root node in new mfs instances
* MooseFS 4.51.1-1 (2023-11-02)
- (master) added protection against loading chunks or nodes with the same id
- (cgi) added protections against javascript injection
* MooseFS 4.51.0-1 (2023-10-08)
- (all) added dynamic default grace period in quotas
- (tools) added usage percents to quota tool
- (all) added human friendly way of defining time periods in configs
- (mount) added changing working directory to root ('/') when the process daemonizes
- (tools) fixed time related conversions
- (bdev) fixed unmap protocol
- (mount) added displaying ctime in attribute list
* MooseFS 4.50.0-1 (2023-08-14)
- (all) removed library and prepared pro/ce versions the way it was in MFS 3.x
* MooseFS 4.49.0-1 (2023-07-26)
- (master) added trashflag fixing
* MooseFS 4.48.1-1 (2023-07-21)
- (master) fixed trashflag handling for snapshoted chunks (bug intr. in 4.46.0)
* MooseFS 4.48.0-1 (2023-05-29)
- (client) fixed "invalid" region sent by clients in "writeend" packet (bug intr. in 4.40.1)
- (master) ignoring "invalid" regions sent by bugged clients (versions < 4.48.0)
- (master+client) added "invalidation offset" to "chunk has changed" packet
* MooseFS 4.47.1-1 (2023-04-25)
- (cs) added condition for minimal chunks to local rebalance (avoid moving chunks between servers when there are very small number of chunks)
* MooseFS 4.47.0-1 (2023-04-19)
- (all) added 'per chunk mode' to storage classes - arch bit set using chunk modification time
- (tools) added displaying chunk mtime to 'fileinfo'
- (master) do not take into account invalid chunks and chunks with wrong versions in 'mfscheckfile'
- (tools) fixed retrieving path and checksum in case of chunks with wrong version
- (master) fixed calculating disconnected servers in chunkserver chart
- (cs) added limit for hdd path length (PATH_MAX-100)
- (all) changed 'fgets' to 'getline'
* MooseFS 4.46.1-1 (2023-04-03)
- (master) added changelog reservation for delayed follower (pro only)
- (master) moved chunk priority enqueue in case of local-split from 'sending request' to 'status received'
- (master) fixed condition for chunks locked to future date
- (master) changed order of cases in do_jobs
* MooseFS 4.46.0-1 (2023-03-21)
- (master) added sclasses and fcounts to chunk records (file<->chunk connecting no longer needed after metadata loading)
- (master) changed fcounts data structure (8 bytes saved per chunk), also fixed memory leak in previous data structures
- (master) fixed timeout during metadata transfer caused by waiting for socket closing (intr. in 4.45.3)
* MooseFS 4.45.3-1 (2023-03-07)
- (cli) fixed defaults for classid in matrix
- (master) added waiting for socket closing after metadata sending
* MooseFS 4.45.2-1 (2023-02-17)
- (master) always try to fix the undergoal status of chunk before writing data
- (cs) fixed checksum sparsification in local-split operation
- (master) fixed chunk job exit reasons ("info" report)
- (master) fixed double locks in new replication data structure (intr. in 4.45.0)
- (master) fixed status returned by undergoal_replicate in case of replication error
- (master) fixed deciding if undergoal chunk can be fixed
- (master) moved setting of chunk operation to inline function
- (all) prepared set of function for debugging
- (master) fixed a bug in counting number of servers occupied by EC parts of the same chunk
- (master) changed 'reformat' priority name to 'ioready'
- (master) added using bucket allocator for lock replication structure
* MooseFS 4.45.1-1 (2023-02-02)
- (mfsio) added support for password in MD5 format
* MooseFS 4.45.0-1 (2023-01-24)
- (master) added last modification time to each chunk (stored in 'lockedto' field), replication locks moved to separate data structures
* MooseFS 4.44.4-1 (2023-01-19)
- (master) fixed bug in sorting chunkservers during selection for chunk creation
* MooseFS 4.44.3-1 (2023-01-17)
- (tools) added ignoring NOP packets received from chunkserver
* MooseFS 4.44.2-1 (2022-12-21)
- (mfsio) added minimal master version accepted for connection - as an option
* MooseFS 4.44.1-1 (2022-12-16)
- (master+libpro) added check for valid metaid in meta_load function
- (master) fixed termination during metadata save issue (introduced in 4.40.1)
- (cs) changed 'read/write' to 'receive/send' in messages not to confuse network errors with disk errors
* MooseFS 4.44.0-1 (2022-12-06)
- (master+cgi+cli) added filtering chunk matrix by storage class
- (master) fixed chunk matrix counters in chunk_load function
* MooseFS 4.43.2-1 (2022-11-28)
- (master) changed format of chunk job info
* MooseFS 4.43.1-1 (2022-11-15)
- (master) added more detailed chunk job info
* MooseFS 4.43.0-1 (2022-11-08)
- (libpro) added support for long licence format with long JSON string
- (mfsio) fixed Windows issues
- (master) adjusted priority queues algorithm
* MooseFS 4.42.0-1 (2022-09-22)
- (master+cs) added support for getting content of file pointed by config option
- (master) added support for syslog packets (gathering all syslog messages by master)
* MooseFS 4.41.1-1 (2022-09-13)
- (all) verified and unified all messages log levels
- (all) added options to filter messages (min level) and to elevate log levels sent to syslog
* MooseFS 4.41.0-1 (2022-08-26)
- (all) new mfslog module - prepared for keeping all logs centralized
- (master) changed default ATIME_MODE to 2
- (master) fixed atime/mtime/ctime preservation during snapshot (in HA environement upgrade may cause one time desync)
* MooseFS 4.40.4-1 (2022-08-08)
- (mfsio) fixed lookup cache issues
* MooseFS 4.40.3-1 (2022-08-01)
- (all) using SIGUSR1 instead of SIGINFO even on system where SIGINFO is defined
- (mfsio) added using full path lookup with cache
* MooseFS 4.40.2-1 (2022-07-12)
- (master) added process termination when changelog can't be stored locally
* MooseFS 4.40.1-1 (2022-07-08)
- (master+client) added offset and size to "writeend" and "invalidate" packets to minimize invalidated data in cache
- (master+client) added support for "working flags" and added "working cache invalidator" flag
- (master+client) try to keep cache on open when all correct invalidations were performed
- (tools) added support for winattr,eattr,facl and xattrs in patch tool
- (supervisor+master) added support for "fake" metadata save with crc check
- (master) added protection against running background metadata saver twice
- (master) added ignoring scheduled metadata save when forced metadata save is in progress
- (nbd) added option to ignore locks during block device mapping
- (tools) added "small changes" switch to patch tool
* MooseFS 4.40.0-1 (2022-06-10)
- (master) new packet 'set all attributes' (for mfspatch)
- (master) fixed lookup in cases of '.' and '..' (incorrectly set some attributes in answer)
* MooseFS 4.39.3-1 (2022-05-31)
- (tools) fixed status returned by mfspatch tool
- (mount) added invalidate kernel dentry cache in case of snapshot commands
- (master) added acl's and xattr's to 'full_directory' packet (for future use in mfspatch)
- (mfspatch) added setting back atime after data read
* MooseFS 4.39.2-1 (2022-05-25)
- (cs) fixed stalled jobs detection
* MooseFS 4.39.1-1 (2022-05-24)
- (cs) fixed displaying max task times in debug-info file
* MooseFS 4.39.0-1 (2022-05-12)
- (mfsio) split mfsio.c into internal api (used for both - windows client and posix libmfsio) and simple translating layer
- (master) added a safeguard so a regular user cannot create a block and/or character device
- (tools) added support for sockets in mfspatch tool
* MooseFS 4.38.4-1 (2022-05-09)
- (master) added checking condition similar to replication in case of localsplit
- (cs) added reporting delete and replicate commands received from master during registration
* MooseFS 4.38.3-1 (2022-05-04)
- (all) fixed windows compatibility issues in some files
- (common) added support for WSAPoll in portable.h (windows only)
- (common) added support for GetTickCount64" in clocks.h (windows only)
* MooseFS 4.38.2-1 (2022-04-27)
- (cs) added truncated chunks detector
* MooseFS 4.38.1-1 (2022-04-25)
- (tools) added retry after failure (connection with mount/master)
* MooseFS 4.38.0-1 (2022-04-21)
- (tools) added new 'patch' tool for remote backups
* MooseFS 4.37.6-1 (2022-04-07)
- (metatools) added option to load chunk identifiers from file to mfsmetasearch
* MooseFS 4.37.5-1 (2022-03-29)
- (cli) fixed handling table with disconnected chunkservers
* MooseFS 4.37.4-1 (2022-03-24)
- (tools) fixed removing acl in mfssetfacl (anding group with mask)
- (tools) fixed parser in mfssetfacl (username without 'user:')
* MooseFS 4.37.3-1 (2022-03-22)
- (man) updated manpages for all tools
- (tools) fixed acl_spec parser (protection against users named 'user','group' etc.)
* MooseFS 4.37.2-1 (2022-03-15)
- (mount) removed forcing direct mode when file has beed opened with O_APPEND (cache problems reported on Linux)
- (mount) added logging offset changes when data is appended
* MooseFS 4.37.1-1 (2022-03-08)
- (master) reduce function stack frame usage (slow down due to use -fstack-clash-protection by some OS'es)
- (master) fixed file mode in changelog (problem with mask when parent has default acl's)
- (tools) refactoring in all tools
* MooseFS 4.37.0-1 (2022-01-25)
- (master,cs,cgi+cli) separate high speed rebalance status from classic overloaded status
- (master,cgi+cli) added follower delay chart (pro only)
- (tools) added 'import' subcommand for mfsscadmin
- (netdump) added displaying command length
- (mount) increased acceptable answer size in master proxy (needed for trash tools)
- (cs) removed chunk creations and deletions requested by replicator from corresponding charts
* MooseFS 4.36.5-1 (2022-01-13)
- (cs) added background attributes scan (reload + storage limit)
- (cgi) added exit after CS section when there are no active masters
- (master) when chunk has both bits ARCH and TRASH set then system will use TRASH class (if defined) first and then ARCH (if defined)
* MooseFS 4.36.4-1 (2021-12-20)
- (cs) added to mfschunkdbdump support for new chunkdb format (intr. in 4.36.3)
- (master) fixed reporting partial ec as wrong version
- (freebsd) added mfschunkdbdump with manpage to plist file
* MooseFS 4.36.3-1 (2021-12-16)
- (cs) added 'shared' mode for each hdd with optional available space limit (size or percent)
- (master) wait with next replication when previous returned status 'time out'
- (cs) changed calculation of estimated disk usage (using real disk usage from 'stat' instead of file length)
- (cs) added 'percent' limit modes for hard drives
* MooseFS 4.36.2-1 (2021-11-23)
- (master) fixed handling writecounter on NOTDONE status
- (cgi) fixed compatiblity with MFS 3.0 issue
- (cs) added timeout to replicator (const 150 seconds) with progress check
- (all) changed trashtime to trashretention in code, manpages etc.
* MooseFS 4.36.1-1 (2021-11-17)
- (cs) fixed NOP handling during write to chunk
- (mount) increased waiting time for write finish
- (cs) added option to switch between mmap and malloc (default set to malloc)
- (client) removed using mmap for master buffer allocations
* MooseFS 4.36.0-1 (2021-10-20)
- (master+tools) fixed quick version of mfsfileinfo (support for EC4)
- (man) updated man pages
- (master+cs) added error message when a config file can't be loaded (issue #457)
- (client) fixed invalidating directory cache after 'unlink','rmdir' and 'rename'
- (cs) fixed cond variables leaking
* MooseFS 4.35.1-1 (2021-10-10)
- (libpro) updated API for version 4.35
- (mount) fixed printing version on macos
* MooseFS 4.35.0-1 (2021-09-28)
- (master+cli+cgi) added info about maintenance mode with timeout (how many seconds left)
- (cs) added stalled jobs detection
- (cs) added more jobs info to report (avg job time,max job time etc.)
- (master) reduced number of copies that will be cleaned up on each call after chunkserver disconnection
* MooseFS 4.34.2-1 (2021-09-23)
- (master) fixed state switching (made DUMMY the final state - pro only)
- (cli) added chart data type 'all' - alias to all charts (master and chunkserver)
- (cli) when in chunkserver data host and port are not specified then all available chunkservers will be used
* MooseFS 4.34.1-1 (2021-09-22)
- (master) added job exit reasons to info file
- (master) fixed failed jobs algorithm (rebalance stalled when there were low rebalance probability)
* MooseFS 4.34.0-1 (2021-08-27)
- (master) made chunks always readable after 'mfsfilerepair' (will return zeros when chunks are missing)
- (master) fixed logical error (master without metadata could become ELECT and then LEADER which leaded to segfault)
- (all) new feature: minimum file length needed for being moved from KEEP to ARCH mode in storage class
* MooseFS 4.33.2-1 (2021-08-20)
- (cs+master) removed register protocols compatible with pre 2.0 versions
* MooseFS 4.33.1-1 (2021-08-16)
- (cs) fixed crc data in info packets (*_CHUNK_CHECKSUM,*_CHUNK_CHECKSUM_TAB,*_CHUNK_INFO)
- (mount) added nop packets to master proxy (fixed 'query error' on long requests from tools)
- (metasearch) fixed parsing hex numbers with letters
- (master) added changelog after automatic version fix in 'chunk_do_jobs'
- (master) added doing extra chunk job when chunk is removed from delay queue
* MooseFS 4.33.0-1 (2021-08-10)
- (cs+cgi) added clearing last hdd errors in chunkservers
- (cli) added JSON output (pull request by Aleksander Wieliczko)
* MooseFS 4.32.1-1 (2021-07-16)
- (cgi) fixed using '&' in javascript URLs (issue #439)
- (cs) added tracking of busy chunks (don't send chunk status when chunk is busy)
- (master) removed tracking of busy chunks
- (master) added chunk deletion delay after replication (mainly during EC<->COPY conversion)
- (master) fixed emergency save in master-follower
- (cgi) added tooltips to charts
- (master) always return MFS_ERROR_EAGAIN when number of valid copies is zero but goal equivalent is higher than zero
- (master+cs) fixed overflows in old charts (only for 3.x cgi compatibility)
- (cgiserv) fixed error/redirect responses (pull request for 3.x by Eronana)
* MooseFS 4.32.0-1 (2021-06-29)
- (metatools) new tool 'mfsmetasearch'
- (cs+master) added to LOAD packet info about disk scanning and removals
- (master) never use registering chunkserver as a destination place for replication (potential race between replication and chunk registration)
- (master) do not check files when system is during chunkserver disconnections, registration etc.
- (cs) reduce number of chunks per packet sent by chunkserver during registration (avoid master clog)
- (master) kill meta store process after becoming leader
- (master+cs) prepare system for integrity testing between master and chunkserver
- (master) fixed handling copy sgid for directories on follower and during restore from changelog
- (master+supervisor) added option to force metadata store (pro only feature)
- (charts) fixed leap years calculation for years that are multiples of 400
- (master) fixed changelog order between unlock and close file or session
- (master) removing good chunks from list of missing chunks sent to cli/cgi
- (master+cs) changed packet for access to nonexistent chunk (from "chunk lost" to "chunk doesn't exist" - prevents turning off replications)
- (client) added limit for sustained parents that can be stored
- (master) fixed handling licence quotas (pro only feature)
* MosseFS 4.31.9-1 (2021-06-04)
- (master) fixed changelog rotation (intr. in 4.31.1)
* MooseFS 4.31.8-1 (2021-05-10)
- (master) take into account parts on the same servers in redundancy level calculations (for example - do not remove copies when all parts are still on the same server after split)
- (cs) force fsync and close after replication
* MooseFS 4.31.7-1 (2021-04-27)
- (master) fixed redundancy level calculating algorithm (intr. in 4.31.5)
- (master) fixed localsplit missing part mask
- (master) fixed restore mode (missing cache initialization - issue #432)
- (master) fixed version sent in chunk deletion (INVALID and WVER chunks)
* MooseFS 4.31.6-1 (2021-04-23)
- (master) removed redundancy level fixes from loop (loop uses different algorithm, so can't fix counters)
- (master) changed rebalance replication from low-priority to high-priority (avoid race between rebalance and other replications)
- (master) changed chunkserver connection info dumped on INFO/USR1 signal
* MooseFS 4.31.5-1 (2021-04-20)
- (cgi) added chart color keys
- (mount) fixed mfsmount freeze on OSX (secondary groups handling on 'access')
- (mount) removed OSX defines workaround (no longer needed)
- (master) fixed default paths for exports.cfg and topology.cfg
- (master) split fail limits into undergoals/overgoals/wronglabels
- (master) changed redundancy level calculating algorithm (take into account duplicated parts on the same server)
* MooseFS 4.31.4-1 (2021-04-07)
- (cs) fixed reconnecting in replicator (intr. in 4.29.2)
- (master) added experimental job limiting options
* MooseFS 4.31.3-1 (2021-04-02)
- (master) added replication/deletion info (INFO/USR1 signal)
- (master) reducing CPU usage in chunk loops (fail limit per class)
* MooseFS 4.31.2-1 (2021-03-30)
- (master) stop taking into account chunks with one copy and goal one as endangered in master charts
- (cgi) fixed printing values in javascript charts
- (all) fixed dumping current config values on INFO/USR1 signal
* MooseFS 4.31.1-1 (2021-03-26)
- (master) added METADATA_SAVE_OFFSET option
- (master) added limits per storage class for chunk jobs
* MooseFS 4.31.0-1 (2021-03-24)
- (master+cs+cgi) new client-side charts with new options
- (cs) added assertions for pthread functions in mainserv module
* MooseFS 4.30.2-1 (2021-03-08)
- (libpro) fixed changing error number to string
* MooseFS 4.30.1-1 (2021-03-05)
- (all) added support for dangerous options
- (cs) added timeout for replicator
- (master+cs) added support for new charts (new CHARTS_DATA packet)
* MooseFS 4.30.0-1 (2021-02-16)
- (master+cs) added way to first register chunks that are needed for I/O operations
* MooseFS 4.29.2-1 (2021-02-15)
- (cs) added deleting duplicates whenever original chunk is modified or deleted
- (cs) added reconnecting ability to replicator
* MooseFS 4.29.1-1 (2021-02-10)
- (master) added inode virtual length for append mode
- (mount) moved rwlock from descriptor to inode (fixes append issues)
- (cli+cgi) added "Marked for removal" filter to "Disks"
- (cgi) changed method of charts selection in charts comparison
- (cgi) added using htmlentities function for various strings
- (mount) added parents of CWD's to 'sustained' inodes (workaround for FreeBSD problem - issue #362)
* MooseFS 4.29.0-1 (2021-01-20)
- (master) added support for total quota
- (cgi+cli) added message before printing stacktrace on exception
- (master+cgi+cli) added new licence file format (licences with string types)
* MooseFS 4.28.2-1 (2021-01-15)
- (master) fixed reference time used to synchronize lockto field between masters (intr. in 4.25.0)
- (master) fixed handling disconnection of chunkserver with pending localsplit operations (metadata desync - CHNK part)
* MooseFS 4.28.1-1 (2021-01-11)
- (all) fixed timeout handling in socket library
* MooseFS 4.28.0-1 (2020-12-28)
- (mount) added symlink cache timeout
- (master) added option to define inode reuse delay
- (master+tools) erasing chunk during mfsfilerepair is optional now (new flag '-d')
* MooseFS 4.27.1-1 (2020-12-23)
- (master) fixed chunk timeout issue (take into account localsplit operation)
* MooseFS 4.27.0-1 (2020-12-04)
- (cs) added space and chunks charts
- (cs) added checking access to all folders before scan
- (master+cs) new charts
- (master) new session stats
- (master+client) sending form client to master true number of read/write/fsync operations
- (master+cgi+cli) new licence data
* MooseFS 4.26.10-1 (2020-12-02)
- (nbd+mfsio) added options to configure mfs parameters in block device
* MooseFS 4.26.9-1 (2020-12-01)
- (master+cgi) added support for labels mode (STRICT,STD,LOOSE) in all copy-like modes (in KEEP,ARCH and TRASH)
- (master) fixed rebalance argorithm (import fix from 3.x)
- (master) added support for CHUNK_UNIQ_MODE (3.x compatibility) - force IP or RACK uniqueness in all classes
* MooseFS 4.26.8-1 (2020-11-16)
- (master) servers in 'rebalance' state are now allowed to be used in replication
- (master) unified conditions for conversions COPY<->EC
* MooseFS 4.26.7-1 (2020-11-13)
- (master) added option for restricting incompatible clients
- (master) added simple fulfillment calculation for EC classes
* MooseFS 4.26.6-1 (2020-11-10)
- (master) added protection against listing too big directory
* MooseFS 4.26.5-1 (2020-11-06)
- (master) fixed EC data being sent for 'mfsscadmin list' command
- (tools) skipped displaying arch delay when arch mode is set to FAST
- (tools) improved check for archive time options (scadmin -o)
- (master) fixed some scenarios in 'do_jobs' and 'calculate_endanger_priority' functions
* MooseFS 4.26.4-1 (2020-11-05)
- (master) fixed ec4 chunk matrix data sent to cgi
* MooseFS 4.26.3-1 (2020-11-04)
- (master+cgi) added displaying unmapped IP in chunkserver list, also fixed manipulating remapped chunkservers
- (master) fixed serious HA issue introduced in 4.24.0
* MooseFS 4.26.2-1 (2020-11-02)
- (master+cgi) split EC table into EC8 and EC4 tables
* MooseFS 4.26.1-1 (2020-10-29)
- (nbd) added support for config with initial mappings
- (nbd) added support for user defined block sizes (although it seems that kernel supports only 512,1024,2048 and 4096)
* MooseFS 4.26.0-1 (2020-10-28)
- (master) implementation of EC 4+n
* MooseFS 4.25.0-1 (2020-10-19)
- (master) fixed timestamp using to clear locks in chunks section of metadata file
* MooseFS 4.24.2-1 (2020-10-16)
- (master) fixed handling 'marked for removal' EC parts
* MooseFS 4.24.1-1 (2020-10-09)
- (master) added ignoring empty filenames
- (master+cs) added protections against accidentally running a pro installation without pro features on
- (master) fixed chunk copies counters overflow
- (client) prepared for 4+N EC mode
- (cs) prepared localsplit for 4+N EC mode
* MooseFS 4.24.0-1 (2020-09-23)
- (nbd) fixed nbd listing
- (pro) moved pro features to dynamically downloadable library
- (cs) removed condition that caused chunks to be forever locked
- (cs) added timeout in waiting for locked chunks
- (all) changed to hex all chunkid logged to syslog (only in changelog it is left in decimal format)
- (cs) changed port number from hex to dec in replicator module
- (master) fixed scenario with not enough servers and parts on servers marked for removal
- (mount) added printing open/create mode to the oplog
- (mount) fixed opening file after using lookup cache
* MooseFS 4.23.5-1 (2020-07-27)
- (nbd) fixed packet size
- (nbd) added chdir("/")
- (cgiserv) added chdir("/")
* MooseFS 4.23.4-1 (2020-07-22)
- (tools,man) fixed facl tools and manpages
* MooseFS 4.23.3-1 (2020-07-14)
- (all) fixed memory leak in new logger (intr. in 4.23.0)
* MooseFS 4.23.2-1 (2020-07-01)
- (mount+master) fixed handling keepcache and direct flags (related to issue #374)
- (cgi) changed time format (issue #197)
- (cs) added logging info when '.chunkdb' is not written to disk
- (master) fixed alphabetical order of commands detected in changelog
- (tools) fixed small issues in trash management tools
* MooseFS 4.23.1-1 (2020-06-22)
- (tools) fixed mfsacl tools
- (tools) added trash management tools
* MooseFS 4.23.0-1 (2020-06-17)
- (master) optimized reaction to status NOTDONE received from chunkserver
- (cs) changed queue limit to max workers (limited dynamically)
- (master) fixed treating chunk delete status
* MooseFS 4.22.2-1 (2020-05-26)
- (cs) fixed deadlock condition on mutexes 'folderlock' and 'hashlock' (exists since 4.20.3)
* MooseFS 4.22.1-1 (2020-05-25)
- (mount) fixed trunacting files open with O_APPEND flag (bug itntr. in 4.22.0, issue #368)
- (cs) added disk rebalance when all designated source disks are already empty (issue #364)
- (mount) added additional info to '.params' file (versions of mfs,libfuse itp.)
- (master+cs) added check against EACCES after lockf (according to Linux man - such stupid error can be returned here - issue #369)
- (master) fixed access checks in snapshot
- (tools) fixes in trashtools
* MooseFS 4.22.0-1 (2020-05-05)
- (master+client) added support for new eattrs: immutable,appendonly,undeletable
- (master) moved multilan management to separate source file
- (master) fixed using multilan in leaderip mapping
- (master) added using multilan mapping in chunkserver list (available in cli/cgi)
* MooseFS 4.21.8-1 (2020-05-04)
- (nbd) added readonly mode and locking
- (cs) fixed condition in choosing disks for internal rebalance
- (mount) added workaround in access for a bug in FreeBSD kernel (issue #354)
- (cs) fixed master reconnection conditions (reload usually shouldn't cause reconnection)
- (master) changed disk removal detection algorithm (issue #356)
- (cs) fixed calculating size limits
- (cs) added handling inode limits in local filesystems on chunkservers (issue #358)
- (master) added topology grouping when new chunks are about to be created (prefer closer servers)
- (master) added more error messages to bgsaver
- (cs) added changing subfolder during internal rebalance (related to issue #326)
- (mount) turn off dentry invalidator for Linux kernels >= 4.19 (related to issue #357)
- (master) changed condition that checks timestamp in changelogs (less prone to small clock differences)
- (cgi+cli) changed mark for removal state name UNKNOWN->PENDING (related to issue #359)
- (client) decreased max IDLE time in writer module from 1s to 0.1s
- (client) update inode in dentry invalidator
- (master) fixed trash recover (privileges, bug in nonexistent path elements)
- (client) silenced "kern.proc.filedesc" syslog messages on FreeBSD (issue #360)
* MooseFS 4.21.7-1 (2020-03-27)
- (master) changed condition that decides if master should wait for more chunks during I/O
- (mount) delayed setting channel for fuse notifications (very rare segfault in libfuse2 during init)
- (client+master) changed conditions for ancestor test in getattr (issue #350)
- (cs) added parameter for number of chunks to be send in single regiter packet
- (cs) fixed reporting damaged chunks in testing function (issue #352)
- (client) changed open test in setattr (related to issue #350)
- (master) fixed handling truncate for open files (related to issue #350)
- (master) added uid mapping in setfacl function
- (master+client) fixed keep cache conditions
- (cs) introduced official label format defined in chunkserver configuration
* MooseFS 4.21.6-1 (2020-03-24)
- (master) added protection between neverending desyncing between newer LEADER and older FOLLOWER
- (master) fixed slices with 'to' set to 0 in mfsappendchunks
- (man) fixed typo in mfsappendchunks man page
* MooseFS 4.21.5-1 (2020-03-23)
- (cs) when chunk can't be located always send to master info about lost chunk
- (supervisor,master,cs) fixed buffer overrun in mastersupervisor code (intr. 4.17.0)
- (master) changed algorithm of reusing csid in chunk module (adding released csid to the end of free list)
- (master) fixed segfault during appending chunks of file with positive length and no chunks
* MooseFS 4.21.4-1 (2020-03-20)
- (master) fixed memory leaks in xattr and posixacl modules
- (master) fixed checking disable flags in mfsrmsnapshot (UNLINK+RMDIR instead of SNAPSHOT)
* MooseFS 4.21.3-1 (2020-03-19)
- (client) fixed deadlock in dentry invalidator
* MooseFS 4.21.2-1 (2020-03-12)
- (client) added dentry invalidator (needed in Linux with kernel < 4.19 - EBUSY bug)
* MooseFS 4.21.1-1 (2020-03-06)
- (all) added support for multiple ip/hostnames separated by colon or semicolon for masterhost definitions
- (all) added protection against ip duplicates in master resolver
- (master) fixed for reading data during cleanup after chunkserver disconnection
* MooseFS 4.21.0-1 (2020-03-02)
- (master,cgi+cli) added support for disabling individual filesystem commands in exports
- (client) added handling read/write/readdir disables on client side (better error messages)
- (client) added session parameters to '.params' file
* MooseFS 4.20.6-1 (2020-02-26)
- (master) introduced replication limits for 'reformat priority'
- (cs) silence stupid compiler warning
- (client) fixed handling LOCKED and EAGAIN status in readdata
* MooseFS 4.20.5-1 (2020-02-17)
- (cs) added protections against segfaults (issue #342)
* MooseFS 4.20.4-1 (2020-02-13)
- (cs) changed allocation of duplicated chunks from malloc to mmap, decreased memory usage by duplicates
- (client) reading in O_WRONLY no longer causes EACCES (might be related to issue #334)
- (metadump) printing dots for non-printable characters made optional (issue #332)
* MooseFS 4.20.3-1 (2020-01-27)
- (cs) fixed bug that may lead to creating much more chunks in one subfolder (issues #319,#326)
- (cs) added option for controlling subdirectory selection algorithm for newly created chunks (issues #319,#326)
- (cs) prevent potential dumping deleted chunks to 'chunk.db'
- (client) added options for setting behaviour when master returns unavailable chunks or no space status (issue #322)
- (cgi) fixed logo and icon (file type for favicon.ico, change to current logotype - issue #328)
- (master) turning off sending NOP's to unregistered clients and supervisors (matoml module)
- (cs) fixed reporting wrong number of hours in duplications removal message
- (master) fixed reading scenario in EC mode with missing data parts
- (cs) redesigned duplicates removal procedure to do it in groups of 100 files (issue #327)
- (cs) introduce mypread and mypwrite macro (code cleaning)
- (cs) added check for changed crc before every chunk file close (just in case)
- (cs) never use open chunk as a chunk duplicate that needs to be deleted
- (cs) never use disk with pending duplicates as destination disk during internal rebalace (issue #327)
- (cs) fixed condition in internal rebalance procedure (issue #327)
- (cs) added option for setting duplicates retention time in hours (issue #333)
- (cs) fixed memory leak in removing disk with duplicates
- (cs) removed unnecessary attribute reading when chunk duplicates are detected (issue #327)
* MooseFS 4.20.2-1 (2019-12-17)
- (master) fixed TRASH_RECOVER not moving file from trash to normal space
- (master+cs+supervisor) fixed using NOP packets (HA not working with long connections to masters)
* MooseFS 4.20.1-1 (2019-12-16)
- (master) fixed LEADER-FOLLOWER desync case related to archive flag not set for missing chunks in the LEADER
* MooseFS 4.20.0-1 (2019-12-10)
- (master) added glob patterns to trash list and sustained list
* MooseFS 4.19.0-1 (2019-12-03)
- (master) fixed interpreting MOVE changelog (NEXTSEPARATOR macro)
* MooseFS 4.18.7-1 (2019-11-26)
- (cs) added allowance for starting with invalid entries in 'mfshdd.cfg'
* MooseFS 4.18.6-1 (2019-11-21)
- (mfscgiserv) fixed handling redirects (bug intr in 4.18.3)
* MooseFS 4.18.5-1 (2019-11-20)
- (master) fixed missing handling FORCE_TIMEOUT packet
* MooseFS 4.18.4-1 (2019-11-19)
- (master) fixed rmdir packet size
* MooseFS 4.18.3-1 (2019-11-18)
- (master) fixed sign in reporting time difference
- (cgiserv) added 'content-type: text/plain' to cgi outputs with errors
- (cs) fixed memory leak in local-split operation
* MooseFS 4.18.2-1 (2019-11-05)
- (freebsd) detecting new fuse version in the kernel and adjusting behaviour
* MooseFS 4.18.1-1 (2019-10-30)
- (mount+master) fixed few small issues related to POSIX compliance (checked by pjd)
- (freebsd) fixed compatibility with libfuse3 on FreeBSD
* MooseFS 4.18.0-1 (2019-10-22)
- (mount,master) added support for EXCHANGE abd NOREPLACE flags for move/rename
- (mount,master) added support for O_TRUNC flag for open
- (mount) added support for readdirplus (related to issue #302)
- (mount) workaround for bug in fuse (wrong lock_owner in flush - issue #305)
- (mount) fixed deadlock in readdata.c (closes issue #306)
- (all) changed preferred C standard from C99 to C11 and added tests for atomics
- (mount) move read/write structures initialization from open to read/write
- (mount,mfsio) added new inode->fleng map
- (configure) added option disable_all, added summary at the end
* MooseFS 4.17.5-1 (2019-10-02)
- (mount) added support for libfuse3 (related to issue #302)
* MooseFS 4.17.4-1 (2019-09-23)
- (master) added support for multiple lans
- (master) fixed length of empty directories (1 instead of 0)
* MooseFS 4.17.3-1 (2019-09-18)
- (cs) added info logs to bgjobs module (tasks summary)
* MooseFS 4.17.2-1 (2019-09-17)
- (cs) experimental version with unlimited queue
* MooseFS 4.17.1-1 (2019-09-10)
- (cs) fixed NOP packets ping-pong
- (client) fixed NOP flooding in write module
- (cs) fixed race condition in bgjobs module (jobhash)
- (cs+mount) added new status returned to mount when queue is full and support for it in client module
* MooseFS 4.17.0-1 (2019-08-28)
- (master) added NOP command to changelog
- (master+supervisor) added time check
- (cs) fixed behaviour when job queue is full
- (cli+cgi) added time data to master servers
* MooseFS 4.16.3-1 (2019-08-27)
- (master) take write replication counters into account in server ordering for new chunk creations
- (master) changed calculating replication limits in chunk rebalance procedure (using actual usage difference)
* MooseFS 4.16.2-1 (2019-08-20)
- (master+cgi/cli) added syncstate 'INIT'
* MooseFS 4.16.1-1 (2019-08-19)
- (master) added 'restore' run mode (works similar to 'mfsmaster -a' but without running daemon)
* MooseFS 4.16.0-1 (2019-08-14)
- (master) added check if the background saving process is alive
- (master) added lockfile for background saving process
- (master) added protection against time going back in the free inodes list
- (master) added protection in FOLLOWER against not keeping up with the LEADER
- (master) changed condition for removing chunk from data structures (all chunkservers have to be connected)
* MooseFS 4.15.0-1 (2019-07-08)
- (master) added 'userfiles' and 'matchedfiles' to TRASH_LIST and SUSTAINED_LIST returned packets
- (master) fixed LEADER/FOLLOWER desync on SETCHUNK command
- (cli+cgi) fixed shebang in python scripts (preference for python3 in configure)
- (master) better hard links handling
- (master) added limit for number of hardlinks allowed for one object
- (master) added option for automatic removal of unused chunkservers (issue #247)
- (metadirinfo) fixed segfault when output filename is not specified
- (chunktool) added file name fixing option (issue #276)
- (all) changed chunk replication and deletion charts into two color charts (successful/unsuccessful - issue #273)
- (all) added new charts with number of chunk creations and interna changes (also successful and unsuccessful)
- (master) added ignoring chunk with id zero sent from chunkserver
- (metadump) added option for dumping parts of metadata
- (master) added more logs to background data write subprocess (connected with issue #280)
* MooseFS 4.14.1-1 (2019-05-23)
- (cs) added reporting socket error when poll returns POLLERR
- (cli) fixed 'free space' in plain mode
* MooseFS 4.14.0-1 (2019-05-14)
- (cs) new split operation
- (master) using new split operation
- (master) added lookup for paths (for future use)
* MooseFS 4.13.4-1 (2019-05-06)
- (nbd) added option for specifying subfolder on MFS for block devices (issue #252)
* MooseFS 4.13.3-1 (2019-04-12)
- (nbd) fixed segfault when filename not specified
- (client) fixed size of waiting threads counter (very rare deadlock in write module)
- (cli) fixed status returned in case of master name that can't be resolved (issue #238)
- (netdump) fixed using deprecated function pcap_lookupdev
* MooseFS 4.13.2-1 (2019-04-03)
- (master) fixed labels in EC mode