none
DFS is probably randomly deleting your files. RRS feed

  • General discussion

  • I've been tracking a bug with DFS for about a year now. Randomly DFS will stop replicating certain files with an error code 4406 in the event viewer. It seems to happen only in 2016. If you dig further into it and look at the DFS logs you'll see something like "[WARN] Join::SubmitUpdate Not replicating reparse point that cannot be marshaled." It seems to happen for PDF and Excel files more often than others. If you look at the files they will have 0x620 attributes which means Sparse File, Reparse Point, Archive. The reparse point tag will be 0x80000013 which is IO_REPARSE_TAG_DEDUP. None of this is unusual and there are many files with those attributes that replicate normally. Opening the file, changing something, undoing the change and saving it will solve the issue and the files will be replicated again. If the file is not re-opened with in DFS conflict resolution algorithms timeout the file will be disappear and be moved to the conflictanddeleted folder. 

    Why put this here? Because there are no real avenues to report a bug to MS. They are too big to care. I don't have a work around for the issue other than getting email alerts on 4406 and then opening the file and changing something then undoing it and then saving it. It seems to happen more frequently the longer a server has been up so I also recommend rebooting frequently. Anyway here are my debug DFS-R logs. If you find something out of the ordinary let me know.

    20190918 08:05:50.531 7832 USNC  2618 UsnConsumer::UpdateIdRecord LDB Updating ID Record:
    +	fid                             0x600000000F79C
    +	usn                             0x5fc561948
    +	uidVisible                      1
    +	filtered                        0
    +	journalWrapped                  0
    +	slowRecoverCheck                0
    +	pendingTombstone                0
    +	internalUpdate                  0
    +	dirtyShutdownMismatch           0
    +	meetInstallUpdate               0
    +	meetReanimated                  0
    +	recUpdateTime                   20190917 12:37:08.437 GMT
    +	present                         1
    +	nameConflict                    0
    +	attributes                      0x620
    +	ghostedHeader                   0
    +	data                            0
    +	gvsn                            {FBAFB489-1FC7-4466-9505-E7812C68A131}-v765616
    +	uid                             {FBAFB489-1FC7-4466-9505-E7812C68A131}-v763880
    +	parent                          {CF106D0C-E94A-4595-8260-96A5B1275B32}-v26541
    +	fence                           Default (3)
    +	clockDecrementedInDirtyShutdown 0
    +	clock                           20190918 12:05:50.531 GMT (0x1d56e1969c8ecbd)
    +	createTime                      20190220 21:28:33.358 GMT
    +	csId                            {968DA157-F243-4F5D-919F-D32F30DA67F7}
    +	hash                            00000000-00000000-00000000-00000000
    +	similarity                      00000000-00000000-00000000-00000000
    +	name                            JOBLIST.xls
    +	
    20190918 08:05:50.531 7832 USNC  2621 UsnConsumer::UpdateIdRecord ID record updated from USN_RECORD:
    +	USN_RECORD:
    +	RecordLength:        88
    +	MajorVersion:        2
    +	MinorVersion:        0
    +	FileRefNumber:       0x600000000F79C
    +	ParentFileRefNumber: 0x2000000004F4B
    +	USN:                 0x5fc561948
    +	TimeStamp:           20190918 08:05:50.531 Eastern Standard Time
    +	Reason:              Basic Info Change Close Data Overwrite Reparse Point Change 
    +	SourceInfo:          0x0
    +	SecurityId:          0x0
    +	FileAttributes:      0x620
    +	FileNameLength:      22
    +	FileNameOffset:      60
    +	FileName:            JOBLIST.xls
    +	
    20190918 08:05:50.546 6404 OUTC  2882 OutConnectionContentSetContext::TransportRequestVvUp Received request for VvUp csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{B0B1DBC8-3601-4E8B-A16D-429D9CE9CAF1} rgName:domain.local\dfs\shared  ptr:0000020FC2127FA0
    20190918 08:05:50.546 6404 SRTR  2353 SERVER_RequestVersionVector Sent requested version vector. connId:{B0B1DBC8-3601-4E8B-A16D-429D9CE9CAF1} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} seqNumber:28 requestType:REQUEST_NORMAL_SYNC changeType:all
    20190918 08:05:50.546 8284 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{B0B1DBC8-3601-4E8B-A16D-429D9CE9CAF1}
    20190918 08:05:50.546 8284 OUTC  2882 OutConnectionContentSetContext::TransportRequestVvUp Received request for VvUp csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF} rgName:domain.local\dfs\shared  ptr:0000020FC2127BE0
    20190918 08:05:50.546 8284 SRTR  2353 SERVER_RequestVersionVector Sent requested version vector. connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} seqNumber:25 requestType:REQUEST_NORMAL_SYNC changeType:all
    20190918 08:05:50.546 6404 OUTC  2882 OutConnectionContentSetContext::TransportRequestVvUp Received request for VvUp csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{820A5C3D-8CA4-4DD3-9681-45E4FDA46C8D} rgName:domain.local\dfs\shared  ptr:0000020FC0776800
    20190918 08:05:50.546 6404 SRTR  2353 SERVER_RequestVersionVector Sent requested version vector. connId:{820A5C3D-8CA4-4DD3-9681-45E4FDA46C8D} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} seqNumber:27 requestType:REQUEST_NORMAL_SYNC changeType:all
    20190918 08:05:50.546 6404 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{6A1762D1-F10E-4B7D-8937-485CDED95B2C}
    20190918 08:05:50.562 6404 SRTR  1113 SERVER_RequestUpdates Processing RequestUpdates call. connId:{B0B1DBC8-3601-4E8B-A16D-429D9CE9CAF1} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} credits:32 requestType:all
    20190918 08:05:50.562 6404 OUTC  2814 OutConnectionContentSetContext::TransportRequestUpdates Received request for updates csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{B0B1DBC8-3601-4E8B-A16D-429D9CE9CAF1} rgName:domain.local\dfs\shared  ptr:0000020FC2127FA0
    20190918 08:05:50.562 6404 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{B0B1DBC8-3601-4E8B-A16D-429D9CE9CAF1}
    20190918 08:05:50.562 6404 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF}
    20190918 08:05:50.562 6212 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{820A5C3D-8CA4-4DD3-9681-45E4FDA46C8D}
    20190918 08:05:50.562 6212 OUTC  2882 OutConnectionContentSetContext::TransportRequestVvUp Received request for VvUp csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{6A1762D1-F10E-4B7D-8937-485CDED95B2C} rgName:domain.local\dfs\shared  ptr:0000020FC2127DC0
    20190918 08:05:50.562 6212 SRTR  2353 SERVER_RequestVersionVector Sent requested version vector. connId:{6A1762D1-F10E-4B7D-8937-485CDED95B2C} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} seqNumber:25 requestType:REQUEST_NORMAL_SYNC changeType:all
    20190918 08:05:50.562 6212 SRTR  1113 SERVER_RequestUpdates Processing RequestUpdates call. connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} credits:32 requestType:all
    20190918 08:05:50.562 6404 SRTR  1113 SERVER_RequestUpdates Processing RequestUpdates call. connId:{820A5C3D-8CA4-4DD3-9681-45E4FDA46C8D} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} credits:32 requestType:all
    20190918 08:05:50.562 8284 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{820A5C3D-8CA4-4DD3-9681-45E4FDA46C8D}
    20190918 08:05:50.562 6404 OUTC  2814 OutConnectionContentSetContext::TransportRequestUpdates Received request for updates csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{820A5C3D-8CA4-4DD3-9681-45E4FDA46C8D} rgName:domain.local\dfs\shared  ptr:0000020FC0776800
    20190918 08:05:50.562 6212 OUTC  2814 OutConnectionContentSetContext::TransportRequestUpdates Received request for updates csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF} rgName:domain.local\dfs\shared  ptr:0000020FC2127BE0
    20190918 08:05:50.562 4264 SRTR  2442 SERVER_AsyncPoll Processing AsyncPoll call. connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF}
    20190918 08:05:50.577 6588 JOIN  1104 [WARN] Join::SubmitUpdate Not replicating reparse point that cannot be marshaled. connId:{EBCF5C4A-030B-494C-8D8C-5B048AF63CAF} csId:{968DA157-F243-4F5D-919F-D32F30DA67F7} csName:shared record:
    +	fid                             0x600000000F79C
    +	usn                             0x5fc561948
    +	uidVisible                      1
    +	filtered                        0
    +	journalWrapped                  0
    +	slowRecoverCheck                0
    +	pendingTombstone                0
    +	internalUpdate                  0
    +	dirtyShutdownMismatch           0
    +	meetInstallUpdate               0
    +	meetReanimated                  0
    +	recUpdateTime                   20190918 12:05:50.531 GMT
    +	present                         1
    +	nameConflict                    0
    +	attributes                      0x620
    +	ghostedHeader                   0
    +	data                            0
    +	gvsn                            {FBAFB489-1FC7-4466-9505-E7812C68A131}-v765616
    +	uid                             {FBAFB489-1FC7-4466-9505-E7812C68A131}-v763880
    +	parent                          {CF106D0C-E94A-4595-8260-96A5B1275B32}-v26541
    +	fence                           Default (3)
    +	clockDecrementedInDirtyShutdown 0
    +	clock                           20190918 12:05:50.531 GMT (0x1d56e1969c8ecbd)
    +	createTime                      20190220 21:28:33.358 GMT
    +	csId                            {968DA157-F243-4F5D-919F-D32F30DA67F7}
    +	hash                            00000000-00000000-00000000-00000000
    +	similarity                      00000000-00000000-00000000-00000000
    +	name                            JOBLIST.xls
    +	
    20190918 08:05:50.577 6588 EVNT  1194 EventLog::Report Logging eventId:4406 parameterCount:7
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter1:968DA157-F243-4F5D-919F-D32F30DA67F7
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter2:JOBLIST.xls
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter3:D:\SHARED
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter4:shared
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter5:domain.local\dfs\shared
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter6:4F01BA20-918B-44F0-8A13-5D2B1B65EDF4
    20190918 08:05:50.577 6588 EVNT  1214 EventLog::Report         eventId:4406 parameter7:5B77BDA4-9DB1-48DF-B470-AAF6E649648C
    20190918 08:05:50.577 6588 JOIN  1201 Join::SubmitUpdate LDB Updating ID Record:
    +	fid                             0x600000000F79C
    +	usn                             0x5fc561948
    +	uidVisible                      1
    +	filtered                        0
    +	journalWrapped                  0
    +	slowRecoverCheck                0
    +	pendingTombstone                0
    +	internalUpdate                  0
    +	dirtyShutdownMismatch           0
    +	meetInstallUpdate               0
    +	meetReanimated                  0
    +	recUpdateTime                   20190918 12:05:50.531 GMT
    +	present                         1
    +	nameConflict                    0
    +	attributes                      0x620
    +	ghostedHeader                   0
    +	data                            0
    +	gvsn                            {FBAFB489-1FC7-4466-9505-E7812C68A131}-v765616
    +	uid                             {FBAFB489-1FC7-4466-9505-E7812C68A131}-v763880
    +	parent                          {CF106D0C-E94A-4595-8260-96A5B1275B32}-v26541
    +	fence                           Default (3)
    +	clockDecrementedInDirtyShutdown 0
    +	clock                           20190918 12:05:50.531 GMT (0x1d56e1969c8ecbd)
    +	createTime                      20190220 21:28:33.358 GMT
    +	csId                            {968DA157-F243-4F5D-919F-D32F30DA67F7}
    +	hash                            00000000-00000000-00000000-00000000
    +	similarity                      00000000-00000000-00000000-00000000
    +	name                            JOBLIST.xls
    +	


    Wednesday, September 18, 2019 4:18 PM