Hyper-V Backup jobs failing with an error “The system cannot find the file specified” – Veeam Backup & Replication 9.5 Update 4

We have recently upgraded the Veeam Backup & Replication to version  9.5 Update 4 and we got trouble on backing windows 2012 Hyper-V cluster VMs.The error was related “application-aware processing may fail with the error “The system cannot find the file specified”.”

Error

Processing “VMName” Error: The system cannot find the file specified. Failed to open file [\\?\GLOBALROOT\Device\CSV{e72144ea-ef3e-475b-88b9-733771799784}\VMNAME\Snapshots\F68A0FFE-F6AC-4605-9B55-B80DB89098B3.xml] in readonly mode. Failed to open file [\\?\GLOBALROOT\Device\CSV{e72144ea-ef3e-475b-88b9-733771799784}\VMNAME\Snapshots\F68A0FFE-F6AC-4605-9B55-B80DB89098B3.xml] for reading.

Cause

This issue is caused by the snapshot path in the VM ‘s configuration being different from the actual path on a file system in terms of symbols capitalization. You can confirm this by comparing paths in bold in the Task.<VM NAME>.<VM UUID>.log file:

[22.01.2019 19:39:09] <28> Info                   [AP] (65e8) output:     <snapshots>
[22.01.2019 19:39:09] <28> Info                   [AP] (65e8) output:       <data_root type=”string”>C:\Temp\<VM name></data_root>
[22.01.2019 19:39:09] <28> Info                   [AP] (65e8) output:       <list>
[22.01.2019 19:39:09] <28> Info                   [AP] (65e8) output:         <size type=”integer”>0</size>
[22.01.2019 19:39:09] <28> Info                   [AP] (65e8) output:       </list>
[22.01.2019 19:39:09] <28> Info                   [AP] (65e8) output:     </snapshots>

[22.01.2019 19:39:09] <11> Info [AP] (65e8) command: ‘file2text\n\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy16\temp\<VM NAME>\Snapshots\<VM UUID>.xml\n2097152\n’
[22.01.2019 19:39:10] <10> Info [ReconnectableSocket] Stop confirmation was sent on [c1d84e94-b09b-4039-a8dc-4973e12934fc].
[22.01.2019 19:39:10] <23> Error [AP] (65e8) error: The system cannot find the file specified.
[22.01.2019 19:39:10] <23> Error Failed to open file [\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy16\temp\<VM NAME>\Snapshots\<VM UUID>.xml] in readonly mode.

Solution

There are two methods for correcting this issue depending on your preference:

Change the snapshot path in VM configuration manually

  • Connect to the Hyper-V host and go to VM Configuration of VM in question
  • Go to Checkpoints tab and choose ‘Browse…’ underneath the snapshot path
  • Update the path.

Install a hotfix for Veeam Backup & Replication 9.5 Update 4 (build 9.5.4.2615):

Download

N0te:- Ensure that all jobs are in a stopped state before procceding this step

  • Stop all services on the Veeam Backup server that begin with Veeam. (PowerShell: gsv Veeam* | spsv )
  • Navigate to the Veeam installation folder on the Veeam Backup Server (by default it is C:\Program Files\Veeam\Backup and Replication\Backup)
  • Rename the Veeam.Backup.Core.dll file to Veeam.Backup.Core.dll_backup
  • Replace the files listed in the previous step with those found in the hotfix package
  • Start Veeam services on Veeam Backup server. (PowerShell: gsv Veeam* | sasv )

Reference

Conclusion

We have followed the steps mentioned on the Veeam KB and the issue fixed.