none
ROBo copie powershell script based on start and end time and number of objects copied. RRS feed

  • Question

  • HI All,

    As i was new to scripting we are looking for power shell script based on "ROBO copie data need to replicate from one server drive to another server". But here the few conditions to get copied this files.

    @ Based on last time stamp given script need to be executed.

    @In case folder are matches source to destination those need to be skipped and only un matched filed need to be copied into destination. 

    @All this activity need to tracked in log files based on : Script start time & Script end time & number objects copied. 

    I have wrote few but noting was fullfill all these given conditions. once again thank you and Be safe. !!!

    Friday, May 15, 2020 7:57 AM

All replies

  • Please carefully review the following links to set your expectation for posting in technical forums.


    \_(ツ)_/

    Friday, May 15, 2020 10:23 AM

  • As i was new to scripting we are looking for power shell script based on "ROBO copie data need to replicate from one server drive to another server". !

    Why use a script? Just use the robocopy utility. The initial copy may take some time to run. And users may update the source files while the copy is running. On subsequent robocopy runs, use the /mir switch to "mirror" the folders. When you are ready to cut over to the new server, set the share permissions on the source server to readonly so that users cannot change the files and run a final robocopy to get all of the changes. Use the /l switch to get a report from robocopy without actually making any file changes. 


    C:\>robocopy /?
    -------------------------------------------------------------------------------
       ROBOCOPY     ::     Robust File Copy for Windows
    -------------------------------------------------------------------------------
      Started : Friday, May 15, 2020 9:50:33 AM
                  Usage :: ROBOCOPY source destination [file [file]...] [options]
                 source :: Source Directory (drive:\path or \\server\share\path).
            destination :: Destination Dir  (drive:\path or \\server\share\path).
                   file :: File(s) to copy  (names/wildcards: default is "*.*").
    ::
    :: Copy options :
    ::
                     /S :: copy Subdirectories, but not empty ones.
                     /E :: copy subdirectories, including Empty ones.
                 /LEV:n :: only copy the top n LEVels of the source directory tree.
                     /Z :: copy files in restartable mode.
                     /B :: copy files in Backup mode.
                    /ZB :: use restartable mode; if access denied use Backup mode.
                     /J :: copy using unbuffered I/O (recommended for large files).
                /EFSRAW :: copy all encrypted files in EFS RAW mode.
      /COPY:copyflag[s] :: what to COPY for files (default is /COPY:DAT).
                           (copyflags : D=Data, A=Attributes, T=Timestamps).
                           (S=Security=NTFS ACLs, O=Owner info, U=aUditing info).

                   /SEC :: copy files with SECurity (equivalent to /COPY:DATS).
               /COPYALL :: COPY ALL file info (equivalent to /COPY:DATSOU).
                /NOCOPY :: COPY NO file info (useful with /PURGE).
                /SECFIX :: FIX file SECurity on all files, even skipped files.
                /TIMFIX :: FIX file TIMes on all files, even skipped files.
                 /PURGE :: delete dest files/dirs that no longer exist in source.
                   /MIR :: MIRror a directory tree (equivalent to /E plus /PURGE).
                   /MOV :: MOVe files (delete from source after copying).
                  /MOVE :: MOVE files AND dirs (delete from source after copying).
         /A+:[RASHCNET] :: add the given Attributes to copied files.
         /A-:[RASHCNET] :: remove the given Attributes from copied files.
                /CREATE :: CREATE directory tree and zero-length files only.
                   /FAT :: create destination files using 8.3 FAT file names only.
                   /256 :: turn off very long path (> 256 characters) support.
                 /MON:n :: MONitor source; run again when more than n changes seen.
                 /MOT:m :: MOnitor source; run again in m minutes Time, if changed.
          /RH:hhmm-hhmm :: Run Hours - times when new copies may be started.
                    /PF :: check run hours on a Per File (not per pass) basis.
                 /IPG:n :: Inter-Packet Gap (ms), to free bandwidth on slow lines.
                    /SL :: copy symbolic links versus the target.
                /MT[:n] :: Do multi-threaded copies with n threads (default 8).
                           n must be at least 1 and not greater than 128.
                           This option is incompatible with the /IPG and /EFSRAW options.
                           Redirect output using /LOG option for better performance.
     /DCOPY:copyflag[s] :: what to COPY for directories (default is /DCOPY:DA).
                           (copyflags : D=Data, A=Attributes, T=Timestamps).
               /NODCOPY :: COPY NO directory info (by default /DCOPY:DA is done).
             /NOOFFLOAD :: copy files without using the Windows Copy Offload mechanism.
    ::
    :: File Selection Options :
    ::
                     /A :: copy only files with the Archive attribute set.
                     /M :: copy only files with the Archive attribute and reset it.
        /IA:[RASHCNETO] :: Include only files with any of the given Attributes set.
        /XA:[RASHCNETO] :: eXclude files with any of the given Attributes set.
     /XF file [file]... :: eXclude Files matching given names/paths/wildcards.
     /XD dirs [dirs]... :: eXclude Directories matching given names/paths.
                    /XC :: eXclude Changed files.
                    /XN :: eXclude Newer files.
                    /XO :: eXclude Older files.
                    /XX :: eXclude eXtra files and directories.
                    /XL :: eXclude Lonely files and directories.
                    /IS :: Include Same files.
                    /IT :: Include Tweaked files.
                 /MAX:n :: MAXimum file size - exclude files bigger than n bytes.
                 /MIN:n :: MINimum file size - exclude files smaller than n bytes.
              /MAXAGE:n :: MAXimum file AGE - exclude files older than n days/date.
              /MINAGE:n :: MINimum file AGE - exclude files newer than n days/date.
              /MAXLAD:n :: MAXimum Last Access Date - exclude files unused since n.
              /MINLAD:n :: MINimum Last Access Date - exclude files used since n.
                           (If n < 1900 then n = n days, else n = YYYYMMDD date).
                    /XJ :: eXclude Junction points and symbolic links. (normally included by default).
                   /FFT :: assume FAT File Times (2-second granularity).
                   /DST :: compensate for one-hour DST time differences.
                   /XJD :: eXclude Junction points and symbolic links for Directories.
                   /XJF :: eXclude symbolic links for Files.
                    /IM :: Include Modified files (differing change times).
    ::
    :: Retry Options :
    ::
                   /R:n :: number of Retries on failed copies: default 1 million.
                   /W:n :: Wait time between retries: default is 30 seconds.
                   /REG :: Save /R:n and /W:n in the Registry as default settings.
                   /TBD :: wait for sharenames To Be Defined (retry error 67).
    ::
    :: Logging Options :
    ::
                     /L :: List only - don't copy, timestamp or delete any files.
                     /X :: report all eXtra files, not just those selected.
                     /V :: produce Verbose output, showing skipped files.
                    /TS :: include source file Time Stamps in the output.
                    /FP :: include Full Pathname of files in the output.
                 /BYTES :: Print sizes as bytes.
                    /NS :: No Size - don't log file sizes.
                    /NC :: No Class - don't log file classes.
                   /NFL :: No File List - don't log file names.
                   /NDL :: No Directory List - don't log directory names.
                    /NP :: No Progress - don't display percentage copied.
                   /ETA :: show Estimated Time of Arrival of copied files.
              /LOG:file :: output status to LOG file (overwrite existing log).
             /LOG+:file :: output status to LOG file (append to existing log).
           /UNILOG:file :: output status to LOG file as UNICODE (overwrite existing log).
          /UNILOG+:file :: output status to LOG file as UNICODE (append to existing log).
                   /TEE :: output to console window, as well as the log file.
                   /NJH :: No Job Header.
                   /NJS :: No Job Summary.
               /UNICODE :: output status as UNICODE.
    ::
    :: Job Options :
    ::
           /JOB:jobname :: take parameters from the named JOB file.
          /SAVE:jobname :: SAVE parameters to the named job file
                  /QUIT :: QUIT after processing command line (to view parameters).
                  /NOSD :: NO Source Directory is specified.
                  /NODD :: NO Destination Directory is specified.
                    /IF :: Include the following Files.
    ::
    :: Remarks :
    ::
           Using /PURGE or /MIR on the root directory of the volume formerly caused
           robocopy to apply the requested operation on files inside the System
           Volume Information directory as well. This is no longer the case; if
           either is specified, robocopy will skip any files or directories with that
           name in the top-level source and destination directories of the copy session.
           The modified files classification applies only when both source
           and destination filesystems support change timestamps (e.g., NTFS)
           and the source and destination files have different change times but are
           otherwise the same. These files are not copied by default; specify /IM
           to include them.
    C:\>


    • Edited by MotoX80 Friday, May 15, 2020 2:50 PM
    Friday, May 15, 2020 2:03 PM
  • As this need to be automate based on timeline provided by development team. so that we can configure this script from task scheduler can be called via there.

    I have my previous script on below manner.

    robocopy \\gisscn-Ao-a10p.cable.comcast.com\D$\BeaconApi\Uploads\ \\gisscn-Bo-a10p.cable.comcast.com\D$\BeaconApi\Uploads\ *.* /MIR robocopy \\gisscn-Ao-a10p.cable.comcast.com\D$\BeaconApi\Attachments\ \\gisscn-Bo-a10p.cable.comcast.com\D$\BeaconApi\Attachments\ *.* /MIR echo "Success" $(Get-Date) >> D:\RoboCopie_Scripts_Primay-Secondary\4_hours\Logs\test_%FileDate%.log stop-process -Id $PID

    BUt seems the script was that much efficient while tracking the all info i was looking for.Could you please suggest me on this.



    • Edited by Paban Ja Monday, May 18, 2020 5:14 AM
    Monday, May 18, 2020 5:03 AM
  • Thank you. Looking forward i will follow the given instructions as per given .
    Monday, May 18, 2020 5:15 AM
  • As this need to be automate based on timeline provided by development team. so that we can configure this script from task scheduler can be called via there.

    I have my previous script on below manner.

    robocopy \\gisscn-Ao-a10p.cable.comcast.com\D$\BeaconApi\Uploads\ \\gisscn-Bo-a10p.cable.comcast.com\D$\BeaconApi\Uploads\ *.* /MIR robocopy \\gisscn-Ao-a10p.cable.comcast.com\D$\BeaconApi\Attachments\ \\gisscn-Bo-a10p.cable.comcast.com\D$\BeaconApi\Attachments\ *.* /MIR echo "Success" $(Get-Date) >> D:\RoboCopie_Scripts_Primay-Secondary\4_hours\Logs\test_%FileDate%.log stop-process -Id $PID

    BUt seems the script was that much efficient while tracking the all info i was looking for.Could you please suggest me on this.



    I'm sorry but I do not understand your comments. What is the problem? 

    You do not want to use 3 machines in this copy process. That will require that all of the data be transmitted over the network twice. I would RDP to the destination server and run robocopy from there. Use the local drive letter and not the UNC path.

     
    robocopy \\gisscn-Ao-a10p.cable.comcast.com\D$\BeaconApi\Uploads\ D:\BeaconApi\Uploads\ *.* /MIR

    You should not need to do a stop-process on the Powershell PID. Powershell should terminate normally when the script ends.

    It also appears that you are mixing Powershell and cmd.exe statements. %FileDate% is a cmd.exe variable and in Powershell you will just get the characters '%FileDate%'.

      
    Monday, May 18, 2020 5:06 PM