20da4c889251225224be1661d4f3f7f9d4d0d8fa hiram Thu Sep 10 11:24:58 2026 -0700 eliminate obsolete information diff --git src/hg/utils/otto/genArk/README src/hg/utils/otto/genArk/README index 7b26a5c343e..8310d05ce35 100644 --- src/hg/utils/otto/genArk/README +++ src/hg/utils/otto/genArk/README @@ -1,38 +1,43 @@ Thu Oct 23 12:10:27 PDT 2025 In the process of readjusting the push scripts so they will only push out from hgwdev to hgwbeta, and then cluster admin cron jobs will push out from hgwbeta to the RR machines +The only RR interaction these scripts have is pushing a 'public.hub.txt' +file to hgw0 as it renames to 'hub.txt' + +The cluster-admin process uses a file list constructed by these scripts +for just the files that need to go out, new or changed. + +What is missing here is a 'removal' step to eliminate obsolete files. +This could be taken care of via the same 'file list' type of operation. +Such a list is already constructed, it just needs to be folded into +the cluster-admin procedure. + ################################################################### Also using the assemblyList.py script from kent/src/hg/hubApi/assemblyList.py # scripts used to push out the /gbdb/genark/ hierarchy -# from hgwdev to our RR sites, and the pullHgwdev.sh is -# running in qateam cron job on the Asia node +# from hgwdev to our RR sites. -pullHgwdev.sh pushRR.sh -### manages the pushing of the beta and public versions of 'contrib' -### tracks in genark assemblies -alphaBetaPush.pl - ################################################################### # operation procedure ################################################################### Listings of files are made on hgwdev, hgwbeta and hgw1 in order to determine what needs to be pushed out. It is done with these listings instead of allowing rsync to simply push everything because there is a staged alpha, beta, public release procedure that pushes out different hub.txt files to hgwbeta and hgw1, and different 'contrib/' directories in the GenArk hubs. 1. the script devList.sh is running as an otto cron job on hgwdev: 58 18 * * * /hive/data/inside/GenArk/pushRR/devList.sh which runs on hgwdev and constructs listings of files with their timestamps in: