fe3d94f9b4c05194f24c081e138b32e6f3274792 jnavarr5 Mon Apr 1 17:07:30 2019 -0700 Adding rsync examples for querying the hgdownload-euro server, refs #20551 diff --git src/hg/htdocs/goldenPath/help/gbib.html src/hg/htdocs/goldenPath/help/gbib.html index 9443ea8..728fa9d 100755 --- src/hg/htdocs/goldenPath/help/gbib.html +++ src/hg/htdocs/goldenPath/help/gbib.html @@ -250,44 +250,54 @@ </ol> <p> In addition to downloading entire track sets, you can also download individual subtracks. The file size of each track is listed next to the track name. If you are unsure of which tracks to select, we recommend the option <em>Default tracks with conservation tables, but no alignments</em>. When downloading large tracks, keep in mind that you cannot delete these tracks and the related data from GBiB once you have downloaded them. If you find that you've started downloading the wrong track or a track that is too large for your machine, you can cancel the download at any point by clicking <em>Cancel Download Now</em>.</p> <p> Depending on your network bandwidth, the download can take several minutes or up to a few hours over a DSL line. <strong>During the download</strong>, the file <em>gbib-data.vdi</em> will grow in size, and <strong>you will not be able to use GBiB</strong>. Once the download is complete, the default tracks should load in less than three seconds for a typical genomic position.</p> <p> -If you are in your GBiB on the command-line you can use a direct rsync command for files of interest. -For example, if you knew you wanted all the GENCODE tracks on hg19 you could run this command: -<ul> +If you are in your GBiB on the command-line you can use a direct rsync command for files of +interest. For example, if you knew you wanted all the GENCODE tracks on hg19 you could run either +of the two rsync commands for the North American or European hgdownload servers: +<pre> <code>sudo rsync hgdownload.soe.ucsc.edu::mysql/hg19/wgEncodeGencode* /data/mysql/hg19/.</code> -</ul> +</pre> +<pre> +<code>sudo rsync hgdownload-euro.soe.ucsc.edu::mysql/hg19/wgEncodeGencode* /data/mysql/hg19/.</code> +</pre> <p> -It would rsync all of the files at the UCSC hgdownload server in the hg19 assembly that start with -wgEncodeGencode to your GBiB into the hg19 directory. There are some supporting files in a hgFixed -directory, such as for the publication tracks, that could be mirrored with such commands.</p> +The above commands will rsync all of the files at the UCSC hgdownload server in the hg19 assembly +that start with wgEncodeGencode to your GBiB into the hg19 directory. There are some supporting +files in a hgFixed directory, such as for the publication tracks, that could be mirrored with such +commands.</p> <p> You can also download gbdb files in this manner. -<ul> +<pre> <code>sudo rsync hgdownload.soe.ucsc.edu::gbdb/hg19/multiz100way/phyloP100way.wib /data/gbdb/hg19/multiz100way/.</code> -</ul> +</pre> + +<pre> +<code>sudo rsync hgdownload-euro.soe.ucsc.edu::gbdb/hg19/multiz100way/phyloP100way.wib /data/gbdb/hg19/multiz100way/.</code> +</pre> + <p>The above command would copy the phyloP100way track to display in the GBiB from a local file.</p> <h3>Offline mode</h3> <p> GBiB has an offline mode that is particularly useful when you want to ensure that GBiB no longer connects to the Internet once the initial download and setup are complete (for instance, to comply with corporate IT policy). Before going offline, first mirror all the tracks that you will want to access. Then, in the GBiB terminal window type the command: <code>gbibOffline</code>. This command will remove GBiB's network access to the UCSC MySQL server and download servers.</p> <p> Once GBiB is in offline mode, the Genome Browser will display an error message if you attempt to access a data file not located on your local disk; therefore, we do not recommend this option for general use. To reactivate Internet access, click on the GBiB terminal window and type the command: <code>gbibOnline</code>.</p> @@ -730,35 +740,38 @@ <pre><code>httpsProxy=http://user:password@someProxyServer:3128</code></pre> <p> If there are domains or domain-suffices that should not be proxied, use <code>noProxy</code>. <pre><code>noProxy=ucsc.edu,mit.edu,localhost,127.0.0.1</code></pre> <p> The file /usr/local/apache/cgi-bin/hg.conf should already include a line like <code>include hg.conf.local</code> to incorporate the changes in hg.conf.local.</p> <p> <strong>Problem:</strong> "No space left on device" error when running gbibAddTools.</p> <p> In older GBiB's, there is an error in the <code>gbibAddTools</code> command. To fix this command, edit the <code>/home/browser/.bashrc</code> file and change the following line: <pre><code>alias gbibAddTools='mkdir ~/bin -p; rsync -avP hgdownload.soe.ucsc.edu::genome/admin/exe/linux.x86_64/ ~/bin/'</code></pre> </p> -<p>to: +<p> +to either of the follwing lines: <pre><code>alias gbibAddTools='sudo mkdir -p /data/tools; sudo rsync -avP hgdownload.soe.ucsc.edu::genome/admin/exe/linux.x86_64/ /data/tools/ && ln -s /data/tools ~/bin'</code></pre> +<pre><code>alias gbibAddTools='sudo mkdir -p /data/tools; sudo rsync -avP hgdownload-euro.soe.ucsc.edu::genome/admin/exe/linux.x86_64/ /data/tools/ && ln -s /data/tools ~/bin'</code></pre> </p> <p> -This updated command installs the tools to a location with more disk space available. +The updated commands will install the tools to a location with more disk space available using +either the North American or European hgdownload servers. </p> <a name="Commands"></a> <h2>Genome Browser in a Box commands</h2> <!-- Explanation here --> <p> In addition to normal Linux commands, GBiB defines some special commands you may use while inside the GBiB terminal's window. These additional commands are documented in the README.txt file on the GBiB terminal's home directory, which can also be accessed via <a href="#Connectwithssh">ssh</a>.</p> <h6>General commands</h6> <table> <tr>