eee0b1f73f5f01866f9e8b8dbb5ed153298d2638 lrnassar Wed May 15 14:53:53 2019 -0700 Linking to new hubAPI page from different FAQs #18869 diff --git src/hg/htdocs/FAQ/FAQdownloads.html src/hg/htdocs/FAQ/FAQdownloads.html index 9bd21be..8c470d3 100755 --- src/hg/htdocs/FAQ/FAQdownloads.html +++ src/hg/htdocs/FAQ/FAQdownloads.html @@ -65,30 +65,35 @@ You can download sequence and annotation data using our FTP server, but we recommend using rsync, which has the advantage of starting up where it left off after a failure, when run again. Please see the previous link for examples.

You can also download data from our Downloads page or our DAS server. To download a specific subset of the data or to configure the output format of the data, use the Table Browser. For information on extracting a large set of sequences from an assembly, see Extracting sequence in batch from an assembly.

For more information on using the UCSC DAS server, see Downloading data from the UCSC DAS server.

+

+Another option for querying sequence and annotation data is the JSON API. This interface allows for extraction of sequence and annotations from +both UCSC assemblies and from hubs.

+

To quickly download large volumes of data you can use UDR (UDT Enabled Rysnc): UDR provides users much faster download rates. Here is an example using UDR, once installed, to download all the mouse mm9 ENCODE information that amounts to several terabytes:

$ udr rsync -avP hgdownload.soe.ucsc.edu::goldenPath/mm9/encodeDCC/ /my/local/mm9/
$ udr rsync -avP hgdownload-euro.soe.ucsc.edu::goldenPath/mm9/encodeDCC/ /my/local/mm9/

Please read more about the new UDR method here.

Metadata tables for GenBank and RefSeq moved to hgFixed database

I can no longer find metadata tables like gbCdnaInfo for an assembly.

As of June 2016, the location of metadata tables that support the GenBank and RefSeq tracks (RefSeq, Other RefSeq, mRNA, EST, etc.) have been moved from directories of individual assemblies @@ -195,30 +200,33 @@ specifiers available for that assembly. The entry point specifies chromosome position, and the type indicates the annotation table requested. You can view the lists of entry points and types available for an assembly with requests of the form:

http://genome.ucsc.edu/cgi-bin/das/[db_name]/entry_points
 http://genome.ucsc.edu/cgi-bin/das/[db_name]/types

where [db_name] is the UCSC name for the assembly, e.g. hg16, mm4.

For example, here is a query that returns all the records in the refGene table for the chromosome position chr1:1-100000 on the hg16 assembly: 

http://genome.ucsc.edu/cgi-bin/das/hg16/features?segment=1:1,100000;type=refGene

For more information on DAS, see the Biodas website and the DAS specification.

+

+A more recent alternative to the DAS server is the JSON API.

Downloading the UCSC Genome Browser source

Where can I download the Genome Browser source code and executables?

The Genome Browser source code and executables are freely available for academic, nonprofit, and personal use (see Licensing the Genome Browser or Blat for commercial licensing requirements). The latest version of the source code may be downloaded here.

See Downloading Blat source and documentation for information on Blat downloads.

Download restrictions

@@ -825,32 +833,33 @@ browser (for more info see this FAQ), but this start position listed in this section of the 4th column is actually 1 based. It will be the exact coordinate the feature starts on as displayed in the browser.
  • Strand: forward(f) or reverse(-) strand.

    • Track Data Access

    How do I access the data underlying a track?

    The raw data underlying a track can be explored interactively with the Table Browser, Data Integrator, or Variant Annotation Integrator. For automated analysis, the genome annotation can be downloaded from the -downloads server or one of our two -public MySQL servers.

    +downloads server, one of our two +public MySQL servers, or +using our JSON API.

    bigBed data: For bigBed files, individual regions or the whole genome annotation can be obtained using our tool bigBedToBed which can be compiled from the source code or downloaded as a precompiled binary for your system. Instructions for downloading source code and binaries can be found here. The tool can also be used to obtain only features within a given range using one of the hgdownload servers, example: