the ucsc table browser & custom tracks advanced searching and discovery using the ucsc table...

55
The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics Unit Materials prepared by: Warren C Lathe, Ph.D. Version 19b

Upload: janis-stevens

Post on 13-Dec-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

The UCSC Table Browser & Custom Tracks

Advanced searching and discovery using theUCSC Table Browser and Custom Tracks

Osvaldo Graña

CNIO Bioinformatics Unit

Materials prepared by:

Warren C Lathe, Ph.D.

Version 19b

Page 2: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 2

Table Browser and Custom Tracks Agenda

Table Browser Introduction Table Browser: Setup and filters Table Browser: Intersections Custom Tracks: Table Browser & User Generated Exercises

UCSC Table Browser: http://genome.ucsc.edu/

Page 3: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 3

The Table Browser

http://genome.ucsc.edu/

Page 4: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 4

Genome Browser Database

Primary table: positions, names, etc.

UnderlyingDatabase(MySQL)

Auxiliary table: related data

visualize search & download

Page 5: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 5

UCSC Genome Browser Reference

Publication

Karolchik, et al.The UCSC Table Browser data retrieval tool. Nucl. Acids Res. 32(Suppl 1), D493-D496 (2004)

Page 6: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 6

Table Browser and Custom Tracks Agenda

Table Browser Introduction Table Browser: Setup and filters Table Browser: Intersections Custom Tracks: Table Browser & User Generated Summary Exercises

UCSC Table Browser: http://genome.ucsc.edu/

Page 7: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 7

Discovery using the Table Browser

McMurray, C. Mechanisms of trinucleotide repeat instability during human development. Nature Reviews Genetics 11: 786-99

Page 8: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 8

The Table Browser

Open browser

Open browser

http://genome.ucsc.edu/

Page 9: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 9

Table Browser: Choose Genome

Choose Genome

In the Human genome,

search for simple repeats in the entire genome

with the exact sequence “CAG”and get table data.

Page 10: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 10

Table Browser: Choose Table to Search

Choose Data Table

In the Human genome,

search for simple repeats in the entire genome

with the exact sequence “CAG”and get table data.

Page 11: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent11

Table Browser: Describe Table

Describe table

Page 12: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

In the Human genome,

search for simple repeats in the entire genome

with the exact sequence “CAG”and get table data.

Copyright OpenHelix. No use or reproduction without express written consent12

Table Browser: Choose Region to Search

Choose Region to Search Define region

Page 13: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 13

Table Browser: Upload Locations to Search

Paste Upload

Page 14: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 14

Table Browser: Quick Summary of Expected Hits

Data Summary

Nearly 1 million simple

Repeats annotated in the

Human genome

Page 15: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

In the Human genome,

search for simple repeats in the entire genome

with the exact sequence “CAG”and get table data.

Copyright OpenHelix. No use or reproduction without express written consent 15

Table Browser: Filter to Refine Search

Create Filter

Submit Filter

Delete wildcard “*” and type in

“CAG” (uppercase)

Page 16: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 16

Table Browser: Output Data

Output dataIn the Human genome,

search for simple repeats in the entire genome

with the exact sequence “CAG”and get table data.

Page 17: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 17

Table Browser: Output Formats

Output formats

Text Fields

Page 18: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 18

Table Browser: Fasta Sequence Output

Sequence

Page 19: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 19

Table Browser: Database Format Outputs

Database

Page 20: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 20

Table Browser: Custom Track Output

Custom Track

Page 21: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 21

Table Browser: Hyperlinks Output

Hyperlinks

Page 22: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 22

Table Browser: Obtaining Output

Adding name creates file on desktop,leaving blank creates output in browser.

(exception: custom track)

Data Summary

80 simple repeats in

the genome match our filter

criteria, out of 1 million

Page 23: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 23

Table Browser: Output configuration

Fields

Page 24: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 24

Table Browser and Custom Tracks Agenda

Table Browser Introduction Table Browser: Setup and filters Table Browser: Intersections Custom Tracks: Table Browser & User Generated Exercises

UCSC Table Browser: http://genome.ucsc.edu/

Page 25: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 25

Table Browser: Intersecting Data

Find simple repeats (sequence = CAG)

within known genes and get hyperlinks.

Intersect

2nd Table

Any Overlap

Submit

Page 26: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 26

Table Browser: Intersecting Data Narrows Search

Summary

Filtered simple repeats

Filtered simple repeats, intersected (overlapping)

w/ known genes

Page 27: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 27

Table Browser: Get hyperlinks

get output

Page 28: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 28

Table Browser: Exploring the results

HTT, chr4: 307…

CAG

Q

ATN1, chr12: 704…

CAG

Q

Page 29: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 29

Table Browser: Exploring the results

RAI1

CAG

Q

DMPK

Page 30: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 30

Table Browser: Exploring the results

CAG

DMPK

Direction of transcription

CTG

Page 31: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 31

The Table Browser

McMurray, C. Mechanisms of trinucleotide repeat instability during human development. Nature Reviews Genetics 11: 786-99

Page 32: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 32

Table Browser: Correlating Data Tables

Correlate 2 Datasets

Get Results

Page 33: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 33

Table Browser and Custom Tracks Agenda

Table Browser Introduction Table Browser: Setup and filters Table Browser: Intersections Custom Tracks: Table Browser & User Generated Exercises

UCSC Table Browser: http://genome.ucsc.edu/

Page 34: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 34

Custom Tracks: Table Browser Searches

Create Track

Get Output

Page 35: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 35

Custom Tracks: Name and Configure Track

Download track file to desktop

Name Track:SRepeatKGenes

Describe Track:Intersection …

In Genome Browser

Choose defaultview in browser

Page 36: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 36

Custom Tracks: Open Track in Genome Browser

Open Details

Compare

“…caused by anexpanded, unstable

trinucleotide repeat…”

Page 37: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 37

Custom Tracks: Track in Table Browser

Custom tracks also are available for filtering and intersections

on the Table Browser

Custom Tracks

Page 38: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 38

Custom Tracks: Manage Custom Tracks

Edit TrackGenome Browser

Page 39: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 39

Custom Tracks: User-generated Data in Track

Custom Track How-to

Page 40: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 40

Custom Tracks: Four Steps to Create Track

Four steps to create a custom trackFormat your dataDefine browser characteristicsDefine track characteristics Upload and view your trackAdd URL for annotation details (option)

http://genome.ucsc.edu/goldenPath/help/customTrack.html

Page 41: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 41

Custom Tracks: Format your Data

Format Your Data (step 1)

GFFGTFPSLBEDWIG

bigBEDbigWIG

Etc...

Browser Extensible Data

chr4 56010000 56015000 cloneA 900 +chr4 56014000 56019000 cloneB 200 +chr4 56017000 56023000 cloneC 800 -chr4 56021000 56028000 cloneD 300 -

Page 42: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 42

Custom Tracks: Format your Data

Browser Extensible Data: 3 required fields, 9 optional fields

chr4 56010000 56015000 cloneA 900 +chr4 56014000 56019000 cloneB 200 +chr4 56017000 56023000 cloneC 800 -chr4 56021000 56028000 cloneD 300 -

ChromosomeStart En

dName Score (shading)

Additional optional fields: Thick region, Item color, Number of blocks,size of blocks, start position of blocks

Strand

Page 43: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 43

Custom Tracks: Browser Characteristics

Define Genome Browser Characteristics (step 2)

browser position chr4:56010000-56030000browser pix 800browser hide allbrowser pack snp130browser full knownGene

Default Position

Default Image Width

Default Track View

Default Track View

Page 44: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 44

Custom Tracks: Track Characteristics

Define Track Characteristics (step 3)

Score on (1) or off (0)

Default ColorDefault track visibility0=hide

1=dense2=full

3=pack4=squish

track name=clones description="Clones" visibility=2 color=200,0,200 useScore=1 db=hg18

Database

Can also define group placement, turn item colors on, and more.

Page 45: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 45

Custom Tracks: The Track File

Our Track:

browser position chr4:56010000-56030000browser pix 800browser hide allbrowser pack snp130browser full knownGenetrack name=clones description="Clones" visibility=2 color=200,0,200 useScore=1 db=hg18chr4 56010000 56015000 cloneA 900 +chr4 56014000 56019000 cloneB 200 +chr4 56017000 56023000 cloneC 800 -chr4 56021000 56028000 cloneD 300 -

Page 46: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 46

Custom Tracks: Upload Track File

Upload and View your Track (step 4)

Upload File

Page 47: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 47

Custom Tracks: Upload File from Computer

Documentation template

Click to browse yourcomputer to find file

Page 48: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 48

Custom Tracks: Submit Track

Submit File

Page 49: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent

Custom Tracks: Track Appears in Genome Browser

Default view of custom track is “full”

Default viewof other tracks set

Documentation

Page 50: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 50

Custom Tracks: Track Appears in Table Browser

Custom Track alsoappears in

Table Browser

Page 51: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Custom Tracks

Copyright OpenHelix. No use or reproduction without express written consent 51

Custom Tracks from Outside Sources

Contributed Track

Page 52: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Load

Copyright OpenHelix. No use or reproduction without express written consent 52

Track Hubs in Genome Browser

Track Hubs

Page 53: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 53

Track Hubs in Table Browser

Track Hubs

Load

User Guide

Page 54: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 54

Table Browser and Custom Tracks Agenda

Table Browser Introduction Table Browser: Setup and filters Table Browser: Intersections Custom Tracks: Table Browser & User Generated Exercises

UCSC Table Browser: http://genome.ucsc.edu/

Page 55: The UCSC Table Browser & Custom Tracks Advanced searching and discovery using the UCSC Table Browser and Custom Tracks Osvaldo Graña CNIO Bioinformatics

Copyright OpenHelix. No use or reproduction without express written consent 55