deblending jim bosch for data management (and especially robert lupton and dustin lang)

28
Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Upload: charles-rippon

Post on 01-Apr-2015

217 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

DeblendingJim Bosch

for Data Management(and especially Robert Lupton and Dustin Lang)

Page 2: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

There Will Be Blends

• LSST will go deep:– We’ll detect fainter objects.– We’ll see the low surface brightness wings of

everything.• LSST is on the ground:– Even under the best conditions, image quality

won’t be as good as what we’d get from space

Page 3: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

There Will Be Blends

From David Kirkby (in prep)

Page 4: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

KINDS OF BLENDS

Page 5: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Space and GroundHST WFC3 F125 Subaru HSC i

Page 6: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Case 1: Unknown Unknowns

• If sources are so close we can’t tell they’re blended, there’s nothing the DM pipelines can do.

• Data from space could help, but using this will likely be Level 3.

• Mostly, we’ll have to deal with these statistically in the science analysis.

Page 7: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Space and GroundHST WFC3 F125 Subaru HSC i

Page 8: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Case 2: Known Unknowns• We believe there may be more than one source in a

particular region.• We want to measure the properties of the sources in

as if they were isolated.• Simultaneous model-fitting is one option, but it may

not be the best one.– Some popular measurements (e.g. aperture fluxes, image

moments) require that we actually try to split up the pixels.– We don’t have good models for some kinds of sources (e.g.

galaxies).

Page 9: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Deblending Stars

• This is easy, if we have a good PSF model: just fit models simultaneously.

• Because stars (at any given epoch) are completely represented by positions and fluxes, there’s no need to do additional measurements.

• If we don’t have enough isolated stars to build a PSF model, we need a crowded field code.

Page 10: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Deblending Galaxies

• Unlike stars, we don’t have good models for galaxies.

• This is clearly bad new for bright, well-resolved galaxies.

• It might also be bad news for faint or poorly-resolved galaxies.

Page 11: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

THE SDSS DEBLENDER:A STARTING POINT

Page 12: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The SDSS Deblender: Detection

• In each band, we smooth the image, then detect above-threshold regions (Footprints). We then grow these regions by the size of the smoothing kernel.

• Within each Footprint, we find one or more Peaks.

SDSS

Page 13: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The SDSS Deblender: Merging/Culling

• We compute the spatial union of all the Footprints from different bands, epochs, smoothing kernels.

• Within each Footprint, we merge all the Peaks from the different detection images, culling those that appear to represent the same source.

Page 14: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The SDSS Deblender: Symmetric TemplatesFor each Peak and pixel , create a template that is the minimum of the pixel value and its reflection about the peak .

Do a linear fit for the amplitudes of all templates by minimizing:

Compute deblended pixel values:

true source profilespixel

values

deblended pixels residuals

templates

Page 15: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The SDSS Deblender: Symmetric Templates

𝒛 𝒙

𝒛 𝒙

SDSS

Page 16: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The SDSS Deblender: Heuristics

• If the dot product of any two templates is close to one, drop one of them.

• If a template looks a lot like the PSF model, use the PSF model as the template instead.

• Put limits on how sharp a template’s features can be.

Page 17: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The SDSS Deblender: Measurement

• We call the outputs of the deblender HeavyFootprints: they’re Footprints that also hold the pixels of the deblended children.

• When we measure a source, we replace every other source’s Footprint with noise first.

• In addition to measuring the child sources, we also measure the parents (because we might have been wrong about it being a blend, or the deblender may have done more harm than good).

Page 18: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Features of the SDSS Deblender

• We can run any measurement algorithm we can run on isolated sources.

• Flux is conserved as it is split up.• No simple assumptions about galaxy

morphology: not only is 180˚ rotation a weak constraint, it’s only enforced on the templates, not the deblended pixels.

Page 19: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Weaknesses of the SDSS Deblender

• Only Peaks are shared between bands; no good way to generate reasonable templates for drop-out sources.

• No way to account for multiple epochs with different PSF.

• Doesn’t handle uncertainty rigorously.• Vetted on a survey with a much less severe

blending problem.

Page 20: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

WHAT NEXT?

Page 21: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Detection for LSST

• Detection will happen on multiple coadds:– different bands (or weighted combinations of bands)– different smoothings (i.e. morphological filters)

• ...and difference images.• We need to merge these detections in order to

deblend consistently.• We need to transfer the deblender outputs back

to images with different bands, PSFs, WCSs, and observation dates.

Page 22: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Going Multi-Epoch

• We can convolve templates derived in one band or image with a difference kernel to generate one appropriate for a different band or image.

• We can use point-source templates for drop-outs.

• We can use PSF-convolved analytic models as templates.

Page 23: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

...or Simultaneous Fitting?

• We’re going to use simple galaxy models for many of our most important measurements; do we gain anything (or lose anything!) by redistributing pixel flux using a more flexible model first?

• Can we make galaxy models flexible enough to make model biases unimportant?

• Flux redistribution with templates may still be useful as a starting point – it’s a lot faster than a high-dimensional nonlinear fit.

Page 24: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

More on Galaxy Modeling

• What should we let vary between bands?• How flexible should models be?– If they’re very flexible, how do we handle low SNR

sources?– Can we afford to sample rather than fit?– If we need priors, where do they come from?

• Do we fit a star model and a galaxy model to everything?

Come to the breakout session at 1:30pm today!

Page 25: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

Using Colors?

• There’s a lot more information in the spectral dimension that could be used in deblending.

• We don’t want to bias downstream algorithms (e.g. photo-zs) or make it less likely to find new and interesting objects that don’t have “normal” colors.

Page 26: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

coaddimages

differenceimages detect

detect Footprints & Peaks

merge/cull

generate templates,

reapportion pixel fluxes

replace neighbors with noise, measure

coadd Heavy Footprints

visit images

preliminary models

simultaneous fitting

coaddition

image subtraction

final models

Footprints & Peaks

Footprints & Peaks

SDSS functionality

Page 27: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

The LSST Prototype Deblender

• The LSST DM Stack includes a limited reimplementation of the SDSS Deblender.

• We don’t have any code for the peak merge/cull stage, so we can’t deblend across multiple bands in a consistent way.

• We don’t have some of the heuristics that were used in SDSS.

Page 28: Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

What We Don’t Know Can Hurt Us

Huff and Graves (2014)

The presence of a LRG affects the measurement of the properties of sources arcminutes away.

This is because undetected galaxies cluster with the galaxies we do detect, and that upsets the measurement algorithms in a systematic way.

Error in measurements of simulated galaxies injected into real data.