chap10 free tools

Upload: paranormalsocieties

Post on 06-Apr-2018

247 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/2/2019 Chap10 Free Tools

    1/20

    .or adnc. Bld wth

    b Standards.Bld wtax.Bld to b ond. Bwth mcroormats. Bld

    yword dnsty. Bld wtHTML & CSS. Bld smntcally manngl cod

    ld wth RSS. Bld st can track. Bld lnks tor st. Bld hCard cont normaton. Bld a rtaton. Bld rpat vst

    rs. Bld a stmap XML. Bld contnt that drvafc. Bld cstom sarc

    ld to b sn by sarcngns. Bld fndabllogs. Bld wth PHP an

    Yo can commncat

    normaton abot yor st to

    sarch ngns and s yor

    st rom thr prspctv sng

    som r srvcs and tlts

    rom Yahoo! and Googl.

    Free Search EngineTools and Services

  • 8/2/2019 Chap10 Free Tools

    2/20

    Yahoo! and Googl provd som r and

    xcptonally sl tools and srvcs to hlpyo commncat th strctr o yor st,

    and gt a clarr ndrstandng o how wll ts

    bng ndxd. Ths tools also provd valabl

    nsght abot nbond lnks to yor st, kywords

    gnratng sarch rrrals, and varos othr

    data that can hlp yo assss th sccss o yor

    ndablty orts.

    Bor valatng statstcs yoll nd to mak

    sr sarch ngns ar ndxng all o th contnt

    on yor st. Yo can mak t asr or sarch

    ngn spdrs to crawl yor st by drawng thm

    a map.

    Bldng and Sbmttng stmap.xmlHistrially, th mmuniatin btwn wbmastrs an sarh ngins

    has bn ry limit. In th ast, n yu built yur sit yu wul submit

    th hm ag URL t all th majr sarh ngins t lt thm knw yu

    lik thir sirs t bgin inxing yur ntnt. With nthing but th hm

    ag URL, sirs an tntially rlk sm ags in yur sit, sially

    ths that may nly b assibl ia yur sarh systm. A w yars ag

    Ggl rgniz that this rblm ul arsly at th mrhn-

    sinss its sarh inx, an rat a siml slutin all sitemap.xml.

    In Jun 2005 Ggl intru a stanariz XML sitma rtl

    that allws wbmastrs t mmuniat th strutur thir sit t sarh

    ngins r mr aurat inxing (http://sitemaps.org). Tay, baus

    th sitemap.xml rtl is surt by Yah!, Ask, an MSN Li Sarh

    as wll, th sam XML il an lt all majr sarh ngins knw whih ags

    thy shul inx in yur sit.

    Th sitemap.xml rtl als lts wbmastrs inlu inrmatin abutah ag, inluing th at it was uat, th rquny hang, an

    hw imrtant it is in th sit. This ty aitinal inrmatin an hl

    sarh ngins rawl yur sit mr intlligntly.

  • 8/2/2019 Chap10 Free Tools

    3/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS

    Th strutur a sitemap.xml il is rlatily siml. Hrs an abbriat

    xaml that illustrats th tags mmn t th rtl:

    http://aarronwalter.com/

    1.0

    daily

    http://aarronwalter.com/about/0.5

    monthly

    Althugh this xaml ris URLs r just tw ags n my wbsit, th

    sitemap.xml rtl an srib sits any sal. Th il bgins with

    th XML rlgu an a initin th shma bing us. Thats nt th

    imrtant art, thugh. Nti thr ar tw n an ls tags, ah

    ntaining irnt inrmatin. eah tag ins a irnt ags

    latin, ririty, an hang rquny. Baus th hm ag is th mst

    imrtant ag in th sit it has a highr ririty alu than th intrir ag in

    this xaml.

    Yu an tinally in th ririty an hang rquny yur agsrm within ah tag. Th tag ntains a lating int num-

    br rm 0.0 t 1.0, whr 1.0 is th highst ririty. It lts sarh ngins

    knw whih ags yu m mst imrtant s sirs an riritiz as thy

    inx yur sit.

    Th tag ris sarh ngins gnral inrmatin abut hw

    tn yur ags will hang, but nt tak this t sriusly as it may nt

    rrlat t hw tn yur ag gts rawl. Yull in a list ssibl al-us r th tag an urthr inrmatin abut sitemap.xml tags

    at http://www.sitemaps.org/protocol.php.

  • 8/2/2019 Chap10 Free Tools

    4/20

    cHApTeR 10

    This il is quit shrt an it is rlatily siml s it wul b asy t buil.

    I yur sit ha hunrs r thusans ags it wul b ar t tim n-suming an tius t writ it by han.

    Lukily thr ar srs skt an Wb aliatins that will rawl yur

    sit an rat a sitemap.xml il autmatially s yu an sn mr tim in

    yur hammk than writing rtiti XML umnts. Thr ar n srits

    in a arity languags that yu an rly intgrat int yur sits, cntnt

    Managmnt Systms, r Wb aliatins t autmat th rss n

    urthr.

    Yull in an xhausti list tins at http://code.google.com/

    sm_thirdparty.html. Sm tins ar r whil thrs may st yu a w

    buks. I yur a dramwar usr yu may want t try Grg ptrs

    r Ggl Sitma Gnratr xtnsin aailabl n dMXZn.m

    (http://www.dmxzone.com/showDetail.asp?TypeId=3&NewsId=10538 ).

    S FiGuRe 10.1. on yu wnla an install th xtnsin yull

    n t rstart dramwar an thn in a sit in th sit mangr s th

    xtnsin an rawl all th HTML ags in yur sit. T in a sit simly

    hs Sit, slt Nw Sit, thn ntr th inrmatin rqust.

    on yur sit is in, slt cmmans, hs crat Ggl Sitma

    an th xtnsin will wrk its magi. Th inal sitemap.xml il will b la

    in th rt lr yur sit.

    I yu ar using a srr-si sriting languag t rat a ag tmlat

    systm, yull in that th xtnsin will ha trubl rawling yur sits ils.

    Insta, yu will n t us a sitma gnratin tl that rawls th li sit

    in rr t rat th sitemap.xml il.

    on suh tin is XML-Sitmas.m (http://www.xml-sitemaps.com/).

    I yur sit is 500 ags r lss, XML-Simas.m will rawl yur sit an

    gnrat a sitemap.xml il r r. fr sits that ar largr yu wul nt urhas thir pHp srit, whih yu ul intgrat int yur wn rj-

    ts. Th srit als gnrats sitmas in RSS an HTML rmats. HTML

    sitmas ar sially usul t usrs wh lst thir way n yur sit, r

    just want a littl hl unrstaning th s yur inrmatin. Any sarh

    ngin that snt surt th sitemap.xml rtl ul us th HTML

    sitma t naigat yur sit.

    Whn th srit runs, it autmatially ntiis Ggl th il uat sit an risit yur sit t inx rnt ntnt. Th XML-Sitmas.m pHp

    FiGuRe 10.1 George

    Petrovs Google Sitemap

    Generator is a free exten-

    sion for Dreamweaver thatgreatly simplifies the cre-

    ation ofsitemap.xml files.

  • 8/2/2019 Chap10 Free Tools

    5/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS

    srit will als trak wn brkn links in yur sit s yu an rair thm.

    I yu ar lking r an qually atur-rih pHp srit t intgrat int yur

    rjts r r, hk ut hSitmaNG (http://enarion.net/google/).

    Yu an shul a rgular rrsh yur sitemap.xml il with h-

    SitmaNG using crn, a Unix an Linux rating systm utility that sh-

    uls tasks t run autmatially. I yur n a Winws srr, us th built-in

    task shulr in th cntrl panl t run th pHp srit insta.

    Thr ar als g skt aliatins that an mak shrt wrk sitemap.xml il lmnt. RAGe maks Ggl Sitma Autmatr r

    th Ma (http://www.ragesw.com/products/googlesitemap.html) that will

    rawl yur sit, gnrat th sitemap.xml il, ula it t yur srr, an tll

    Ggl n its st (s FiGuRe 10.). Its intuiti intra maks th

    rss ry asy. Althugh yu an us th m rsin Ggl Sitma

    Autmatr t gnrat an ula yur sitemap.xml il, yull ha t ur-

    has a lins t us th Ggl ntiiatin atur.

    I yur nw t crn,hk ut Aarn

    Brazlls hlul artil athtt://www.sitint.m/artil/intruing-rn.

    Winws srr usrs lk-ing r an intrutin t

    Task Shulr an hkut htt://www.ius.m/

    guis/winshulr.htm.

    iArhitt maks a grat sitma utility r Winws all Sitma Gn-

    ratr (http://www.iarchitect.net/Products/Sitemap-Generator/). S

    FiGuRe 10.. In aitin t rating, ulaing, an ntiying sarh ngins yur sitma, Sitma Gnratr rats HTML sitmas an ris

    shuling tins s yu an urthr autmat th builing an uating

    yur sitemap.xml il.

    I yur nt using a sitma gnratin rgram that will autmatially ula

    yur sitemap.xml il yull n t it yursl. Gnrally th il is la in

    th Wb rt lr n a srr, whih is tyially all public_html r www.

    Thn yull n t inrm sarh ngins its latin s thy an ra thsitma an bgin rawling yur sit.

    FiGuRe 10. RAGEs

    Google Sitemap Automator

    (http://www.ragesw.com/

    products/googlesitemap.

    html) quickly builds a

    sitemap.xml file, uploads it

    to your server and notifies

    Google of its location.

  • 8/2/2019 Chap10 Free Tools

    6/20

    cHApTeR 10

    inormng Sarch engns Abot Yor

    stmap.xml FlThr ar thr ways yu an lt sarh ngins knw abut yur sitemap.xml

    il n its ula r uat:

    n robots.txt

    n ping

    n Manual submissin

    fr th bst rsults yull want t us a mbinatin ths thr t nsur

    all sarh ngins ar awar yur sitma.

    robots.txt chatr 3, Srr-Si Stratgis, intru th robots.

    txt rtl us t tll sarh ngin sirs whih ils r irtris n

    a srr shul b xlu rm inxing. Th il is la in th Wb rt

    lr yur srr, an is autmatially ra by all sarh ngin sirs.

    A robots.txt il an als b us t mmuniat th latin yur

    sitemap.xml il t all sarh sirs that isit yur sit. Simly a th llw-

    ing t yur robots.txt il t in th latin:

    Sitemap: sitemap.xml

    Th bnit using robots.txt t mmuniat yur sitmas latin is

    that any sarh ngin that surts th rtl will autmatially in th il

    whn it isits yur sit. This arah s nt sn a mssag ut t sarh

    FiGuRe 10. Sitemap

    Generator for Windows

    offers features beyond most

    of its competitors, includ-

    ing HTML sitemaps and

    scheduled updating of your

    sitemap.xml file.

  • 8/2/2019 Chap10 Free Tools

    7/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS

    tip

    ngins initing thm t inx yur sit. I yur launhing a nw sit, its a

    g ia t ntiy sarh ngins irtly as wll using n th nxt twmths.

    Png Aping is a shrt mssag rm n mutr t anthr. Whn yu

    ublish a nw sit an want t rqust a ull inxing yu an ing sarh

    ngins iniiually t lt thm knw whr yur sitemap.xml il is lat.

    Ggl, Ask, an Yah! all r ing ntiiatin sris, whih an b

    us by simly naigating t ah in yur brwsr. Rla th highlightsaml URL in ths xamls with th abslut ath t yur sitemap.xml il.

    n Google: htt://www.ggl.m/wbmastrs/sitmas/ing?sitma=

    http://example.com/sitemap.xml

    n Ask: htt://submissins.ask.m/ing?sitma=http://example.com/

    sitemap.xml

    n Yahoo!: htt://sarh.yahais.m/SitexlrrSri/v1/ing?sitma=http://example.com/sitemap.xml

    MSN Li Sarh is nsiuusly absnt rm this list. Althugh it surts

    th sitemap.xml rtl, at th tim writing it int r a sitma sub-

    missin tl any kin. Th nly way t lt MSN Li Sah knw abut yur

    sitma is ia yur robots.txt il.

    Ths ing URLs ar als ry usul i yur builing a ntnt managmntsystm r Wb aliatin that ns t ntinually uat sarh ngins

    with nw ags. Yur aliatin ul autmatially uat yur sitemap.xml

    il, thn nnt t ths ing sris r yu.

    T quikly ing all sarh ngins with sitemap.xml ing sris,

    rat a bkmark lr in yur brwsr, thn a bkmarks r

    ah ing sri with yur sitemap.xml URL trailing. Anytim yu

    uat yur sitemap.xml il simly launh ths bkmarks t

    instantly sn wr yur nw ntnt t sarh ngins.

    Manal Sbmsson Yu an als lt sarh ngins knw abut yur

    sitemap.xml il by isiting ah n an manually submitting yur sitma

    URL. Unrtunatly, nly Ggl an Yah! urrntly ri manual

    sitemap.xml submissin tls. fr sitma uats this is rtainly th mst

    tius th thr tins. I yur launhing a nw sit, a manual submis-

    sin is rbably a g ia.

  • 8/2/2019 Chap10 Free Tools

    8/20

    cHApTeR 10

    note

    As wll isr in th rst this hatr, whn yu manually submit yur

    sitma t Ggl an Yah! thy will ars yur il an ntiy yu anyrrrs thy nuntr. Thy als ri inrmatin abut th last

    tim thy ra yur sitma s yull knw i yur nwst ntnt is in thir

    sarh inx.

    I yu n t gnrat a sitma r a Wrprss blg yull want

    t ra th stin in chatr 5 ntitl Autmatially Gnrating

    an XML Sitma.

    Googl Wbmastr Cntral SrvcsGgl ris an amazing array r statistis, iagnstis, an manag-

    mnt utilitis in Wbmastr cntral (http://www.google.com/webmasters/).

    S FiGuRe 10.. frm hr yu an submit yur URL t Ggl, an hk

    th status yur sit t s i it has bn inx. But th utility Wbmas-

    tr cntral gs ar byn URL submissin.

    Th bulk Ggls r utilitis in Wbmastr cntral an b un in Wb-

    mastr Tls (https://www.google.com/webmasters/tools/). Br yu

    an us Ggls Wbmastr Tls, yull n t rat a Ggl aunt i

    FiGuRe 10. GooglesWebmaster Central con-

    tains a wide variety of free

    and very useful utilities that

    provide statistics, diag-

    nostics, and management

    features.

  • 8/2/2019 Chap10 Free Tools

    9/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS

    yu nt alray ha n. Yu an manag sitmas an iw statistis r

    multil sits rm a singl aunt, whih is grat i yu ha t k tabs nmany lint wbsits.

    on yu lgg in yull b takn t th ashbar, whr yu an a

    yur sits URL in rr t iw ata abut it an manag sm rrns.

    Yull b rmt t riy that yu ha th authrity t manag th sit in

    n tw ways. Yu an ithr a a sial mta tag t yur hm ag

    with a alu uniqu t yur sit, r ula a sial il Ggl ris t

    yur srrs Wb rt lr. Whn yu mlt n ths tasks yusimly lik th riy buttn, an Ggl will isit yur sit immiatly t

    nirm that th mta tag r il is rsnt. on yu rn yu ar th

    wbmastr th sit, yu an start using Ggls tls.

    Wbmastr ToolsGgls Wbmastr Tls ar ii int i ky stins:

    n diagnstis

    n Statistis

    n Links

    n Sitmas

    n Tls

    Whn yu lg in t Wbmastr Tls an ha lik n a URL yu want t

    manag yull b takn t an riw ag that ris sm quik inrma-

    tin (s FiGuRe 10.).

    FiGuRe 10. The overview

    page in Googles Webmaster

    Tools provides quick access to

    statistics and information that isavailable within subsections.

  • 8/2/2019 Chap10 Free Tools

    10/20

    10 cHApTeR 10

    essntial inrmatin lik 404 rrrs, ags that wr rqust but tim

    ut, HTTp rrrs, r ags blk by yur robots.txt il an b iw at aglan n th riw ag. I any rrrs r issus nrn wr tt

    a link is ri t larn mr abut th rblm.

    Als n th riw ag yull in th at th last inx yur hm

    ag an iniatin whthr yur sits ntnt is in Ggls inx. This

    quik iw maks stting srius rblms asir. Lts xamin sm th

    mr tail aturs Ggls Wbmastr Tls.

    DiagnosticsIn th diagnstis stin yull in urthr tail abut trubl Ggl

    nuntr whil inxing yur sit (s FiGuRe 10.). Thr ar six tys

    rrrs an issus that Ggl lgs:

    n HTTP errors: srr niguratin rrrs, rbin irtris, t.

    n Not found: 404 rrrs

    n URLs not followed: any ags yu may ha iniat that wr nt t

    b inx

    n URLs restricted by robots.txt

    n URLs timed out: ags that wr rqust but ulnt b inx

    baus a slw ntwrk nntin, ti , r sm thrrasn

    n Unreachable URLs: ags list in yur sitemap.xml il but wr nt

    rahabl

    FiGuRe 10. You can

    pinpoint any problems

    Google encountered when

    crawling your website from

    the Diagnostics section of

    Webmaster Tools.

  • 8/2/2019 Chap10 Free Tools

    11/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS 11

    Yull nti in th diagnstis stin a sub-stin ntitl Mbil crawl.

    I yur sit is lir in a rmat sii t mbil is suh as cHTMLr WML, Ggl will still inx yur ntnt. Lk r issus inxing yur

    mbil ntnt hr.

    Statistics

    Statistis is rhas th mst intrsting th Wbmastr Tls (s

    FiGuRe 10.). It ntains a sris substins that shw ry intrsting

    ata abut what kywrs ar sning l yur way, what Ggl ss

    whn it rawls yur sit, inx stats, rawl stats, an stats n hw many -

    l ar subsribing t yur RSS s. Its a lt inrmatin, all whih an

    rally n yur ys t Ggls rsti yur sit.

    FiGuRe 10. The Statis-

    tics section of Googles

    Webmaster Tools provides

    plenty of detailed informa-tion about your site. You

    can learn what content

    Google perceives as impor-

    tant on your pages, what

    keywords or phrases are

    generating traffic to your

    site, and more.

    Top Sarch Qrs T Sarh Quris is an sially intrsting ara

    t xlr. Nt nly an yu larn what kywrs an hrass ar gnrating

    trai t yur sit, but yu an als s what yur ranking is r ah qury.

    Althugh its intrsting t isr in this ata th kywrs yu targt

    in yur sit, its n mr intrsting t isr ths that yu nr ha

    thught wul gnrat any trai. Yur likly t in sm rtty bizarr

    sarh hrass that ar irting l t yur sit! Wath this ara lsly

    r us n what ntnt yu shul xan r nhan n yur sit.

    Yu an islat an iw sgmnts th ata by ggrahi latin, r

    sarh ty inluing blg, imag, mbil, r Wb.What Googlbot Ss In th What Gglbt Ss stin yu an iw

    Ggls ranking kywrs an hrass in th ntnt yur sit. I yu

  • 8/2/2019 Chap10 Free Tools

    12/20

    1 cHApTeR 10

    nt s th kywrs yu riginally targt at th t th list, thn yull

    n t risit th kywr stratgis utlin in chatr 2, Marku Strat-gis, an chatr 4, crating cntnt that dris Trai, t try t imr

    thir rminn in yur ags.

    en mr intriguing in this stin is th listing kywrs thr l ha

    inlu in thir links t yur sit. Its rumr that this is n th mst sig-

    niiant atrs that Ggl wighs whn attmting t unrstan th ntnt

    a sit an assigning thir rritary pagRank. Unrtunatly thy nt

    ri links hr t th sits that ha rat inbun links t yur sit, butthy in th nxt stin th Wbmastr Tls. Wll xlr aitinal

    mths attaining inrmatin abut inbun links latr in this hatr.

    Th mr rrlatin yu an rat btwn th t kywrs in yur sit

    an th t kywrs in inbun link labls, th mr suss yull ha

    ahiing t rankings r ths wrs. cntrlling txt in yur sit is asy,

    but ntrlling it n thr ls sits is rtty tugh. I yu knw th l

    running sits that link t yurs, yu an always mak a rinly rqust that

    thy rwrit thir link labl t inlu yur targt kywrs.

    furthr wn th ag in this stin yull s a brakwn th tys

    ntnt that Ggl has rawl n yur sit, inluing HTML, XML, pdf,

    flash, lain txt, an thr rmats.

    Crawl Stats Th crawl Stats substin has lss inrmatin than thrs,

    but th ata is qually inrmati. Hr yull in th arag Ggl pag-Rank ags in yur sit, an yur t-rat ag r th ast thr mnths.

    ealuat th ag that ranks highst in yur sit t trmin what qualitis

    mak it stan ut r th thrs. Usually th quantity an quality inbun

    links rm rutabl sits will trmin whih ag ranks highst. As is-

    uss in chatr 4, aluabl ntnt will usually liit lnty inbun links.

    This is anthr imrtant bit inrmatin t mnitr r ias n what n-

    tnt is mst aluabl t yur auin.

    indx Stats Th Inx Stats stin ris sm links t run Ggl

    sarh quris using sarh ratrs that will ral inrmatin abut yur

    sit. Yu atually nt n t isit this stin Ggls Wbmastr Tls

    t iw this ata. Yu an simly sarh r yur URL r by any th

    llwing sarh ratrs in Ggls sarh bx t larn a littl abut hw

    thy inx yur sit:

    n sit: xaml.minx ags in yur sit

    n allinurl: xaml.mags that rr t yur sits URL

  • 8/2/2019 Chap10 Free Tools

    13/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS 1

    n link: xaml.mags that link t yur sit

    n ah: xaml.mth urrnt ah yur sitn in: xaml.minrmatin Ggl has abut yur sit

    n rlat: xaml.mags that ar similar t yur sit

    A wr warning: Th link ratr ris a rtty inmlt listing all

    inbun links t a sit. dnt ani i yu s a surrisingly shrt list rsults

    whn using this ratr. Th Links tl, whih wll tak a lk at shrtly, r-

    is a mrhnsi list with ry usul xtn ata. Yu an als usth allinurl ratr t s a mr mrhnsi list inbun links.

    Sbscrbr Stats Th inrmatin ri in th Subsribr Stats s-

    tin is ni, but ri a ry limit snasht th numbr l wh

    ha subsrib t yur sits RSS s. Ggl nly traks subsritins

    within its wn RSS aggrgatrs. I usrs ar subsribing t yur s in Blg-

    lins (http://bloglines.com), Ntibs (http://Netvibes.com ), r any thr

    RSS aggrgatr bsis ths rat by Ggl, yu wnt s this atarlt hr.

    Tak this inrmatin with a big grain salt. In chatr 13, Analyzing Yur

    Trai, wll tak a lk at fBurnrs (http://feedburner.com) subsri-

    tin statistis, whih ri a mr mlt snasht hw many l

    ar subsribing t an raing yur s.

    Links

    Th Links stin ris rally intrsting ata abut what sits ar linking

    t yurs, an whih ags in yur sit ar garnring th mst inbun links

    (s FiGuRe 10.).

    FiGuRe 10. Using the

    Links tool you can identify

    which pages in your site arereceiving the most inbound

    links, and what sites are

    linking to them.

  • 8/2/2019 Chap10 Free Tools

    14/20

    1 cHApTeR 10

    pags that ar riing many inbun links ar biusly riing yur aui-

    n with th ty ntnt thy in intrsting. Wath this inrmatin

    lsly s yu an trmin whih ags ar ular, an wrth xaning

    t gnrat n mr trai.

    Th Links stin als lists all th ags in yur sit that ha intrnal links

    t thr ags in yur sit. This is rimarily usul t trmin i yu ar

    rss-linking nugh t hl irulat trai thrugh th sit. Th mr tra-

    i irulatin yu an rat, th lngr yur usrs will stay n yur sit, an

    rhas mlt businss bjtis, lik mak a urhas r sign u r thmailing list.

    Sitemapsearlir in this hatr yu larn hw t rat a sitemap.xml il an sub-

    mit it t sarh ngins. priing sarh ngins with a sitma hls thm

    mr intlligntly inx yur ntnt.

    In th Sitmas stin Ggls Wbmastr Tls yu an st th URL

    r yur sitemap.xml il an mnitr its status (s FiGuRe 10.). I yur

    launhing a nw sit its a g ia t st yur sitma hr s yu an

    bsr any arsing rblms that Ggl might nuntr.

    FiGuRe 10. With the

    Sitemaps tool you can post

    the URL for your sitemapfile and monitor its status.

    Google will let you know if

    it runs into trouble reading

    your file.

    Bsis ltting yu knw i it nuntrs rrrs arsing yur sitma il, th

    Sitmas tl als tlls yu whn th il was last ra, an hw many URLs

    wr inlu. Yu an als ri a sarat sitemap.xml il i yu ha a

    mbil rsin yur sit.

  • 8/2/2019 Chap10 Free Tools

    15/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS 1

    Tools

    In th Tls stin (s FiGuRe 10.10), yu an analyz yur robots.txtil, manag th sit riiatin rss yu slt, st th rat at whih

    Ggl will rawl yur sit, in th rrr main nam rmat r yur

    sit, an rm rtain URLs rm Ggls inx.

    FiGuRe 10.10 The Tools

    section provides a host

    of useful preferences and

    utilities.

    Analyz robots.txt Yu an intiy ars rrrs in yur robots.txt il

    using th Analyz robots.txt tl. I Ggl has bn t yur sit an un arobots.txt il, yull s its ntnt n th ag hr. This tl als lts yu

    ntr URLs t ags n yur sit t tst whthr yur robots.txt il will r-

    nt Ggl rm inxing thm.

    Manag St Vrcaton I r sm rasn yu n t gt anthr lk

    at th mta tag r il nam Ggl is using t riy that yu ar th wnr

    th sit bing manag, yull in that inrmatin in th Manag Sit vriia-

    tin stin. Unrtunatly, thrs n way t swith riiatin mths.

    St Crawl Rat Yu an k tabs n th rquny an s at whih

    Ggl is rawling yur sit in th St crawl Rat stin. Inrmatin suh

    as th arag numbr ags n yur sit Ggl inxs r ay, th ar-

    ag numbr kilbyts wnla r ay, an th tim it taks Ggl t

    la yur ags an b un in this stin.

    Yull nti a ramati r in la tims i yu timiz yur sits rr-

    man as utlin in chatr 3, Srr-Si Stratgis. FiGuRe 10.11 shws

    a big hang in th tim it tk Ggl t rawl my sit br timizatin

    an atr.

  • 8/2/2019 Chap10 Free Tools

    16/20

    1 cHApTeR 10

    I yur sit sunly bms xtrmly ular, an banwith is mr a

    nrn than king Ggls inx urrnt, yu an thrttl bak th inx-

    ing rquny yur sit in this stin.

    St Prrrd Doman In chatr 3 yu larn that whn Ggl inxs

    sits, it ss URLs with an withut th ring www as ntirly irnt

    sits. Baus th URL htt://www.mysit.m might ha mr inbun links

    t it than htt://mysit.m, Ggl might assign it a highr pagRank n

    thugh ths URLs g t th sam sit. This is all th Ggl annial

    rblm.

    In th St prrr dmain stin, yu an tll Ggl t hs n URL

    rmat s it snt slit yur pagRank. chatr 3 ris anthr slutin

    t th rblm that uss Aahs mod_rewrite mul t rma all ag

    rqusts t a singl, nsliat rmat. Its nt a ba ia t bth tr yur bass with Ggl an thr sarh ngins as wll.

    enabl enhancd imag Sarch I yur oK with yur imags bing

    isr ia Ggls imag sarh, yu an hs t nabl nhan

    imag sarh. Imags an b lat ia thir il nams r alt txt, but

    Ggl has an n mr ingnius arah that maks thir imag sarh

    mr aurat.

    Ggl Imag Lablr (http://images.google.com/imagelabeler/) is an

    imag intiiatin rjt that rsnts luntrs with a ranm sris

    imags glan rm sits that ha nabl th nhan imag sarh

    tin. As luntrs iw ah imag, thy ri sriti mta ata that

    Ggls imag sarh uss t gnrat xtinally aurat rsults t qu-

    ris. Baus imag sarh is hugly ular, nabling this tin an gnr-

    at a lt trai t yur sit.

    Rmov uRLs I Ggl has inx ntnt n yur sit yu rathr

    it int, yu an submit a rqust t ha it rm in th Rm URLs

    FiGuRe 10.11 After opti-

    mizing my site, I saw an

    approximately 90 percentspeed increase in Googles

    indexing of my content.

    Before optimization

    After optimization

  • 8/2/2019 Chap10 Free Tools

    17/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS 1

    stin. o urs yu an blk inxing using robots.txt (s cha-

    tr 3, Srr-Si Stratgis) r th noindex mta tag (s chatr 2,

    Marku Stratgis). But nithr mth will immiatly rm a ag

    rm Ggls inx. Th ntnt wul nly b rm rm th inx n

    Ggl rturns t r-inx yur sit. I yu n smthing rm immi-

    atly, th Rm URLs stin is th la t it.

    Gttng ino Abot Yor St wthYahoo! St explorrSit exlrr is a r st tls that ri insight int hw Yah! is inx-

    ing yur sit (https://siteexplorer.search.yahoo.com/), an wh is linking t

    yur ags. Sit exlrr is als whr yu wul submit a sitemap.xml il t

    Yah! whn yu launh a nw wbsit.

    T us Sit exlrr yull n t rat a Yah! aunt, i yu ntalray ha n, thn authntiat yur sit llwing a similar rss as

    Ggls Wbmastr Tls. Yu an r a sit is yurs by aing a sial

    mta tag t yur hm ag r by ulaing a il Yah! ris t yur

    srrs Wb rt lr r authntiatin. on yu mlt n

    ths tasks yu an initiat Yah! t riy that yu ar th wnr th sit.

    frm th main ntrl anl ara all My Sits yu an a URLs yu

    lik t xlr, an k tabs n yur sits authntiatin status (sFiGuRe 10.1). Yu an lt Yah! knw th latin yur sitemap.xml il in

    th fs stin Sit exlrr, whih an b un by liking th Manag

    buttn nxt t yur URL.

    FiGuRe 10.1 You can

    manage and explore any

    number of sites in Yahoo!s

    Site Explorer.

    Rru with rmissin Yah! In. 2007 by Yah! In. YAHoo! an t h YAHoo! lg ar tramarks Yah! In

  • 8/2/2019 Chap10 Free Tools

    18/20

    1 cHApTeR 10

    In th fs stin, simly ntr th ath t yur sitma il n yur srr

    an Yah! will ra it, thn rawl yur sit (s FiGuRe 10.1). Hr yu an

    als in a sitma r a mbil rsin yur sit, i yu ha n. Th

    at an tim Yah! last ra an rss yur sitma il will b is-

    lay hr as wll.

    FiGuRe 10.1 You can let

    Yahoo! know the location

    of your Web and mobile

    sitemap.xml files in the

    Feeds section of Site

    Explorer.

    Rru with rmissin Yah! In. 2007 by Yah! In. YAHoo! an th YAHoo! lg ar tramarks Yah! In

    FiGuRe 10.1 Site Explorer

    lists all pages in your site

    that Yahoo! has indexed.Here you can also view a

    complete listing of sites that

    link to yours.

    Rru with rmissin Yah! In. 2007 by Yah! In. YAHoo! an th YAHoo! lg ar tramarks Yah! In

    Th ral hart Sit exlrr is th exlr tl, whih yu an ass by

    rturning t th My Sits ag, thn liking th exlr buttn t th right

    yur URL. Sit exlrr lists all th ags that Yah! has inx in

    yur sit (s FiGuRe 10.1). This is sially usul whn yu irst launh

    yur sit, as yu an k a ls y n what ntnt has iially ma it

    int th Yah! inx. Yu an als rm any ag rm Yah!s inx by

    liking th dlt URL/path buttn, whih is isibl whn yu hr r any

    ag rr.

    Yu an iw a mrhnsi list sits that link t yur ags by liking

    th link labl Inlinks at th t th ag. This is imrtant inrmatin, as

    th mr links rm rutabl surs yur sit ris th highr yur ag

  • 8/2/2019 Chap10 Free Tools

    19/20

    fRee SeARcH eNGINe TooLS ANd SeRvIceS 1

    rank will b. I yu ask rins, llagus, an ailiats t rat a link

    n thir sit t yurs, yu an wath this stin Sit exlrr t s whn

    Yah! has nti th nw inbun links.

    Sm sits try t ishnstly rat inbun links by blgging abut an link-

    ing t blg sts n high-ranking wbsits in rr t rat a trakbak. As

    xlain in chatr 5, Builing a finabl Wrprss Blg, a trakbak

    is an autmatially gnrat st xrt that will b islay unr a blg

    st whn anthr blg links t that st. Th trakbak will usually inlu a

    link t th sit that gnrat it.

    Sm blggrs may writ maninglss r unrlat sts with links t yur

    sit s thy an buil thir inbun links an sarh rankings ishnstly.

    I yu s inbun links t yur sit that lk lik sam whn brwsing Sit

    exlrr, yu an rrt thm t Yah! by hring r th rr an lik-

    ing th Rrt Sam buttn.

    Thrs a lt t b larn abut yur sit rm Sit exlrr. Its a g iat mnitr th ags inx an inbun links t yur sit n a rgular basis

    t nsur yur sit is isibl t yur auin ia Yah! sarh.

  • 8/2/2019 Chap10 Free Tools

    20/20