Transcript
  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 1/18

    Thissiteusescookies.MoreinfoCloseBycontinuingtobrowsethesiteyouareagreeingtoouruseofcookies.FindoutmorehereCloseCCBYNCOpenaccessResearch

    Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysisBMJ2013347doi:http://dx.doi.org/10.1136/bmj.f5298(Published12September2013)Citethisas:BMJ2013347:f5298

    ArticleRelatedcontentMetricsResponsesPeerreview

    BernardineHStegeman,researchassociate13,MarcosdeBastos,researchfellow2,FritsRRosendaal,professorofclinicalepidemiology3,AvanHylckamaVlieg,researchfellow4,FransMHelmerhorst,professorofclinicalepidemiologyoffertility25,TheoStijnen,professorofmedicalstatistics6,OlafMDekkers,researchfellow7

    Authoraffiliations

    Correspondenceto:[email protected]

    AbstractObjectiveToprovideacomprehensiveoverviewoftheriskofvenousthrombosisinwomenusingdifferentcombinedoralcontraceptives.

    DesignSystematicreviewandnetworkmetaanalysis.

    DatasourcesPubMed,Embase,WebofScience,Cochrane,CumulativeIndextoNursingandAlliedHealthLiterature,AcademicSearchPremier,andScienceDirectupto22April2013.

    ReviewmethodsObservationalstudiesthatassessedtheeffectofcombinedoralcontraceptivesonvenousthrombosisinhealthywomen.Theprimaryoutcomeofinterestwasafatalornonfatalfirsteventofvenousthrombosiswiththemainfocusondeepvenousthrombosisorpulmonaryembolism.Publicationswithatleast10eventsintotalwereeligible.Thenetworkmetaanalysiswasperformedusinganextensionoffrequentistrandomeffectsmodelsformixedmultipletreatmentcomparisons.Unadjustedrelativeriskswith95%confidenceintervalswerereported.Therequirementforcrudenumbersdidnotallowadjustmentforpotentialconfoundingvariables.

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 2/18

    Results3110publicationswereretrievedthroughasearchstrategy25publicationsreportingon26studieswereincluded.Incidenceofvenousthrombosisinnonusersfromtwoincludedcohortswas1.9and3.7per10000womanyears,inlinewithpreviouslyreportedincidencesof16per10000womanyears.Useofcombinedoralcontraceptivesincreasedtheriskofvenousthrombosiscomparedwithnonuse(relativerisk3.5,95%confidenceinterval2.9to4.3).Therelativeriskofvenousthrombosisforcombinedoralcontraceptiveswith3035gethinylestradiolandgestodene,desogestrel,cyproteroneacetate,ordrospirenoneweresimilarandabout5080%higherthanforcombinedoralcontraceptiveswithlevonorgestrel.Adoserelatedeffectofethinylestradiolwasobservedforgestodene,desogestrel,andlevonorgestrel,withhigherdosesbeingassociatedwithhigherthrombosisrisk.

    ConclusionAllcombinedoralcontraceptivesinvestigatedinthisanalysiswereassociatedwithanincreasedriskofvenousthrombosis.Theeffectsizedependedbothontheprogestogenusedandthedoseofethinylestradiol.

    IntroductionShortlyaftertheintroductionofthefirstcombinedoralcontraceptive(containinganoestrogenandaprogestogen),acaseofvenousthrombosisassociatedwithcontraceptiveusewasreported.1Sincethen,manyobservationalstudieshaveshownthatcombinedoralcontraceptivesareassociatedwithatwofoldtosixfoldincreasedriskofvenousthrombosis.2345Despitethelowincidenceofvenousthrombosisaboutthreeper10000womanyearsamongwomenofreproductiveage,6theeffectofcombinedoralcontraceptivesonvenousthrombosisislarge,owingtothefactthatmanywomenuseoralcontraceptives.

    Becausetheoestrogencompound(ethinylestradiol)incombinedoralcontraceptiveswasthoughttocausetheincreasedriskinthrombosis,thedoseofethinylestradiolwasloweredfrom150100gintheearliestbrandsto50ginthe1960s,andto3035gand20ginthe1970s.789Thereduceddoseofethinylestradiolincontraceptiveswasindeedassociatedwithareductionintheriskofvenousthrombosis.1011121314Apartfromadjustmentsinthedoseofethinylestradiol,theprogestogencompoundwasalsochangedinanefforttoreducesideeffects.Afterthefirstgenerationprogestogens(thatis,norethisteroneandlynestrol),newprogestogensweredeveloped.Thesenewcompoundswerecalledsecondgeneration(thatis,levonorgestrel)andthirdgenerationprogestogens(thatis,gestodene,desogestrel,norgestimate).15However,usersofcombinedoralcontraceptiveswiththirdgenerationprogestogenshaveahigherriskofvenousthrombosisthanthoseusingsecondgenerationprogestogens.16171819Otherprogestogenshavebeendevelopedaftertheintroductionofthirdgenerationprogestogensthatis,drospirenone(introducedin2001).Thethrombosisriskforcontraceptiveswithdrospirenonewasfoundtobehigherthanforcombinedoralcontraceptiveswithsecondgenerationprogestogens.2021

    Thepresentnetworkmetaanalysisaimedtoprovideanoverviewoftheriskofvenousthrombosispercombinedoralcontraceptiveinhealthywomen,andassesstheeffectofthegenerationofprogestogenused.Weperformedanetworkmetaanalysisbecausecombinedoralcontraceptivesaremostlycomparedwithnonuseorwithacontraceptivecontaininglevonorgestrelwith30gethinylestradiol.Thesecomparisonsresultedingapsindirectevidence,becausenoteverycombinedoralcontraceptivewasdirectlycomparedwithotherpossiblecombinedoralcontraceptives.Anetworkmetaanalysisallowsevidencefromdirectandindirectcomparisonstobesummarisedinaweightedaverageforallpossible

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 3/18

    comparisons.

    MethodsSearchstrategyandselectioncriteriaPublicationsofinterestwereobservationalstudies(cohortor(nested)casecontrolstudies)thatincludedhealthywomenusingcombinedoralcontraceptives.Theprimaryoutcomeofinterestwasafatalornonfatalfirsteventofvenousthrombosiswiththemainfocusondeepvenousthrombosisorpulmonaryembolism.Publicationswithaminimumof10eventsintotalwereeligible.

    Thefollowingdatabasesweresearched:PubMed(984articlesretrieved),Embase(1339),WebofScience(306),Cochrane(57),CumulativeIndextoNursingandAlliedHealthLiterature(122),AcademicSearchPremier(197),andScienceDirect(105).OursearchtermsconsistedofMeSHheadingsandsubheadings,textwords,andwordvariationsforcombinedoralcontraceptive,estrogens,progestogens,andvenousthromboembolism.Thissearchstrategywasamendedforeachdatabase.Wesearchedeachdatabasefrominceptionuntil22April2013(dateoffinalsearch).Nolanguagerestrictionwasapplied.Inadditiontodatabasesearches,wecheckedreferencesofpotentialinterestingpublications.

    Astandardformwasusedtoselectpublications.Twoinvestigators(BHS,MdB)independentlyassessedpublicationsforeligibility.Titlesandabstractswerescreenedandifdeemedpotentiallyrelevant,fulltextarticleswereretrieved.Anydisagreementsbetweentheinvestigatorswerediscussedandifnecessary,athirdreviewer(OMD)wasaskedtoresolvedisagreements.Incaseofmultiplepublicationsfromthesamestudy,thepublicationwiththemostupdatedorthemostinclusivedatawasincluded.Webappendix1showsdetailsofthesearchstrategy.

    DatacollectionTwoinvestigators(BHSandMdB)independentlyextracteddatausingastandardform.Datawereextractedontypeofcombinedoralcontraceptive(doseandtypeofoestrogenandprogestogen),crudenumbersforexposureandoutcome,crudeandadjustedriskestimates,andvariablesadjustedforintheanalysis.Incaseofincompletedatafordoseortypeofoestrogenorprogestogen,authorswereapproachedforextrainformation.Intotal,10authorsweresentanemailon25July2012andifnecessary,areminderon20August2012.Oftheseauthors,80%repliedtoouremails.Ifprovided,datafortheabsolutethrombosisriskinnonuserswereextractedfromthecohortstudies.Forsensitivityanalyses,dataforthefundingsourceandfirsttimeusewereabstracted.

    Riskofbiasassessmentwasbasedondesignfeaturesthatcouldpotentiallybiastheassociationbetweenexposureandoutcome.Weassessedadequacyofexposure(oralcontraceptive)andoutcome(venousthrombosis)measurement,losstofollowup(cohortstudies),andadequacyofcontrolselection(casecontrolstudies).Womenaremorelikelytorememberthattheyusedoralcontraceptivesthanwhatspecificpreparationtheyused.2223Therefore,assessmentofthetypeofcombinedoralcontraceptivethroughanintervieworquestionnairewasclassifiedashighriskofbias,andinformationfromaprescriptiondatabaseaslowrisk.Only2533%ofpatientspresentingwithclinicalsymptomssuggestiveofvenousthrombosisareobjectivelydiagnosedwithvenousthrombosis.24Therefore,studieswithobjectiveconfirmationinallpatientswerejudgedaslowriskofbias.Venousthrombosiswasconsideredobjectivelyconfirmedwhenadeepvenousthrombosiswasdiagnosedbyplethysmography,ultrasoundexamination,computed

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 4/18

    tomography,orvenographyorwhenpulmonaryembolismwasdiagnosedbyventilationperfusionscanning,spiralcomputedtomography,orpulmonaryangiography.2526Lessthan10%losstofollowupwasconsideredtorepresentalowriskofbias.Forcasecontrolstudies,controlsselectedfromhospitalpopulationswasconsideredtoconferahighriskofbias.27

    ClassificationoftypeofcombinedoralcontraceptiveThereisnogenerallyacceptedwaytoclassifycombinedoralcontraceptivesaccordingtogenerationsofprogestogens.Inthisanalysis,themostcommonclassificationsystemwasused,whichisinlinewithbiologicalpropertiespergroupandisreflectedintheireffectsonlevelsofsexhormonebindingglobulin.2829Fortheaimofthepresentnetworkmetaanalysispergenerationofprogestogen,thefollowingprogestogenswereclassifiedasfirstgenerationlynestrenolandnorethisterone.Norgestrelandlevonorgestrelwerecategorisedassecondgenerationprogestogensanddesogestrel,gestodene,andnorgestimatewereclassifiedasthirdgenerationprogestogens.15Thisclassificationwasirrespectiveofethinylestradioldose.Publicationsreportingongenerationsaccordingtoanotherclassificationwereincluded.Toassesstheinfluenceofcombiningdifferentclassifications,weperformedananalysisrestrictedtostudiesusingtheabovedescribedclassification.

    Manydifferentcombinedoralcontraceptivesareavailable.Weselected10frequentlyprescribedoralcontraceptivesforthenetworkmetaanalysis:

    20gethinylestradiolwithlevonorgestrel(20LNG)

    30gethinylestradiolwithlevonorgestrel(30LNG)

    50gethinylestradiolwithlevonorgestrel(50LNG)

    20gethinylestradiolwithgestodene(20GSD)

    30gethinylestradiolwithgestodene(30GSD)

    20gethinylestradiolwithdesogestrel(20DSG)

    30gethinylestradiolwithdesogestrel(30DSG)

    35gethinylestradiolwithnorgestimate(35NRG)

    35gethinylestradiolwithcyproteroneacetate(35CPA)

    30gethinylestradiolwithdrospirenone(30DRSP)

    Wecategorised20LNG,30LNG,and50LNGassecondgenerationprogestogens,and20GSD,30GSD,20DSG,30DSG,and35NRGasthirdgenerationprogestogens.35CPAand30DRSPwerenotusedinthisclassificationbygenerations.

    StatisticalanalysisAnetworkmetaanalysiswasconductedpergenerationofprogestogeninacombinedoralcontraceptiveandperselectedoralcontraceptivepreparation.Weusedanextensionoffrequentistrandomeffects

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 5/18

    modelsformixedmultipletreatmentcomparisons.ThenetworkmetaanalysiswasperformedwiththemvmetacommandforStata,asdescribedbyWhiteandcolleagues.30Weusedcrudedatafroma22tableintheanalysis.Oddsratios,riskratios,orrateratiosandappropriatevarianceswerecomputedandcombinedintheanalysisleadingtoanoverallrelativerisk.Forpublicationswithzeroeventsinonecellofa22table,allcellsofthat22tablewereinflatedbyadding0.5.Ifmorethanonestudyprovideddataforthesamestratum(thatis,dataforgenerationsofprogestogenoronspecificcontraceptivepreparations),wecheckedconsistencyoftheresults.Aninteractiontermwasaddedtothemodeltoestimatethedifferenceinresultsfromdirectandindirectevidence.Allpotentialinteractionsweretestedinanoveralltesttodeterminewhethertherewereanyinconsistenciesinournetworkmetaanalysis.

    Thefollowingsensitivityanalyseswereplanned:perstudydesign,perfundingsource(whetherindustrysponsoredornot),withinfirsttimeusers,andaccordingtoriskofbias.AllstatisticalanalyseswereperformedwithStata,version12.0(StatacorpLP).

    ResultsCharacteristicsofincludedstudiesOf3110publicationsretrievedthroughelectronicandreferencessearches,2144wereexcludedafterscreeningthetitleandabstractand81wereexcludedafterdetailedassessmentofthefulltext(fig1webtable1providesreasonsforexclusion).Overall,26studiesreportedin25articleswereincluded(onearticle10presentedtwostudies).Twopublicationsprovidedimportantadditionalinformationtostudiesincludedinthemetaanalysis(informationonfirsttimeuse)datafromthesepublicationswereaddedtotherespectivestudiesalreadyincluded.Table1showsdetailsofincludedstudies.Ninecohortstudies,threenestedcasecontrolstudies,and14casecontrolstudieswereincluded.

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 6/18

    Fig1Flowdiagramofincludedandexcludedpublications

    DownloadfigureOpeninnewtab

    Downloadpowerpoint

    Viewthistable:

    ViewpopupViewinline

    Table1Characteristicsofincludedstudies

    Twostudiesreportedtheabsoluteriskofvenousthrombosisinnonusers:1.9and3.7per10000womanyears.Basedondatafrom15studiesthatincludedanonusergroup,useofcombinedoralcontraceptiveswasfoundtoincreasetheriskofvenousthrombosisfourfold(relativerisk3.5,95%confidenceinterval2.9to4.3).

    RiskofbiasEightstudiesassessedcombinedoralcontraceptiveusethroughanintervieworquestionnaire(webtable2).Onlyfivestudiesobjectivelyconfirmedvenousthrombosisinallpatients,whereas14studiesobjectivelyconfirmedvenousthrombosisinaproportionofthepopulationorsubjectivelyconfirmedvenousthrombosis.Fivecasecontrolstudiesselectedcontrolsfromapopulationinhospitalcare.Ofthenine

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 7/18

    Viewthistable:

    ViewpopupViewinline

    cohortstudies,noneprovidedinformationaboutlosstofollowup.

    NetworkmetaanalysiscomparinggenerationsofprogestogensAtotalof23studieswereincludedfortheanalysisstratifiedpergenerationofprogestogen.Threestudiesreportedsolelyontheriskofvenousthrombosisindrospirenone,whichisnotclassifiedasagenerationofprogestogen.Webtable3providesdetailsofthenumberofeventsandtotalnumberofwomenortotalfollowuptimepergeneration,andwebtable4providesthestudyspecificadjustedriskestimates.

    Table2showsresultsofthenetworkmetaanalysisaccordingtogenerationsofprogestogen.Comparedwithnonusers,theriskofvenousthrombosisinusersoforalcontraceptiveswithafirstgenerationprogestogenincreased3.2fold(95%confidenceinterval2.0to5.1),2.8fold(2.0to4.1)forsecondgenerationprogestogens,and3.8fold(2.7to5.4)forthirdgenerationprogestogens.Theriskofvenousthrombosisinsecondgenerationprogestogenuserswassimilartotheriskinfirstgenerationusers(relativerisk0.9,0.6to1.4).Thirdgenerationusershadaslightlyhigherriskthansecondgenerationusers(1.3,1.0to1.8).Restrictedtostudieswithanidenticalclassificationofgenerations(seemethodssectionforclassificationused),theresultsofeachgenerationcomparedwithnonuseremainedthesame(firstgenerationrelativerisk3.2,95%confidenceinterval1.6to6.4secondgeneration2.6,1.5to4.7thirdgeneration3.5,2.0to6.1).Aformalinteractiontestdidnotshowinconsistenciesinthenetwork( =2.97,P=0.71).

    Table2Networkmetaanalysis,bygenerationofprogestogenusedincombinedoralcontraceptives

    NetworkmetaanalysiscomparingdifferentcombinedoralcontraceptivesOf14studiesprovidingdatapertypeoforalcontraceptive(webtables5and6),atleastonepreparationwascomparedwithnonuseortwotypeswerecompareddirectly.Table3showsresultsoftheanalysis.Allpreparationswereassociatedwithamorethantwofoldincreasedriskofvenous

    thrombosiscomparedwithnonuse(fig2).Therelativeriskestimatewashighestin50LNGusersandlowestin20LNGand20GSDusers.Adoserelatedeffectwasobservedforgestodene,desogestrel,andlevonorgestrel,withhigherdosesbeingassociatedwithhigherthrombosisrisk.Theriskofvenousthrombosisfor35CPAand30DRSPwassimilartotheriskfor30DSG(relativerisk0.9,95%confidenceinterval0.6to1.3and0.9,0.7to1.3,respectively,comparedwith30DSG).Aformalinteractiontestcouldnotbeperformedbecauseonlytwoof14studiesprovideddataforexactlythesamecontraceptives.

    2

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 8/18

    Fig2Networkmetaanalysis,percontraceptiveplottedonalogarithmicscale.20LNG=20gethinylestradiolwithlevonorgestrel30LNG=30gethinylestradiolwithlevonorgestrel50LNG=50gethinylestradiolwithlevonorgestrel20GSD=20gethinylestradiolwithgestodene30GSD=30gethinylestradiolwithgestodene20DSG=20gethinylestradiolwithdesogestrel30DSG=30gethinylestradiolwithdesogestrel35NRG=35gethinylestradiolwithnorgestimate35CPA=35gethinylestradiolwithcyproteroneacetate30DRSP=30gethinylestradiolwithdrospirenonedots(lines)=overallrelativerisk(95%confidenceinterval)ofvenousthrombosisnonuse=reference

    group

    DownloadfigureOpeninnewtab

    Downloadpowerpoint

    Viewthistable:

    ViewpopupViewinline

    Table3Networkmetaanalysis,bycombinedoralcontraceptivepill

    SensitivityanalysesWeperformedsensitivityanalysesaccordingtofundingsource,studydesign,andmethodofdiagnosisconfirmation(objectivevsubjectiveconfirmationofvenousthrombosis).Table4showssensitivityanalysesperformedaccordingtogenerationofprogestogen.Resultsfromthe

    sensitivityanalysisstratifiedbyfundingsourceshowedthattheriskestimateforthirdgenerationusers(comparedwithnonusers)waslowerinindustrysponsoredstudiesthaninnonindustrysponsoredstudies(relativerisk1.9v5.2).Incohortstudies,theriskestimateforthirdgenerationusers(comparedwithnonusers)waslowerthantheriskforthirdgenerationusersincasecontrolstudies(2.0v4.2).Allriskestimateswerehigherinstudieswithobjectivelyconfirmedvenousthrombosis,ofwhichnonewereindustrysponsored.

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 9/18

    Viewthistable:

    ViewpopupViewinline

    Table4Sensitivityanalyses

    DiscussionWeperformedanetworkmetaanalysisbasedon26studies.Overall,combinedoralcontraceptiveuseincreasedtheriskofvenousthrombosisfourfold.Thereportedincidenceofvenousthrombosisinnonuserswasinlinewiththeliterature.Weobservedthatallgenerationsofprogestogenswereassociatedwithanincreasedriskofvenousthrombosisandthatthirdgenerationusershadaslightincreasedriskcomparedwithsecondgenerationusers.Allindividualtypesofcombinedoralcontraceptivesincreasedthrombosisriskcomparedwithnonusemorethantwofold.Thehighestriskofvenousthrombosiswasfoundamong50LNGusers,andtheriskwassimilarin30DRSP,35CPA,and30DSGusers.Usersof30LNG,20LNG,and20GSDhadthelowestthrombosisrisk.

    StrengthsandlimitationsAnetworkmetaanalysissummarisesdatafromdirectandindirectcomparisonsinaweightedaverage.Inthepresentstudy,thisresultedinacomprehensiveoverviewoftheriskofvenousthrombosisinfrequentlyprescribedcombinedoralcontraceptives.Theinternalvalidityofthenetworkmetaanalysiswasassessedthroughinteractionanalysismodellingpotentialinconsistenciesinthenetwork.30Ourresultsoftheanalysisbasedongenerationsofprogestogensindicatedthatpotentialinconsistenciesarelikelytheresultofchance.

    Alimitationofournetworkmetaanalysiswasthatpublicationshadtoprovidethecrudenumberofusersandnumberofeventspertypeofcombinedoralcontraceptive.Atotalof15studiesprovidedinformationoncombinedoralcontraceptiveuseandthrombosisriskwithoutspecificationofwhichcontraceptivepreparationswereused.Thesestudiescouldthereforenotbeincluded.Becauseoftheneedforcrudenumbersinthenetworkmetaanalysis,adjustedriskestimateswerenotusedforpoolingthedata.Confoundingcouldhaveinfluencedourresults.Ageisapotentialconfounderfortheassociationbetweencontraceptiveuseandvenousthrombosis.Womenusingsecondgenerationcontraceptivesaregenerallyolderthanusersofthirdgenerationcontraceptives.Ifananalysisisnotadjustedforage,therelativeriskwillthenunderestimatetheriskofvenousthrombosisinusersofthirdgenerationcontraceptivescomparedwithusersofsecondgenerationcontraceptives.Thisimpliesthattheriskofthirdgenerationusersmaybehigherthanreportedhere.However,agewasoftendealtwithinthedesignofthestudies.Bodymassindexisonlyweaklyassociatedwithcombinedoralcontraceptiveuse,andanalysesunadjustedforbodymassindexareprobablynotconfounded.

    Thereisnogenerallyacceptedwaytoclassifyoralcontraceptivesaccordingtogenerationsofprogestogens.Forinstance,norgestimatecanbecategorisedasasecondorathirdgenerationprogestogen.Asaconsequence,theclassificationofthesegenerationswasnotthesameinevery

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 10/18

    publication.However,theresultsdidnotmateriallychangewhenrestrictedtostudieswithanidenticalclassificationofgenerationsasdescribedinthemethodsnorwhencontraceptiveswithdesogestrelorgestodenewerecomparedwithlevonorgestrel(thatis,norgestimatewasnottakenintoaccountwhenclassifyingcontraceptivesintogenerations)(datanotshown).

    Intheclassificationofprogestogengenerationsusedinthismetaanalysis,thedoseofethinylestradiolwasnottakenintoaccount.Theobservedincreasedriskinthirdgenerationcontraceptives,comparedwithsecondgenerationcontraceptives,cannotbeexplainedbyadifferenceinethinylestradioldosebecauseahigherdoseofethinylestradiol(50g)canbepresentinasecondgenerationcontraceptivebutnotinathirdgenerationcontraceptive.

    Inonlyafewincludedstudies,venousthrombosiswasobjectivelyconfirmedinallpatients.Onlyabout30%ofpatientswithclinicalsymptomsofthrombosisarediagnosedwithvenousthrombosis.24Includingpatientswithoutobjectivelyconfirmedvenousthrombosiswouldleadtooverestimatingtheassociationwhenoralcontraceptivesusersweremorelikelytobediagnosedthannonusers(diagnosticsuspicionbias).However,twostudiesshowedthatthisbiaswasindependentoftypeoforalcontraceptive.1852Instudieswithoutobjectiveconfirmation,womenweremisclassifiedirrespectiveoftheircontraceptiveuse,leadingtonondifferentialmisclassification.Therefore,resultsofsuchstudiesmayunderestimatethetrueassociation,whichwasconfirmedbyoursensitivityanalysiswheretheriskestimateswerehigherinstudieswithobjectivelyconfirmedvenousthrombosisthaninthosewithoutanobjectiveconfirmation.

    Twoothermetaanalyses1853haveevaluatedtheriskofvenousthrombosiscomparingthirdgenerationcontraceptiveuserswithsecondgenerationusers.Bothstudiesfoundanincreasedriskinthirdgenerationusers(relativerisk1.5,95%confidenceinterval1.2to1.8181.57,1.24to1.9853),whichareinlinewithourresults.Themajorityofincludedstudiesfrombothmetaanalyseswereincludedinouranalysis.

    ClinicalimplicationsofthestudyAlthoughweobservedthattheriskofvenousthrombosisincreasedwiththedoseofethinylestradiol,thisseemedtodependontheprogestogenprovided.Therewasnodifferenceinthevenousthrombosisriskbetween20LNGand30LNG,whereasadifferenceintheriskwasobservedbetween20DSGand30DSG,forexample.Itisunclearwhythedoseeffectofethinylestradiolmightdependontheprogestogen.Apossibilityisthatthereisadifferenceininhibitoryeffectsoftheprogestogenontheprocoagulanteffectofethinylestradiol.OralcontraceptiveuseincreasesthelevelsoffactorsII,VII,VIII,proteinC,anddecreasesthelevelsofantithrombin,tissuefactorpathwayinhibitor,andproteinS.Clinicalstudieshaveshowedthatthiseffectoncoagulationfactorswasmorepronouncedindesogestrelusersthaninlevonorgestrelusers,andlimitedtocombinedoralcontraceptives.5455

    Combiningdifferentpreparationsoforalcontraceptiveintogenerationsofprogestogensmaynotbeanappropriatewaytopresenttheriskofthrombosis,becausetheriskdependsonthedoseofethinylestradiolaswellasontheprogestogenprovided.Wesuggestabstainingfromanyclassificationofcontraceptives,buttocomparetheriskofvenousthrombosisperoralcontraceptivepreparation.

    Itshouldbekeptinmindthatallcombinedoralcontraceptivesincreasetheriskofvenousthrombosis,whichisnotthecaseforthelevonorgestrelintrauterinedevice.56However,ifawomanprefersusingcombinedoralcontraceptives,onlycontraceptiveswiththelowestriskofvenousthrombosisandgood

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 11/18

    complianceshouldbeprescribed,suchaslevonorgestrelwith30gethinylestradiol.Currentpracticeistoincreasethedoseofethinylestradiolincaseofdisruptionsinbleedingpatterns.57Ourresultsindicatethatprescribing50LNGincaseofspottingduringtheuseof30LNGmightcarryaseriousriskforvenousthrombosis.

    WhatisalreadyknownonthistopicCombinedoralcontraceptiveuseincreasestheriskofvenousthrombosis

    Despitethelowincidenceofvenousthrombosis,theriskinwomenusingcombinedoralcontraceptivesisarealconcernbecauseofthewidespreaduseofthesecontraceptives

    WhatthispaperaddsRiskofvenousthrombosisforcombinedoralcontraceptiveswith3035gethinylestradiolandgestodene,desogestrel,cyproteroneacetateanddrospirenoneweresimilar,andabout5080%higherthanwithlevonorgestrel

    Thecombinedoralcontraceptivewiththelowestpossibledoseofethinylestradiolandgoodcomplianceshouldbeprescribedthatis,30gethinylestradiolwithlevonorgestrel

    NotesCitethisas:BMJ2013347:f5298

    Footnotes

    Contributors:BHS,MdB,FMH,andOMDdevelopedthestudydesign.BHSandMdBindependentlyselectedthepublicationsandextracteddata.BHS,TS,andOMDperformedthestatisticalanalysis.Allauthorsinterpretedthedataandcriticallyrevieweddraftsofthemanuscript.BHSisguarantor.

    Funding:Thisstudyreceivednospecificfunding.BHSwassupportedbygrant40008129807045fromtheNetherlandsOrganizationforScientificResearch.MdBwassupportedbygrantfromCapesNuffic,Brazil.Thefundingagencieshadnoroleinthestudydesign,implementation,orpreparationofresults.

    Competinginterests:AllauthorshavecompletedtheICMJEuniformdisclosureformatwww.icmje.org/coi_disclosure.pdfanddeclare:nosupportfromanyorganisationforthesubmittedworkBHSwassupportedbytheNetherlandsOrganizationforScientificResearchMdBwassupportedbyagrantfromCapesNuffic,Brazilnootherrelationshipsoractivitiesthatcouldappeartohaveinfluencedthesubmittedwork.

    Ethicalapproval:Notrequired.

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 12/18

    Datasharing:Noadditionaldataavailable.

    ThisisanOpenAccessarticledistributedinaccordancewiththeCreativeCommonsAttributionNonCommercial(CCBYNC3.0)license,whichpermitsotherstodistribute,remix,adapt,builduponthisworknoncommercially,andlicensetheirderivativeworksondifferentterms,providedtheoriginalworkisproperlycitedandtheuseisnoncommercial.See:http://creativecommons.org/licenses/bync/3.0/.

    References1.JordanW.Pulmonaryembolism.Lancet1961278:11467.

    2.Oralcontraceptionandthromboembolicdisease.JRCollGenPract196713:26779. Medline

    3.InmanWH,VesseyMP.Investigationofdeathsfrompulmonary,coronary,andcerebralthrombosisandembolisminwomenofchildbearingage.BMJ19682:1939. FREEFullText

    4.SartwellPE,MasiAT,ArthesFG,GreeneGR,SmithHE.Thromboembolismandoralcontraceptives:anepidemiologiccasecontrolstudy.AmJEpidemiol196990:36580. Abstract/FREEFullText

    5.VesseyMP,DollR.Investigationofrelationbetweenuseoforalcontraceptivesandthromboembolicdisease.Afurtherreport.BMJ19692:6517. Abstract/FREEFullText

    6.NaessIA,ChristiansenSC,RomundstadP,CannegieterSC,RosendaalFR,HammerstromJ.Incidenceandmortalityofvenousthrombosis:apopulationbasedstudy.JThrombHaemost20075:6929. CrossRef MedlineWebofScience

    7.ThorogoodM,VillardMackintoshL.Combinedoralcontraceptives:risksandbenefits.BrMedBull199349:12439. Abstract/FREEFullText

    8.WhartonC,BlackburnR.Lowerdosepills.PopulationRep198816:131.

    9.StolleyPD,TonasciaJA,TockmanMS,SartwellPE,RutledgeAH,JacobsMP.Thrombosiswithlowestrogenoralcontraceptives.AmJEpidemiol1975102:197208. Abstract/FREEFullText

    10.Venousthromboembolicdiseaseandcombinedoralcontraceptives:resultsofinternationalmulticentrecasecontrolstudy.WorldHealthOrganizationCollaborativeStudyofCardiovascularDiseaseandSteroidHormoneContraception.Lancet1995346:157582. CrossRef Medline WebofScience

    11.InmanWH,VesseyMP,WesterholmB,EngelundA.Thromboembolicdiseaseandthesteroidalcontentoforalcontraceptives.AreporttotheCommitteeonSafetyofDrugs.BMJ19702:2039. Abstract/FREEFullText

    12.VesseyM,MantD,SmithA,YeatesD.Oralcontraceptivesandvenousthromboembolism:findingsinalargeprospectivestudy.BrMedJ(ClinResEd)1986292:526. FREEFullText

    13.LidegaardO,EdstromB,KreinerS.Oralcontraceptivesandvenousthromboembolism:afiveyearnationalcasecontrolstudy.Contraception200265:18796. CrossRef Medline WebofScience

    14.MeadeTW,GreenbergG,ThompsonSG.Progestogensandcardiovascularreactionsassociatedwithoralcontraceptivesandacomparisonofthesafetyof50and30microgramoestrogenpreparations.BMJ1980280:115761. Abstract/FREEFullText

    15.HenzlMR,EdwardsJA.Pharmacologyofprogestins:17alphahydroxyprogesteronederivativesandprogestinsofthefirstandsecondgeneration.In:SitrukWareRL,MishellDRJr,eds.Progestinsandantiprogestinsinclinicalpractice.MarcelDekker,2000:10132.

    16.LidegaardO,LokkegaardE,SvendsenAL,AggerC.Hormonalcontraceptionandriskofvenous

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 13/18

    thromboembolism:nationalfollowupstudy.BMJ2009339:b2890. Abstract/FREEFullText

    17.vanHylckamaVliegA,HelmerhorstFM,VandenbrouckeJP,DoggenCJ,RosendaalFR.Thevenousthromboticriskoforalcontraceptives,effectsofoestrogendoseandprogestogentype:resultsoftheMEGAcasecontrolstudy.BMJ2009339:b2921. Abstract/FREEFullText

    18.KemmerenJM,AlgraA,GrobbeeDE.Thirdgenerationoralcontraceptivesandriskofvenousthrombosis:metaanalysis.BMJ2001323:1314. Abstract/FREEFullText

    19.VandenbrouckeJP,RosingJ,BloemenkampKW,MiddeldorpS,HelmerhorstFM,BoumaBN,etal.Oralcontraceptivesandtheriskofvenousthrombosis.NEnglJMed2001344:152735. CrossRef MedlineWebofScience

    20.JickSS,HernandezRK.Riskofnonfatalvenousthromboembolisminwomenusingoralcontraceptivescontainingdrospirenonecomparedwithwomenusingoralcontraceptivescontaininglevonorgestrel:casecontrolstudyusingUnitedStatesclaimsdata.BMJ2011342:d2151. Abstract/FREEFullText

    21.ParkinL,SharplesK,HernandezRK,JickSS.Riskofvenousthromboembolisminusersoforalcontraceptivescontainingdrospirenoneorlevonorgestrel:nestedcasecontrolstudybasedonUKGeneralPracticeResearchDatabase.BMJ2011342:d2139. Abstract/FREEFullText

    22.NischanP,EbelingK,ThomasDB,HirschU.Comparisonofrecalledandvalidatedoralcontraceptivehistories.AmJEpidemiol1993138:697703. Abstract/FREEFullText

    23.NorellSE,BoethiusG,PerssonI.Oralcontraceptiveuse:interviewdataversuspharmacyrecords.IntJEpidemiol199827:10337. Abstract/FREEFullText

    24.WellsPS,HirshJ,AndersonDR,LensingAW,FosterG,KearonC,etal.Accuracyofclinicalassessmentofdeepveinthrombosis.Lancet1995345:132630. CrossRef Medline WebofScience

    25.GoodacreS,SampsonF,StevensonM,WailooA,SuttonA,ThomasS,etal.Measurementoftheclinicalandcosteffectivenessofnoninvasivediagnostictestingstrategiesfordeepveinthrombosis.HealthTechnolAssess200610:1168. Medline WebofScience

    26.QaseemA,SnowV,BarryP,HornbakeER,RodnickJE,TobolicT,etal.Currentdiagnosisofvenousthromboembolisminprimarycare:aclinicalpracticeguidelinefromtheAmericanAcademyofFamilyPhysiciansandtheAmericanCollegeofPhysicians.AnnFamMed20075:5762. Abstract/FREEFullText

    27.GrimesDA,SchulzKF.Comparedtowhat?Findingcontrolsforcasecontrolstudies.Lancet2005365:142933.CrossRef Medline WebofScience

    28.RapsM,HelmerhorstF,FleischerK,ThomassenS,RosendaalF,RosingJ,etal.Sexhormonebindingglobulinasamarkerforthethromboticriskofhormonalcontraceptives.JThrombHaemost201210:9927. CrossRefMedline

    29.vanVlietHA,FrolichM,ChristellaM,ThomassenLG,DoggenCJ,RosendaalFR,etal.AssociationbetweensexhormonebindingglobulinlevelsandactivatedproteinCresistanceinexplainingtheriskofthrombosisinusersoforalcontraceptivescontainingdifferentprogestogens.HumReprod200520:5638. Abstract/FREEFullText

    30.WhiteIR,BarrettJK,JacksonD,HigginsJPT.Consistencyandinconsistencyinnetworkmetaanalysis:modelestimationusingmultivariatemetaregression.ResearchSynthesisMethods20123:11125. CrossRef

    31. BirdST,DelaneyJA,EtminanM,BrophyJM,HartzemaAG.Drospirenoneandnonfatalvenousthromboembolism:isthereariskdifferencebydosageofethinylestradiol?JThrombHaemost201311:105968.CrossRef Medline

    32. GronichN,LaviI,RennertG.Higherriskofvenousthrombosisassociatedwithdrospirenonecontainingoral

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 14/18

    contraceptives:apopulationbasedcohortstudy.CMAJ2011183:E131925. Abstract/FREEFullText

    33. LidegaardO,NielsenLH,SkovlundCW,SkjeldestadFE,LokkegaardE.Riskofvenousthromboembolismfromuseoforalcontraceptivescontainingdifferentprogestogensandoestrogendoses:Danishcohortstudy,20019.BMJ2011343:d6423. Abstract/FREEFullText

    34. HeinemannLA,DingerJC,AssmannA,MinhTD.Useoforalcontraceptivescontaininggestodeneandriskofvenousthromboembolism:outlook10yearsafterthethirdgenerationpillscare.Contraception201081:4017.CrossRef Medline WebofScience

    35. JickSS,KayeJA,RussmannS,JickH.Riskofnonfatalvenousthromboembolismwithoralcontraceptivescontainingnorgestimateordesogestrelcomparedwithoralcontraceptivescontaininglevonorgestrel.Contraception200673:56670. CrossRef Medline WebofScience

    36. SamuelssonE,HaggS.IncidenceofvenousthromboembolisminyoungSwedishwomenandpossiblypreventablecasesamongcombinedoralcontraceptiveusers.ActaObstetGynecolScand200483:67481. CrossRef MedlineWebofScience

    37. HedenmalmK,SamuelssonE,SpigsetO.Pulmonaryembolismassociatedwithcombinedoralcontraceptives:reportingincidencesandpotentialriskfactorsforafataloutcome.ActaObstetGynecolScand200483:57685.Medline

    38. HeinemannLA,LewisMA,AssmannA,ThielC.Casecontrolstudiesonvenousthromboembolism:biasduetodesign?Amethodologicalstudyonvenousthromboembolismandsteroidhormoneuse.Contraception200265:20714. CrossRef Medline WebofScience

    39. LidegaardO,EdstromB,KreinerS.Oralcontraceptivesandvenousthromboembolism:afiveyearnationalcasecontrolstudy.Contraception200265:18796. CrossRef Medline WebofScience

    40. ParkinL,SkeggDC,WilsonM,HerbisonGP,PaulC.Oralcontraceptivesandfatalpulmonaryembolism.Lancet2000355:21334. CrossRef Medline WebofScience

    41. FarmerRD,LawrensonRA,ToddJC,WilliamsTJ,MacRaeKD,TyrerF,etal.Acomparisonoftherisksofvenousthromboembolicdiseaseinassociationwithdifferentcombinedoralcontraceptives.BrJClinPharmacol200049:58090. CrossRef Medline WebofScience

    42. HeringsRM,UrquhartJ,LeufkensHG.Venousthromboembolismamongnewusersofdifferentoralcontraceptives.Lancet1999354:1278. CrossRef Medline WebofScience

    43. ToddJ,LawrensonR,FarmerRD,WilliamsTJ,LeydonGM.Venousthromboembolicdiseaseandcombinedoralcontraceptives:areanalysisoftheMediPlusdatabase.HumReprod199914:15005. Abstract/FREEFullText

    44. MartinelliI,TaioliE,BucciarelliP,AkhavanS,MannucciPM.InteractionbetweentheG20210Amutationoftheprothrombingeneandoralcontraceptiveuseindeepveinthrombosis.ArteriosclerThrombVascBiol199919:7003. Abstract/FREEFullText

    45. BloemenkampKW,RosendaalFR,BullerHR,HelmerhorstFM,CollyLP,VandenbrouckeJP.Riskofvenousthrombosiswithuseofcurrentlowdoseoralcontraceptivesisnotexplainedbydiagnosticsuspicionandreferralbias.ArchInternMed1999159:6570. CrossRef Medline WebofScience

    46. FarmerRD,ToddJC,LewisMA,MacRaeKD,WilliamsTJ.TherisksofvenousthromboembolicdiseaseamongGermanwomenusingoralcontraceptives:adatabasestudy.Contraception199857:6770. CrossRef MedlineWebofScience

    47. AndersenBS,OlsenJ,NielsenGL,SteffensenFH,SorensenHT,BaechJ,etal.Thirdgenerationoralcontraceptivesandheritablethrombophiliaasriskfactorsofnonfatalvenousthromboembolism.ThrombHaemost199879:2831. Medline WebofScience

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 15/18

    48. LewisMA,HeinemannLA,MacRaeKD,BruppacherR,SpitzerWO.Theincreasedriskofvenousthromboembolismandtheuseofthirdgenerationprogestagens:roleofbiasinobservationalresearch.TheTransnationalResearchGrouponOralContraceptivesandtheHealthofYoungWomen.Contraception199654:513. CrossRef Medline WebofScience

    49. FarmerR.Safetyofmodernoralcontraceptives.Lancet1996347:259. Medline

    50. BloemenkampKW,RosendaalFR,HelmerhorstFM,BullerHR,VandenbrouckeJP.EnhancementbyfactorVLeidenmutationofriskofdeepveinthrombosisassociatedwithoralcontraceptivescontainingathirdgenerationprogestagen.Lancet1995346:15936. CrossRef Medline WebofScience

    51. Effectofdifferentprogestagensinlowoestrogenoralcontraceptivesonvenousthromboembolicdisease.WorldHealthOrganizationCollaborativeStudyofCardiovascularDiseaseandSteroidHormoneContraception.Lancet1995346:15828. CrossRef Medline WebofScience

    52.VandenbrouckeJP,HelmerhorstFM,BloemenkampKW,RosendaalFR.Thirdgenerationoralcontraceptiveanddeepvenousthrombosis:fromepidemiologiccontroversytonewinsightincoagulation.AmJObstetGynecol1997177:88791. CrossRef Medline WebofScience

    53.ManzoliL,DeVitoC,MarzuilloC,BocciaA,VillariP.Oralcontraceptivesandvenousthromboembolism:asystematicreviewandmetaanalysis.DrugSaf201235:191205. Medline WebofScience

    54.KemmerenJM,AlgraA,MeijersJC,BoumaBN,GrobbeeDE.EffectsofsecondandthirdgenerationoralcontraceptivesandtheirrespectiveprogestagensonthecoagulationsystemintheabsenceorpresenceofthefactorVLeidenmutation.ThrombHaemost200287:199205. Medline WebofScience

    55.KemmerenJM,AlgraA,MeijersJC,TansG,BoumaBN,CurversJ,etal.EffectofsecondandthirdgenerationoralcontraceptivesontheproteinCsystemintheabsenceorpresenceofthefactorVLeidenmutation:arandomizedtrial.Blood2004103:92733. Abstract/FREEFullText

    56.vanHylckamaVlieg,A,HelmerhorstFM,RosendaalFR.Theriskofdeepvenousthrombosisassociatedwithinjectabledepotmedroxyprogesteroneacetatecontraceptivesoralevonorgestrelintrauterinedevice.ArteriosclerThrombVascBiol201030:2297300. Abstract/FREEFullText

    57.GalloMF,NandaK,GrimesDA,LopezLM,SchulzKF.20microgversus>20microgestrogencombinedoralcontraceptivesforcontraception.CochraneDatabaseSystRev20088:CD003989.

    ViewAbstract

    Tweet 80

    223Like

    5

    ArticletoolsPDF3responses

    Respondtothisarticle

    DatasupplementPrintAlerts&updates

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 16/18

    DownloadDownloadDownloadDownloadDownloadDownload

    Articlealerts

    Pleasenote:youremailaddressisprovidedtothejournal,whichmayusethisinformationformarketingpurposes.

    Loginorregister:

    Username*Password*Login

    Registerforalerts

    Ifyouhaveregisteredforalerts,youshoulduseyourregisteredemailaddressasyourusernameCitationtools

    Downloadthisarticletocitationmanager

    StegemanBernardineH,deBastosMarcos,RosendaalFritsR,vanHylckamaVliegA,HelmerhorstFransM,StijnenTheoetal.Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysisBMJ2013347:f5298

    BibTeX(win&mac)EndNote(tagged)EndNote8(xml)RefWorksTagged(win&mac)RIS(winonly)Medlars

    HelpIfyouareunabletoimportcitations,pleasecontacttechnicalsupportforyourproductdirectly(linksgotoexternalsites):

    EndNoteProCiteReferenceManagerRefWorksZotero

    Requestpermissions

    Authorcitation

    ArticlesbyBernardineHStegemanArticlesbyMarcosdeBastosArticlesbyFritsRRosendaalArticlesbyAvanHylckamaVliegArticlesbyFransMHelmerhorstArticlesbyTheoStijnenArticlesbyOlafMDekkers

    AddarticletoBMJPortfolio

    Emailtoafriend

    Forwardthispage

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 17/18

    Seemoredetails

    ThankyouforyourinterestinspreadingthewordaboutTheBMJ.

    NOTE:Weonlyrequestyouremailaddresssothatthepersonyouarerecommendingthepagetoknowsthatyouwantedthemtoseeit,andthatitisnotjunkmail.Wedonotcaptureanyemailaddress.

    Username*YourEmail*SendTo*

    YouaregoingtoemailthefollowingDifferentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysisYourPersonalMessage

    Send

    TopicsReproductivemedicineContraceptionDrugs:obstetricsandgynaecologyInternetPulmonaryembolism

    Whoistalkingaboutthisarticle?

    UKjobsInternationaljobs

    NHSForthValley:ConsultantinGeneralAdultPsychiatryHomertonUniversityHospitalNHSFoundationTrust:ConsultantHaematologistwithspecialinterestinAnticoagulationandthrombosisHomertonUniversityHospitalNHSFoundationTrust:ConsultantHaematologistwithspecialinterestin

    Tweetedby139On13FacebookpagesReferencedin2WikipediapagesMentionedin1Google+postsHighlightedby1platforms

    38readersonMendeley1readersonCiteULike

  • 11.05.2015 Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

    http://www.bmj.com/content/347/bmj.f5298 18/18

    Haematooncology(10PAs+1additionalPA)Dr.SulaimanAlHabibMedicalGroup:JobopportunitiesinSaudiArabiaNHSEngland:NationalClinicalReferenceGroupCCGMembers&ampSenateAreaMembersViewmoreBacktotop


Top Related