effect of generic antibiotic introduction: key learnings · effect of generic antibiotic...

80
29 March 2014 8th RTI Forum, Jakarta, Indonesia 1 Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD Cellular and Molecular Pharmacology Louvain Drug Research Institute Université catholique de Louvain Brussels, Belgium Bayer HealthCare 8th RTI Forum Jakarta, Indonesia 29 March – 30 March 2014 With approval of the Belgian Ethical Health Platform – visa no. 14/V1/6480/058622

Upload: others

Post on 17-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 1

Effect of generic antibiotic introduction: key learnings

Paul M. Tulkens, MD, PhD

Cellular and Molecular PharmacologyLouvain Drug Research InstituteUniversité catholique de Louvain

Brussels, Belgium

Bayer HealthCare 8th RTI Forum Jakarta, Indonesia

29 March – 30 March 2014

With approval of the Belgian Ethical Health Platform – visa no. 14/V1/6480/058622

Page 2: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 2

Disclosures and slides availability

• Research grants – Theravance, Astellas, Targanta, Cerexa/Forest, AstraZeneca, Bayer, GSK, Trius,

Rib-X, Eumedica

– Belgian Science Foundation (F.R.S.-FNRS), Ministry of Health (SPF), and Walloon and Brussels Regions

• Speaking fees – Bayer, GSK, Sanofi, Johnson & Johnson, OM-Pharma

• Decision-making and consultation bodies– General Assembly and steering committee of EUCAST

– European Medicines Agency (external expert)

– US National Institutes of Health (grant reviewing)

Slides: http://www.facm.ucl.ac.be Lectures

Page 3: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 3

You said "generics": the recent story of a well known antibiotic

http://www.cbip.be/GGR/Index.cfm?ggrWelk=/nIndex/GGR/Stof/IN_L.cfm

Before patent expiration

Page 4: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 4

A well known antibiotic in Belgium1

2

3

4

5

6

7

After …

http://www.cbip.be/GGR/Index.cfm?ggrWelk=/nIndex/GGR/Stof/IN_L.cfm

Page 5: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 5

But why would you choose a "generic" antibiotic ?

1. Because it is like airlines: low cost is better

2. Because they have the same quality as the original ones

3. Because they can be produced locally (in my country) (as opposed to countries of "Big Pharma")

4. Because my patients / my hospital / my country has/have limited resources

5. Because "old antibiotics" (no longer under patent) cover most of my needs

6. All of the above

Please, give your FIRST choice (1-5) OR choose 6

Page 6: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 6

I guess the real and only justifiable answer is...

Page 7: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 7

What shall we discuss?1. The US and the EU laws

2. Approach to PK bioequivalence

3. Approach to microbiological equivalence

MIC, MPC, heteroresistance …

4. Approach to pharmacodynamic equivalence

PK/PD animal models and clinical data

5. Problems related to dissolution and stability

6. Impurities and falcified medicines

7. The hidden risk of "low cost" antibiotics

Page 8: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 8

What shall we discuss?1. The US and the EU laws2. Approach to PK bioequivalence

3. Approach to microbiological equivalence

MIC, MPC, heteroresistance …

4. Approach to pharmacodynamic equivalence

PK/PD animal models and clinical data

5. Problems related to dissolution and stability

6. Impurities and falcified medicines

7. The hidden risk of "low cost" antibiotics

http://vlpmaricopa.org/vlp/clc/Aboutus.htm Last visited: 25 March 2014

Page 9: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 9

The US Law

• FDA works along the provisions of the Drug Price Competition and Patent Term Restoration Act ("Hatch-Waxman Act" [Public Law 98-417]), which encouraged the manufacture of generic drugs

• Marketers of generic drugs can file an Abbreviated New Drug Application (ANDAs) to seek FDA approval

http://www.gpo.gov/fdsys/pkg/STATUTE-98/pdf/STATUTE-98-Pg1585.pdf

Page 10: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 10

US "Abbreviated New Drug Application"

http://www.fda.gov/Drugs/DevelopmentApprovalProcess/HowDrugsareDevelopedandApproved/ApprovalApplications/Abb reviatedNewDrugApplicationANDAGenerics/default.htm

Page 11: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 11

FDA requirements in a nutshell *

• Published literature (for data for which the applicant has no right of reference to the original raw data supporting the application)

• FDA's findings (safety and effectiveness of the already approved drug)

• Comparison with the original NCE/NME (New Chemical Entity/New Molecular Entity) application for– dosage form, strength, route of administration– substitution of an active ingredient in a combination product or

change such as different salt, ester, complex, …

• Bioequivalence study

The proposed product does not need to be shown to be clinically better than the previously approved product; however, the application should not be used as a route of approval for poorly bioavailable generic drug products unable to meet the standards for bioequivalence.

* 505 (B) (2) Application (Guidance to Industry) http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM079345.pdf

Page 12: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 12

FDA approved generic drugs: "Orange book" *

* http://www.accessdata.fda.gov/scripts/cder/ob/default.cfm

Page 13: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 13

FDA approved generic drugs: "Orange book" *

* http://www.accessdata.fda.gov/scripts/cder/ob/default.cfm

As in LEVAQUIN®http://medicaidprovider.hhs.mt.go

v/pdf/levaquinpi.pdf

Page 14: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 14

In the European Union

* Legislative act of the European Union that is then translated into country-specific laws for actual implementation, which may vary (in details) between countries (vs regulations that are self-executing and do not require local adaptations)

*

http://europa.eu/legislation_s ummaries/internal_market/si ngle_market_for_goods/phar maceutical_and_cosmetic_p roducts/l21230_en.htm

Page 15: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 15

The EU Directive

• By way of derogation from Article 8(3)(i), and without prejudice to the law relating to the protection of industrial and commercial property, the applicant shall not be required to provide the results of pre- clinical tests and of clinical trials if he can demonstrate that the medicinal product is a generic of a reference medicinal product which is or has been authorised under Article 6 for not less than eight years in a Member State or in the Community.

• ‘generic medicinal product’ shall mean a medicinal product which has the same qualitative and quantitative composition in active substances and the same pharmaceutical form as the reference medicinal product, and whose bioequivalence with the reference medicinal product has been demonstrated by appropriate bioavailability studies. … Bioavailability studies need not be required of the applicant if he can demonstrate that the generic medicinal product meets the relevant criteria as defined in the appropriate detailed guidelines.

Page 16: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 16

What shall we discuss?1. The US and the EU laws

2. Approach to PK bioequivalence3. Approach to microbiological equivalence

MIC, MPC, heteroresistance …

4. Approach to pharmacodynamic equivalence

PK/PD animal models and clinical data

5. Dissolution and stability

6. Impurities and falcified medicines

7. The hidden risk of "low cost" drugshttp://www.choosinggenerics.ca/Bioequivalence.aspxLast visited: 15 March 2014

Page 17: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 17

Bioequivalence: principles

• Bioequivalence is an accepted surrogate for therapeutic equivalence 1 (including for branded drugs when the mareketed form differs from the form used in development…)2

• Primary metrics are 1,3

– AUC (area under the plasma concentrationtime profile of the active substance)

extent of absorption– Cmax (the maximum plasma concentration of the active substance)

extent and rate of absorption– Tmax (the time when Cmax is reached)

rate of absorption

1. Hauschke et al. Bioequivalence Studies in Drug Development – Methods and Applications, John Wiley & Sons Ltd. (UK), 2007.2. Benet LZ: Understanding bioequivalence testing. Transplant.Proc. 31 (Suppl 3A): 7S-9S, 1999.3. Niazi SK: Handbook of Bioequivalence Testing, “Drugs and the Pharmaceutical Sciences”, vol. 171, Informa Healthcare (New York), 2007.

Page 18: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 18

AUC – Cmax – Tmax

0 1 2 3 4 5 60

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

Cmax

Tmax

Page 19: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 19

AUC – Cmax – Tmax

Cmax

Tmax

0 1 2 3 4 5 60

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

AUC

Page 20: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 20

What if the absorption is decreased ?

0 1 2 3 4 5 60

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

Cmax

AUC

Page 21: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 21

What if absorption is delayed ?

0 1 2 3 4 5 60

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

Cmax

Tmax

Page 22: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 22

Criteria of bioequivalence (EMA* / FDA**)• Calculate the 90% confidence interval around the geometric mean

ratios of both AUC and Cmax for Test (generic) and Reference (innovator).

• The 90% confidence intervals should, in most cases, be within the 0.80 – 1.25 acceptance limits.

Notes: 1. if both AUC and Cmax are within range, the generic should have the same bioavailability than the reference2. statistical evaluation of Tmax only makes sense if there is a clinically relevant claim for rapid release or action or signs

related to adverse effects (see next slide)3. For drugs with narrow therapeutic index, EMA recommends "tightened acceptance inervals, Health Canada requires

0.9 – 1.12, but FDA accepts 0.8 – 1.25

* Guideline to the Investigation of Bioequivalence, London, 20 January 2010 - Doc. Ref.: CPMP/EWP/QWP/1401/98 Rev. 1/ Corr ** http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2010/01/WC500070039.pdf

** Guidance for Industry (BIOEQUIVALENCE GUIDANCE) - Guidance for Industry Bioavailability and Bioequivalence Studies for Orally Administered Drug Products — General Considerations http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/ucm070124.pdf http://www.fda.gov/downloads/AnimalVeterinary/GuidanceComplianceEnforcement/GuidanceforIndustry/ucm052363.pdf

0.80 1.251.0

90 % CI around point estimate

ratio

Page 23: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 23

But what about in Asia?

http://facm.ucl.ac.be/conferences/2014/03-Jakarta/documentation/ASEAN-Guidelines-for-the-Conduct-of-Bioavailability.pdf

Page 24: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 24

But what about in Asia?

http://facm.ucl.ac.be/conferences/2014/03-Jakarta/documentation/ASEAN-Guidelines-for-the-Conduct-of-Bioavailability.pdf

Page 25: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Is this enough ?

1. The US / EU / Asian laws are sufficient and convince me to say that generics are like the original products

2. While accepting the laws, I'm not convinced and would like to have additional information from the producers

3. What is required by law is insufficient and the laws need to be changed.

Only ONE answer (1, 2 or 3), please !

29 March 2014 8th RTI Forum, Jakarta, Indonesia 25

Page 26: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 26

What shall we discuss?1. The EU and US laws

2. Approach to PK bioequivalence

3. Approach to microbiological and therapeutic equivalence

MIC, MPC, heteroresistance …

Approach to pharmacodynamic equivalence

PK/PD animal models and clinical data

4. Dissolution, stability, Impurities

5. The hidden risk of "low cost" drugs

http://www.umu.se/english/research/research- excellence/strong-research/Infection+BiologyLast visited: 25 March 2014

http://www.buzzle.com/articles/staph-infections- staph-infection-treatment-and-symptoms.htmlLast visited: 25 March 2014

http://www.gaebler.com/How-to-Start-a- Laboratory-Animals-Business.htmLast accessed: 29 March 2014

Page 27: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 27

Potency (piperacillin)

Using the incremental MIC assay (Jones RN et al., Diagn Microbiol Infect Dis 2008; 61:76–79).

Moet et al. Diagnostic Microbiology and Infectious Disease 2009;65: 319–322

Page 28: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 28

MIC values (vancomycin)

MICs were often higher than for the reference product…

Fujimura & Watanabe J Infect Chemother (2012) 18:421–427

Page 29: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 29

MIC values (meropenem)MICs determined by arithmetic dilutions for strains displaying MICs ranging from 0.125 to 128 mg/L (geometric values)

susceptible strains (MIC 2 mg/L)

Hospira Sandoz Fresenius50

100

150

200

250

300

mean = 110.8 115.8 113.3SD= 39.2 36.5 36.6

brand

MIC

(% o

f MER

ON

EM

val

ue)

intermediate strains (2 MIC < 8 mg/L)

Hospira Sandoz Fresenius50

100

150

200

250

300

mean= 107.7 102.7 103.4SD= 17.41 13.9 19.3

brand

MIC

(% M

ERO

NEM

v

alue

)

resistant strains (MIC > 8 mg/L)

Hospira Sandoz Fresenius50

100

150

200

250

300

mean = 100.4 93.4 97.3SD= 11.5 11.7 12.9

brand

MIC

(% M

ERO

NEM

v

alue

)

Van Bambeke et al., in preparation

Susceptible strains(MIC ≤

2 mg/L)Intermediate strains(≤

2 MIC < 8 mg/L)Resistant strains

(MIC > 8 mg/L)

MERONEM® = meropenem commercialized by AstraZeneca

Page 30: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 30

Killing curves and hetero-resistance (vancomycin)

Rodriguez et al. Antimicrob Agents Chemother. 2012; 56:243–247

Page 31: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 31

Killing curves and hetero-resistance (vancomycin)

Rodriguez et al. Antimicrob Agents Chemother. 2012; 56:243–247

Page 32: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 32

Vancomycin: evidence of non-equivalence in PK/PD animal model

Vesga et al. Antimicrob Agents Chemother. 2010; 54:3271–3279.

Neutropenic thigh mouse model

Page 33: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 33

Oxacillin: evidence of non-equivalence in animal PK/PD model

Rodriguez et al. BMC Infectious Diseases 2010, 10:153 - http://www.biomedcentral.com/1471-2334/10/153

Neutropenic thigh mouse model

Page 34: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 34

Gentamicin: evidence of non-equivalence in animal PK/PD model

Neutropenic thigh mouse model

Zuluaga et al. PLoS ONE 2010; 5: e10744. doi:10.1371/journal.pone.0010744

Page 35: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 35

Zuluaga et al. PLoS ONE 2010; 5: e10744. doi:10.1371/journal.pone.0010744

Gentamicin: evidence of non-equivalence for survival in animals

Neutropenic thigh mouse model

Page 36: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Clinical alerts (efficacy and safety) ?

J Pharmacol Pharmacother. 2013 Dec;4(Suppl 1):S110-4.

29 March 2014 8th RTI Forum, Jakarta, Indonesia 36

Page 37: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

J Pharmacol Pharmacother. 2013 Dec;4(Suppl 1):S110-4.

Clinical alerts (efficacy and safety) ?

29 March 2014 8th RTI Forum, Jakarta, Indonesia 37

Page 38: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

And what about pharmaceutical quality ?

1. the generic must have the same solubility / dispersion properties than the original

2. the generic cannot contain more impurities (or give rise to more degradation products) than the original

3. I must be sure about the real content of what I prescribe

4. All of the above is important

5. None of the above is important

Please, give your FIRST choice (1, 2 OR 3)

OR choose 4 OR 5

29 March 2014 8th RTI Forum, Jakarta, Indonesia 38

Page 39: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 39

What shall we discuss ?

1. The EU and US laws

2. Approach to PK bioequivalence

3. Approach to microbiological and therapeutic equivalence

MIC, MPC, heteroresistance …

Approach to pharmacodynamic equivalence

PK/PD animal models and clinical data

4. Dissolution, stability, impurities5. The hidden risk of "low cost" drugs

http://www.astrosurf.com/luxorion/eau-intro-molecule2.htmLast visited: 25 March 2014

http://www.wiley-vch.de ...Last visited: 25 March 2014

http://www.docstoc.com ...Last visited: 25 March 2014

Page 40: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 40

Dissolution of meropenem in Japan

Fujimura & Watanabe J Infect Chemother (2012) 18:421–427

Page 41: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 41

Crystals size in meropenem in Japan

Fujimura & Watanabe J Infect Chemother (2012) 18:421–427

Page 42: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 42

Dissolution of meropenem in Belgium

Drug concentration : 50 mg/mL (~ solution used for infusion) gentle manual shaking followed by turbidity measures;

room temperature

0 50 100 150 200 250 3000

20

40

MeronemHospiraSandozFresenius

6080

100

manual gentle shaking

Time (sec)

Turb

idity

(% in

itial

val

ue)

Meronem Hospira Sandoz Fresenius

100

125

150

175

200

Brand

Tim

e to

reac

hm

inim

al tu

rbid

ity(%

Mer

onem

val

ue)

Van Bambeke et al., in preparation

Page 43: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 43

Dissolution of meropenem in Belgium

Drug concentration : 50 mg/mL (~ solution used for infusion) gentle manual shaking followed by turbidity measures;

room temperature

0 50 100 150 200 250 3000

20

40

MeronemHospiraSandozFresenius

6080

100

manual gentle shaking

Time (sec)

Turb

idity

(% in

itial

val

ue)

Meronem Hospira Sandoz Fresenius

100

125

150

175

200

Brand

Tim

e to

reac

hm

inim

al tu

rbid

ity(%

Mer

onem

val

ue)

Van Bambeke et al., in preparation

Page 44: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 44

Are Primary Health Care Professionals (nurses) happy? (meropenem)

Van Bambeke et al., in preparation

dissolution time

MERONEM

FRESENIUS

SANDOZ

HOSPIRA

0

30

60

90

120

150

180

Repeated Measures ANOVA P value P value summary

0.1136ns

seco

nds

questionnaire - solubilisation

MERONEM

FRESENIUS

SANDOZ

HOSPIRA

0

1

2

Repeated Measures ANOVA P value P value summary

0.3084ns

seco

nds

Page 45: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 45

Impurities in meropenem: coloured compounds

Van Bambeke et al., in preparation

are you happy with the colour?

Page 46: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 46

Impurities in meropenem: coloured compounds

OD - 24°C

0 1 2 40.0

0.1

0.2

0.3

0.4MeronemHospiraSandozFresenius

incubation time (hours)

OD

(410

nm

)

OD - 37°C

0 1 2 40.0

0.1

0.2

0.3

0.4MeronemHospiraSandozFresenius

incubation time (hours)

OD

(410

nm

)

Van Bambeke et al., in preparation

Page 47: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 47

Substandard (wrong) drugs in the world ?

Johnston & Holt. Substandard drugs: a potential crisis for public health. Br J Clin Pharmacol. 2013 Nov 29. doi: 10.1111/bcp.12298. [Epub ahead of print] PubMed PMID: 24286459.

Figure 1. Examples of recent accounts of substandard drugs around the world

Page 48: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 48

Falsified Medicines: An EU reaction

http://ec.europa.eu/health/files/eudralex/vol-1/dir_2011_62/dir_2011_62_en.pdf.

with an immediate follow-up from the Industry

http://www.egagenerics.com/index.php/publications

Page 49: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 49

What shall we discuss?1. The EU and US laws 2. Approach to PK bioequivalence 3. Approach to microbiological and therapeutic equivalence

1. MIC, MPC, heteroresistance …2. Approach to pharmacodynamic equivalence3. PK/PD animal models and clinical data

4. Dissolution, stability, impurities5. The hidden risks of "low cost" drugs

1. overconsumption2. lack of innovative research ...

and research for those who pay ...

Page 50: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 50

"Low cost antibiotics" and "prudent use" … The sour Danish experience

Jensen et al. J Antimicrob Chemother 2010; 65:1286–1291

Page 51: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Innovative antibiotic development is abandoned

Boucher H W et al. Clin Infect Dis. 2009;48:1-12

29 March 2014 8th RTI Forum, Jakarta, Indonesia 51

Page 52: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Innovative antibiotic development is abandoned

Boucher H W et al. Clin Infect Dis. 2009;48:1-12

29 March 2014 8th RTI Forum, Jakarta, Indonesia 52

Page 53: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 53

Unless Big Brother comes to your help…

http://www.piersystem.com/go/doc/3803/1863406/

will this ever be available to YOUR

patients

Page 54: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 54

Summary / Suggestions

• The decision to "go for generics" is a political one that may need revision (at political level) to avoid over-use of antibiotics

• Pharmacokinetic criteria are, so far, the (nearly) only ones adopted and accepted by the Regulatory Authorities (EMA / FDA)

• Improved criteria for anti-infective drugs (MIC, MPC, animal PK/PD, …) are probably necessary (but are not yet implemented)

• Antibiotics are cheap (compared to other chemotherapeutic agents), making discussion about costs largely irrelevant … while savings in this area may cause HUGE expenses now and later…

• Antibiotics might be a good starting point to modify the current legislative framework concerning generics at the level of the EU-Parliament, the US Congress, and Asian Countries Authorities …

Page 55: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 55

Back-up

Page 56: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 56

You said "generics"

Lead generic companies resort to multiple strategies for growth

These include

• applying for generic approvals with Food and Drug Administration (FDA) and European Medicines Agency (EMA);

• merger and acquisitions;

• developing a strong and innovative generic drug pipeline;

• improving infrastructure to enhance manufacturing and R&D capabilities;

• new product launches, and geographic expansion.

http://www.computescotland.com/generic-drug-strategies-5795.php

Page 57: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 57

If absorption is markedly delayed, you also have a lower initial AUC

0 6 12 18 240

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

0 6 12 18 240

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

Page 58: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 58

Additional criteria for early AUC (EMA) *

• Use the partial AUC truncated at the population median of Tmax for the reference formulation for for products where rapid absorption is of importance

0 1 2 3 40

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

0 1 2 3 40

1

2

3

4

5

time (h)

conc

entr

atio

n (m

g/L)

* Guideline to the Investigation of Bioequivalence, London, 20 January 2010 - Doc. Ref.: CPMP/EWP/QWP/1401/98 Rev. 1/ Corr ** http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2010/01/WC500070039.pdf

Page 59: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 59

Unsolved problems with PK-based bioequivalence … (application to antibiotics)

• Is PK equivalence leading to pharmacological equivalence ?

– in vitro testing (MIC, MPC, impact on hetero-resistance) …

– PK/PD models (animals)

– Clinical studies (?)

• What about intravenous forms ? (that, by definition, are not amenable to conventional bioequivalence studies)

• What about

– dissolution times (critical in a nursing environment)

– stablility (penems, e.g.)

– impurities (do you like them ?)

– …

Page 60: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Are generic really comparable ?

arithmetic comparison

geometric comparison

generi

c Aref

erence

generi

c B

0

10

20

30

40

Number of valuesMinimum25% PercentileMedian75% PercentileMaximum

MeanStd. DeviationStd. Error

Lower 90% CIUpper 90% CI

generic A1212.0019.5026.5033.0036.00

25.928.2622.385

21.6330.20

reference1225.0032.0035.5038.0042.00

34.924.5421.311

32.5637.27

generic B1222.0029.0032.5033.5037.00

31.174.0641.173

29.0633.27

AU

C (m

g x

L-1 x

h)

generi

c aref

erence

generi

c B

1.1

1.2

1.3

1.4

1.5

1.6

Number of valuesMinimum25% PercentileMedian75% PercentileMaximum

MeanStd. DeviationStd. Error

Lower 90% CIUpper 90% CI

generic a121.0801.2801.4251.5151.560

1.3900.15960.04607

1.3071.473

reference121.4001.5051.5501.5801.620

1.5390.059310.01712

1.5081.570

generic B121.3401.4651.5151.5251.570

1.4910.061420.01773

1.4591.523

AU

C (l

og10

[mg

x L-1

x h

])

Page 61: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Are generic really comparable ?

subject# AUC generic A AUC reference AUC generic B A/reference B/reference

1 30.00 31.00 33.00 0.97 1.06

1 31.00 33.00 30.00 0.94 0.91

1 24.00 36.00 32.00 0.67 0.89

1 28.00 37.00 33.00 0.76 0.89

1 36.00 34.00 28.00 1.06 0.82

1 35.00 31.00 27.00 1.13 0.87

1 15.00 25.00 22.00 0.60 0.88

1 35.00 37.00 33.00 0.95 0.89

1 25.00 39.00 34.00 0.64 0.87

1 12.00 42.00 37.00 0.29 0.88

1 25.00 35.00 30.00 0.71 0.86

1 15.00 39.00 35.00 0.38 0.90

arithmetic mean 25.92 34.92 31.17 0.76 0.89

SD 8.26 4.54 4.06 0.26 0.06

geometric mean 24.49 34.63 30.90 0.71 0.89

CI 90 0.12 0.03

lower 90 0.58 0.86

higher 110 0.83 0.92

Page 62: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

Are generic really comparable ?

0.80 1.251.0

90 % CI around point estimate (0.58-0.83)

Ratio of AUCs with calculation of the geometric means (point estimates)

ratio A

/ref

ratio B

/ref

0.50

0.75

1.00

1.25

Number of valuesMinimum25% PercentileMedian75% PercentileMaximum

MeanStd. DeviationStd. Error

Lower 90% CIUpper 90% CI

ratio A/ref120.29000.62000.73500.96001.130

0.75830.26200.07565

0.62250.8942

ratio B/ref120.82000.87000.88500.89501.060

0.89330.057260.01653

0.86360.9230

Geomean 0.7072 0.8924

ratio

of A

UC

s

0.60

0.80 1.251.0

90 % CI around point estimate (0.86-0.92)

0.60

Page 63: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 63

Special situations (EU)Narrow therapeutic index drugs• In specific cases of products with a narrow therapeutic index, the acceptance interval

for AUC should be tightened to 90.00-111.11%. Where Cmax is of particular importance for safety, efficacy or drug level monitoring the 90.00-111.11% acceptance interval should also be applied for this parameter. It is not possible to define a set of criteria to categorise drugs as narrow therapeutic index drugs (NTIDs) and it must be decided case by case if an active substance is an NTID based on clinical considerations.

Highly variable drugs or drug products• The extent of the widening is defined based upon the within-subject variability seen in

the bioequivalence study using scaled-average-bioequivalence according to [U, L] = exp [±k·sWR], where U is the upper limit of the acceptance range, L is the lower limit of the acceptance range, k is the regulatory constant set to 0.760 and sWR is the within- subject standard deviation of the log-transformed values of Cmax of the reference product (Important: this applies to Cmax only, NOT to AUC)

Page 64: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 64

Potency (oxacillin)

Rodriguez et al. BMC Infectious Diseases 2010, 10:153http://www.biomedcentral.com/1471-2334/10/153

Page 65: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 65

Metronidazole: complete equivalence

Agudelo & Vesga, Antimicrob Agents Chemother. 2013; 56:2659–2665

Cmax /MIC Time>MIC

Page 66: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 66

Impurities

Page 67: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 67

Impurities in ciprofloxacin

Trefi et al. Journal of Pharmaceutical and Biomedical Analysis 44 (2007) 743–754

Page 68: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 68

A Journey to the statins ….

80100120140160180200220240260280

01 02 03 04 05 06

Dépenses DDD patients

introduction of generics of

statins

Source: INAMI / RIZIV

Very good for the budget

Do all those patients really need a statin ?

Page 69: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 69

"Low cost antibiotics" and Internet

http://antidotum.org/index.php?showtopic=424075

Page 70: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 70

"Low cost antibiotics" and Internet

http://buygeneric24.org/cart_page.php

Page 71: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 71

A recent economic US study

A "natural experiment" in which Meijer, a popular Midwestern retail chain, offered 14-day supplies of certain generic oral antibiotics free of charge to customers with prescriptions from October 2006 (about 2 millions prescriptions analysed from 2004 trough 2008)

We find that the program increased the filled prescriptions of covered (free) antibiotics while reducing those of not-covered (paid) antibiotics, with an increase in overall antibiotic prescriptions.

Page 72: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 72

The situation may be worse in veterinary medicine

Page 73: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 73

The situation may be worse in veterinary medicine

• In France, introduction of generic fluoroquinolones increased their use by 30% in turkey (n=5500) production and 50% in chicken broiler (n=7000) production.

• The level of resistance in Spain where cheap generics are available is associated with a higher use of fluoroquinolones in poultry and pigs vs Germany, UK or Denmark where prices are higher and practice better controlled

Generic drug promotion in veterinary medicine is not consistent with the general objective of Public Health authorities to restrict the use of antibiotics in veterinary medicine…

Page 74: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 74

A spiral to death (in Belgium)?

• For antibiotics and antifungals, if a medical doctor or a dentist prescribes for an acute treatment:

– under the name of the active compound: the rules of prescription under INN (*) are of application (delivery of the cheapest preparation available)

– under a trade name: as from 1st May 2012, the pharmacist must deliver the product available in the group of « the cheapest drugs ».

Official text in French available at: http://www.inami.fgov.be/drug/fr/drugs/general-information/antibiotic/index.htm (last accessed: 7 November 2013)

• The drug acquisition cost for the treatment of a community-acquired pneumonia following the recommendations of BAPCOC (**) (amoxicillin [3 g / day in 3 administrations for 5 to7 days] is only 13-14 € … (ex-factory price: 7 €)

Source: Belgian "Répertoire commenté des médicaments" available at http://www.cbip.be/GGR/Index.cfm?ggrWelk=/nIndex/GGR/Stof/IN_A.cfm (last accessed: 7 November 2013)

* INN: International International Nonproprietary Name** BAPCOC: Belgian Antibiotic Policy Coordination Committee

Page 75: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 75

A spiral to death (in Belgium)?

• For antibiotics and antifungals, if a medical doctor or a dentist prescribes for an acute treatment:

– under the name of the active compound: the rules of prescription under INN (*) are of application (delivery of the cheapest preparation available)

– under a trade name: as from 1st May 2012, the pharmacist must deliver the product available in the group of « the cheapest drugs ».

Official text in French available at: http://www.inami.fgov.be/drug/fr/drugs/general-information/antibiotic/index.htm (last accessed: 7 November 2013)

• The drug acquisition cost for the treatment of a community-acquired pneumonia following the recommendations of BAPCOC (**) (amoxicillin [3 g / day in 3 administrations for 5 to7 days] is only 13-14 € … (ex-factory price: 7 €)

Source: Belgian "Répertoire commenté des médicaments" available at http://www.cbip.be/GGR/Index.cfm?ggrWelk=/nIndex/GGR/Stof/IN_A.cfm (last accessed: 7 November 2013)

This infernal spiral (to low prices) explains why nnovators leave the field

* INN: International International Nonproprietary Name** BAPCOC: Belgian Antibiotic Policy Coordination Committee

Page 76: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 76

Unless Big Brother comes to your help…

Page 77: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 77

Unless Big Brother comes to your help…

Page 78: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

29 March 2014 8th RTI Forum, Jakarta, Indonesia 78

Unless Big Brother comes to your help…

http://www.phe.gov/newsroom/Pages/mcm-procurements.aspx

Page 79: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

But EU is not too bad either

http://www.imi.europa.eu/

EU taxpayer funding:83 x 106 euros

29 March 2014 8th RTI Forum, Jakarta, Indonesia 79

Page 80: Effect of generic antibiotic introduction: key learnings · Effect of generic antibiotic introduction: key learnings Paul M. Tulkens, MD, PhD. Cellular and Molecular Pharmacology

How can you COMBACTE ?

https://www.combacte.com/?q=node/32

29 March 2014 8th RTI Forum, Jakarta, Indonesia 80