ltsi project update€¦ · 4.4 greg kroah-hartman 2016-01-10 2.4 8516 3548 3.16 ben hutchings...

31
LTSI Project update Long Term Support Ini0a0ve Tsugikazu SHIBATA 20, June. 2018 at Open Source Summit Japan, Ariake Tokyo

Upload: others

Post on 15-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTSIProjectupdateLongTermSupportIni0a0ve

TsugikazuSHIBATA20,June.2018

atOpenSourceSummitJapan,AriakeTokyo

Page 2: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Linux=OpenSourceproject

•  LinuxisoneofthemostsuccessfulOpenSourceproject

•  ConGnuegrowingin27years;expandingadopGonfornewarea;–  ITenterprise,Cloud,Network,SmartPhone,RoboGcs,Embedded,IoTandmanyothers

•  DevelopinganddeliveringunderGPLv2

Page 3: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Developedbythecommunity

•  ParGcipaGng~1700developer,~230companieseveryreleases

•  Growingyearly1.5Mlinesofcode,4000filesincreased

•  27Yearsofhistory•  Maintainershavegreatskilltomanagethesubsystemandprofessionalknowledgeofitsareaoftechnologies

Page 4: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

StatusofLatestLinuxKernel

•  LatestreleasedKernel:4.17– Released:June3rd,2018– Linesofcode:25,379,564(-179,241)– Files:61,332(-1,661)– Developedperiod:63daysfrom4.16

•  CurrentStableKernel:4.17.2•  Currentdevelopmentkernel:4.18-rc1

Page 5: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Kernelreleasecycle•  Releasecycle:65~70days,5~6releases/year

Version Release Rel.span

4.9 2016-12-11 70

4.10 2017-02-19 60

4.11 2017-04-30 80

4.12 2017-07-02 63

4.13 2017-09-03 63

4.14 2017-11-12 70

4.15 2018-1-28 77

4.16 2018-4-1 63

4.17 2018-6-3 63

Version Release Rel.span

3.19 2015-2-9 644.0 2015-4-12 624.1 2015-6-22 71

4.2 2015-8-30 69

4.3 2015-11-2 64

4.4 2016-1-10 68

4.5 2016-3-14 64

4.6 2016-5-15 63

4.7 2016-7-24 70

4.8 2016-10-2 70

6

5 5

Page 6: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Linuxdevelopmentpolicy•  Upstreamisonlytheplacetoacceptthepatches

– Reviewedbyskilledmaintainer– Testedwithotherproposalstoconfirmnoconflicts– Wellcoordinateddevelopmentprocessforoverthousandsofdevelopers

(Bug/Security)

Upstream

New Features Fixes

Page 7: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LinuxDevelopmentprocess•  Justagerthereleaseof4.n,twoweeksofmergewindowwillbeopenedforproposalofnewfeatures

•  Ager2weeksofmergewindow,-rc1willbereleasedandthestabilizaGonwillbestarted

•  4.n+1willbereleasedwhenitbecomesreasonablystablebysomeof-rcXreleased

4.n 4.n+1-rc1 -rc2 -rc3 -rc4 -rcX

MergeWindow(2weeks)

Stabilization

Page 8: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LinuxSourceCodeGrowth

•  Increasing0.3ML/Version,1.5ML/year

0

5,000,000

10,000,000

15,000,000

20,000,000

25,000,000

30,000,000

4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 4.9 4.10 4.114..124.13 4.14 4.15 4.16 4.17

Linuxsourcecodegrowth

Page 9: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Stablekernelrelease

•  Recommendedbranchforuserswhowantthemostrecentstablekernel

•  3partversionlike4.n.m•  ContainsmallandcriGcalfixesforsecurityproblemsorsignificantregressionsdiscoveredinalatestdevelopmentversion

•  Becomes“EndOfLife”whennextstablekernelwerereleased

4.n 4.n+1 4.n+2

4.n.1 4.n.2

4.N+1 Development

EOL

EOL

Page 10: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTS:LongTermStableKernel

•  Extendedmaintenanceperiodforstablekernel•  KerneltreeconGnuetobackportbugandSecurityfixesformorelongterm

•  Pickoneversionperyearandmaintain2years

LTS

Stable Release

Development Release

Page 11: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

StatusofLatestLinuxKernelAgain

•  LatestreleasedKernel:4.17•  CurrentStableKernel:4.17.2•  Currentdevelopmentkernel:4.18-rc1

4.17

4.17.2

4.18 Development4.18-rc1

Page 12: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

WhyLTS?•  Onlythetreegetfixesfromthecommunity•  Intherealusecase,tested/confirmedkernelisimportant,lessimportantfornewfeatures

•  Security/BugFixeswillbereleasedweeklyormoreandthatshouldbeapplied

•  LTSwillbereleasedaroundNovember/DecemberGmeframeforeasierforplanning

Page 13: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

CurrentLTSversionsVersion Maintainer Released ProjectedEOL Years

4.14 GregKroah-Hartman 2017-11-12 Jan,2020 2

4.9 GregKroah-Hartman 2016-12-11 Jan,2019 2

4.4 GregKroah-Hartman 2016-01-10 Feb,2022 6

4.1 SashaLevin 2015-06-21 May,2018 3

3.16 BenHutchings 2014-08-03 Apr,2020 6

3.2 BenHutchings 2012-01-04 May,2018 6

https://www.kernel.org/category/releases.html

Page 14: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

2010 2011 2012 2013 2014 2015 2016 2018 2019 2020 20212017

7/21 11/5

v3.0

v3.2 1/4 5

5/20

v3.4

4

6/30

v3.10 10

11/3

v3.12

5

3/30 11/5

v3.14

v3.16

8/30 4

12/7

v3.18

6/1

v4.1

1/10

v4.4

2022

2

12/11

v4.9 1

11/12

v4.14 1

SupportperiodofLTSKernels

5

v4.1?

We are Here

Page 15: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTSincludeslargenumberoffixes•  600–700fixesincludedinaStablerelease•  LTSincludeseveralthousandsoffixes

VersionFROM-TO

#Commits

3.2 3.2.99 8531

3.3 3.3.8 698

3.4 3.4.113 5929

3.5 3.5.7 816

3.6 3.6.11 757

3.7 3.7.10 718

3.8 3.8.13 996

3.9 3.9.11 746

3.10 3.10.108 6705

3.11 3.11.10 677

VersionFROM-TO

#commits

3.12 3.12.74 7746

3.13 3.13.11 903

3.14 3.14.79 4977

3.15 3.15.10 703

3.16 3.16.56 8437

3.17 3.17.8 884

3.18 3.18.112 6821

3.19 3.19.8 873

4.0 4.0.9 757

4.1 4.1.52 6695

 As of 2018/06/07

VersionFROM-TO

#commits

4.2 4.2.8 903

4.3 4.3.6 618

4.4 4.4.135 8516

4.5 4.5.7 973

4.6 4.6.7 705

4.7 4.7.10 912

4.8 4.8.17 1102

4.9 4.9.105 8212

4.10 4.10.17 1136

4.11 4.11.12 984

VersionFROM-TO

#commits

4.12 4.12.14 837

4.13 4.13.16 883

4.14 4.14.47 4800

4.15 4.15.18 1616

4.16 4.16.13 1267

LTS EOLed LTS Stable

Page 16: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

#ofYearlyfixesinLTS

Version Maintainer Released Yearsmaintained

TotalCommits

Fixes/year

4.14 GregKroah-Hartman 2017-11-12 0.6 4800 48004.9 GregKroah-Hartman 2016-12-11 1.5 8212 54744.4 GregKroah-Hartman 2016-01-10 2.4 8516 3548

3.16 BenHutchings 2014-08-03 4.2 8437 2008

 As of 2018/5/7

•  LTSinclude1~3thousandsoffixeseveryyear•  ConGnuetoapplythesepatchesareveryimportantforthe

securityviewpoint

Page 17: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

OverviewofMeltdownandSpectreName CVE Solu_oninLinux Note

SpectreV1BoundsCheckBypass(Variant1)

CVE-2017-5753

FixesforX86andARMAvailable.Driverneedtodomore

BackportedtoLTS4,4,4.9,4.14.ARMisdifferent

SpectreV2BranchTargetInjecGon(Varinat2)

CVE-2017-5715

FixesforX86andARMAvailableasRetpolineimplementaGon

BackportedtoLTS4.14,4.9,4.4Javascript/Browerupdatemayneededforsidechannelaoack

MeltdownRogueDataCacheLoad(Variant3)

CVE-2017-5754

PTI(PageTableIsolaGon)X86andARMFixesweredifferent

BackportedtoLTS4.14,4.9,4.4

Please CHECK by yourself for the latest status, things are changing time by time.

Page 18: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

OverviewofMeltdownandSpectreName CVE Solu_oninLinux Note

RogueSystemRegisterRead(Variant3a)

CVE-2018-3640

ExpectsX86onlyandneedtoupdateCPUMicrocode.

KernelfixforMetldownsolvethisproblem

SpeculaGveStoreBypass(Varinat4)

CVE-2018-3639

SSBD(SpeculaGveStoreBypassDisable)handlingARMfixesnotyet

Availablefor4.9.102,4.14.43,4.16.11MicrocodeupdaterequiredforfullprotecGon

LazyFloaGngpointstaterestore(Variant5)

Linuxkernelfixedin2016 DetailstobepublishedJune27

Please CHECK by yourself for the latest status, things are changing time by time.

Page 19: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

RegularKernelUpdate•  Meltdown/Spectreproblemtellus

–  Securityproblemis#1priority,needtoprovideimmediatefixes

–  AreaoffixesareunexpectedsothatsyncwithLTSisveryimportant

–  Cherrypickingpatchesarebeingdifficulttoconfirm•  Numberoffixeswillcomelater

•  ApplyingALLtheLTSpatchesisthebestway,cherrypickingpatchespossiblyhaveproblem

Page 20: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Whyallthepatches?

•  PatchesarebasedonlatestLTSkernelthatisbasedonallpatchedsourcecode

•  Ifyouappliedcherrypickedyourpreferredpatchesonly,thatwillbecomenotsameaslatestLTSandfinally,newerimportantpatchmaynotbeapplied–  Becauseofrackofotherpatches

•  Wholesetofpatchesneedtoapplyifyouwantedtouseyourkernelforlongterm

Page 21: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

CaseofLTS4.14•  4.14releasedin2017-11-12,Now4.4.50isthere•  Monthly6to9releasehappeningfor4.14.x

•  Monthly,Bi-monthlyorquarterlykernelupdatemayreasonable

Month 4.4 4.9 4.14

2017/12 5 7 7

2018/1 6 6 6

2 5 6 7

3 7 7 9

4 4 5 6

5 5 8 9

6 3 4 3

# of releases for month

As of 2018/06/18

Page 22: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

What’stheproblem?

•  NeedtotestnewkernelsforeveryLTS,ittakesmorecostandGmetomaintain– UseAutomatedtestsuchasFuego/KernelCI– Usecommontestsuitesandsharetheresults– Makeconsensusofcommontestsanddevelopit– ConGnuetodiscussfurther

Page 23: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

FurtherdiscussionatLTSIWorkshop

•  DiscussaboutApplyingpatchesofLTSandautomatedtests– GregKH,TimBird,KevinHillman– AGL/CIPpeople

•  Date:Friday22ndJune2018•  Time:10:30-12:00•  Venue:room2

Page 24: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTSIStatus

Page 25: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

WhatisLTSI•  OpenSourcecommunitytocreateandmaintainLTSIkerneltreeforlongterm– BasedonLTS,AlltheLTSpatchesareapplicable– AddanotherchancetoincludefurtherpatchesontopofLTS,ThatisLTSItree

•  Selfcontainedchangesorfutureupstreamcode•  DriversforLTS,developedagerLTSrelease

–  IndustrypartytosharebestpracGceandhelpcompaniestouseLinuxforlongterm

Page 26: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTSIincludesLTSLTSIp BeabletoaddrequiredfeaturesontopofLTSp Sharestatus,info,problemamongindustrypeoplep HugetesGngbycontributorsp Autotestframe-work

p ProvidehelpdeveloperforupstreamLTSp Release1version/year,Maintain2years

p Frequentlyandlargenumberofbug/securityfixes

Page 27: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTSI2018Developmentplan

11 12 321 4 85 6 7 109 11 12 2110

4.14 4.15 4.16 4.17 4.18 4.19

4.14 LTSVPMWPreparation

2017 2018 2019

LTSI 4.14 Release

YoctoAGL GG

You will be able to have chance to add new patches on top of 4.14 in LTSI Merge Window (Note: The patches should be already in –next or self contained)

MergeWindowOpen

MergewindowClose

Valida_onStart

Release

August1st EndofAugust RightagerMergewindowclosed

EndofSeptember

Page 28: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

LTSforthisyearwillbe

4.20

Note: if everything going fine

Or Maybe 5.0

Page 29: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Conclusion•  UsingLTS/LTSIisimportantforrealusecase•  SecurityfixesaremoreimportantandapplyALLtheLTSpatchesmaybeasoluGon–  ConGnuetodiscussforabeoershape

•  Whydon’tyoujoinLTSI?–  ByjoiningLTSI,youwillbeabletosharebestpracGce–  BeabletogetinformaGonforstablekernel

Page 30: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

Youcanpar_cipateLTSI•  FollowonTwioeraccount:

@LinuxLTSI•  Web:

hop://ltsi.linuxfoundaGon.org

•  Mailinglist:hops://lists.linuxfoundaGon.org/mailman/lisGnfo/ltsi-dev

•  Gittree:hop://git.linuxfoundaGon.org/?p=ltsi-ernel.git;a=summary

30

Page 31: LTSI Project update€¦ · 4.4 Greg Kroah-Hartman 2016-01-10 2.4 8516 3548 3.16 Ben Hutchings 2014-08-03 4.2 8437 2008 As of 2018/5/7 • LTS include 1 ~ 3 thousands of fixes every

31

THANKYOU