selfaprogramming&networks · d? 2b5h9d @ec8 75d 1 >5g

Balaji&Prabhakar&and&Mendel&RosenblumDepartments&of&Electrical&Engineering&and&Computer&Science

Stanford&University

SelfAProgramming&Networks:Review&+&Next&Steps&(Smart&NICs)

A"quest"to"make"networks"autonomous:"network"should"sense"and"monitor"itself;"program"and"control"itselfinteractive: network"should"be"simple"and"fun"to"use,"especially"for"3rd party"users

Self=Programming"Networks

SPN""""""""="""""""""Engineering"""+""""Design"Autonomy• Systems• Programs• ML/AI"Algorithms

Interactivity• Visual• Transparent• “Friendly"and"chatty”

Plain&Old&Volkswagen&Tuareg

StanleyThe&Self8Driving&Car

Sense%+%Control

Self-Driving%Cars

Plain&Old&Data&CenterWorkload

Sense Control

App App

Interactive4

Dashboard4&

Query4Engine

Self0Programming&Network&(SPN)

SPN

App

SPN

App

App

Sense,4Infer,4Learn4and4Control4(SILC)

New&FunctionalityTimestamping4As4A4Service

FineHgrained4Network4Telemetry

AppHNetwork4Perf4Monitoring

Operator

Policies

SPN

App

SPN

App

Plain&Old&Data&CenterWorkload

Sense Control

App App

Interactive4Dashboard4&Query4Engine

Self0Programming&Network&(SPN)

App

Sense,4Infer,4Learn4and4Control4(SILC)

New&FunctionalityTimestamping4As4A4Service

FineFgrained4Network4TelemetryAppFNetwork4Perf4Monitoring

Intuitive&DB&and&QE• Simple4+4visual4+4chatty4• App+network perf4views

Data&and&ML&Intensive• Use4data4and4NNs4to4

accelerate4learning4and4for4realFtime4processing

NIC0centric&Architecture• Sensing4and4control4at4NICs4

Smart4NICs:4big4industry4trend

SPNApp

SPNApp

SPNApp

SPNApp

Milestones

Yilong Geng:*Dec*2018

Self%Programming.Networks:.Architecture.and.Algorithms

Zi Yin:*Dec*2018

Understanding.the.Functionality,.Dimensionality.and.Domain.Adaptation.of.Word.Embeddings:Towards a.Better.Chatbot.for.Networking.Applications

Graduations

Y.#Geng,#S.#Liu,#Z.#Yin,#A.#Naik,#B.#Prabhakar#and#M.#Rosenblum:“Self&Programming/Networks:/Architecture/and/Algorithms,”/Allerton/2017Y.#Geng,#S.#Liu,#Z.#Yin,#A.#Naik,#B.#Prabhakar,#M.#Rosenblum#and#A.#Vahdat:

“Exploiting/a/Natural/Network/Effect/for/Scalable,/Accurate/Clock/Synchronization,”/USENIX/NSDI/2018Z.#Yin,#V.#Sachidananda and#B.#Prabhakar:

“The/Global/Anchor/Method/for/Quantifying/Linguistic/Shifts/and/Domain/Adaptation,”/NeurIPS 2018Y.#Geng,#S.#Liu,#Z.#Yin,#A.#Naik,#B.#Prabhakar,#M.#Rosenblum#and#A.#Vahdat:

“SIMON:/A/Simple,/Scalable/Method/for/Sensing,/Inference/and/Measurement/in/Data/Center/Networks,”/USENIX/NSDI/2019,/to/appear

Shiyu Liu:#ClockchainFeiran Wang:#Multi&Raft,/Distributed/TracingVig and#Vin#Sachidananda:#Chatbots/for/Networking/ApplicationsSean#Choi,#Shiyu Liu#and#Muhammad#Shahbaz:#Smart/NICs

Papers#and#Projects

Applications+to+FinTech

VOL. CLXVII . . . No. 58,009 © 2018 The New York Times Company NEW YORK, SATURDAY, JUNE 30, 2018

U(D54G1D)y+?!.!]!#!:

Years ago, Joe Kieta was out todinner at a nice restaurant withhis wife, celebrating their secondanniversary.

Mr. Kieta, then the editor of TheMerced Sun-Star in Merced, Calif.,had just published a series of arti-cles that led to the ouster of the lo-cal district attorney. As he waseating, a friend of the district at-torney showed up and asked Mr.Kieta to go outside.

The man “challenged me to afight right in the middle of thisfancy restaurant,” Mr. Kieta, nowthe editor of The Fresno Bee inCalifornia, said on Friday.

The fatal shooting a day earlierat The Capital Gazette in Annapo-lis, Md., reverberated throughoutnewsrooms across the country,not only for its tragedy but also for

the familiarity of conflicts like thesuspected gunman’s long-runningfeud with the paper. Many report-ers and editors, especially at thelocal level, have stories of beingconfronted or harassed by a resi-dent upset by something in thenewspaper. Unlike Thursday’sshooting, in which five peoplewere killed, few of these situationsend in violence.

The suspect, Jarrod W. Ramos,38, had hounded the paper foryears, after the publication of anarticle about his conviction in acriminal harassment case involv-ing online threats against a for-mer classmate. He filed lawsuits,posted highly personal commentsabout reporters online and rou-tinely intimated violence on social

In Gunman’s Rage, SomethingEerily Familiar for Newsrooms

By TIM ARANGO and JOHN HERRMAN

Continued on Page A14

SAN FRANCISCO — Computerscientists at Stanford Universityand Google have created technol-ogy that can track time down to100 billionths of a second. It couldbe just what Wall Street is lookingfor.

System engineers at Nasdaq,the New York-based stock ex-change, recently began testing analgorithm and software that theyhope can synchronize a giant net-work of computers with that nano-second precision. They say theyhave built a prototype, and are inthe process of deploying a biggerversion.

For an exchange like Nasdaq,such refinement is essential to ac-curately order the millions ofstock trades that are placed ontheir computer systems every

second.Ultimately, this is about money.

With stock trading now domi-nated by computers that makebuying and selling decisions andexecute them with blazing speed,keeping that order also meansprotecting profits. So-called high-frequency trading firms placetrades in a fraction of a second,sometimes in a bet that they canmove faster than bigger competi-tors.

The pressure to manage thesehigh-speed trades grows when thestock market becomes more vola-tile, as it has been in recentmonths, in part to prevent thefastest traders from taking unfairadvantage of slower firms. High-frequency traders typically ac-

Whittling a New York MinuteTo 100 Billionths of a Second

By JOHN MARKOFF


WASHINGTON — In the daysafter the F.B.I. director James B.Comey was fired last year, thedeputy attorney general, Rod J.Rosenstein, repeatedly expressedanger about how the White Houseused him to rationalize the firing,saying the experience damagedhis reputation, according to fourpeople familiar with his outbursts.

In public, Mr. Rosenstein hasshown no hint that he had secondthoughts about his role — writinga memo about Mr. Comey’s per-formance that the White Houseused to justify firing him. “I wroteit. I believe it. I stand by it,” Mr.Rosenstein said to Congress lastyear.

But in meetings with law en-forcement officials in the chaoticdays immediately after Mr.

Comey’s dismissal, and in subse-quent conversations with col-leagues and friends, Mr. Rosen-stein appeared conflicted, accord-ing to the four people.

He alternately defended his in-volvement, expressed remorse atthe tumult it unleashed, said theWhite House had manipulatedhim, fumed how the news mediahad portrayed the events and saidthe full story would vindicate him,said the people, who in recentweeks described the previouslyundisclosed episodes.

According to one person withwhom he spoke shortly after Mr.Comey’s firing, Mr. Rosensteinwas “shaken,” “unsteady” and“overwhelmed.”

Another person in touch with

Firing of Comey Left RosensteinFeeling ‘Shaken’ and Exploited

By MICHAEL S. SCHMIDT and ADAM GOLDMAN


General Motors warned Fridaythat if President Trump pushedahead with another wave of tar-iffs, the move could backfire, lead-ing to “less investment, fewer jobsand lower wages” for its employ-ees.

The automaker said that thepresident’s threat to impose tar-iffs on imports of cars and carparts — along with an earlierspate of penalties — could drivevehicle prices up by thousands ofdollars. The “hardest hit” cars,General Motors said in commentssubmitted to the Commerce De-partment, are likely to be the onesbought by consumers who canleast afford an increase. Demandwould suffer and productionwould slow, all of which “couldlead to a smaller G.M.”

The president has promotedtariffs as a way to protect Ameri-can businesses and workers, aim-ing at dozens of nations with metaltariffs, as well as bringing broaderlevies against Chinese goods. Butcompanies, which rely on othermarkets for sales, production andmaterials, have been increasinglyvocal about the potential damagefrom his policies.

The warning by G.M., echoed incomments by trade groups andother automakers, could test thepresident’s aggressive approachto trade and his commitment tobusiness. In the past, Mr. Trumphas lauded General Motors for itsjob creation and vowed to defendthe auto industry.

A G.M. spokeswoman, DaynaHart, said that the company hadno contingency plans calling forjob cuts, but that such a move was“something that could happen.”

“We are still assessing the im-pact,” she added.

The White House did not re-spond to a request for comment.

G.M. and other industry leadersare caught in the middle of an es-calating trade war that hasprompted retaliation from the Eu-ropean Union, Mexico, Canadaand China.

Last month, Mr. Trump orderedan investigation into whether im-ported cars and automotive com-ponents pose a national securityrisk, calling for penalties expectedto be as high as 25 percent. The ad-ministration has already put lev-ies on imported steel and alu-minum, and is about place tariffs

G.M. TELLS TRUMPTARIFF PLAN PUTS

U.S. JOBS AT RISK

CAUGHT IN TRADE WAR

Warns Auto Prices CouldRise by Thousands,

Sapping Demand

By TIFFANY HSU

LONDON — Arron Banks, aBritish financier who bankrolledthe campaign for Britain to leavethe European Union, has longbragged about his “boozy six-hour lunch” with the Russian am-bassador eight months before thevote.

Some also wondered about Mr.Banks’s Russian-born wife andtheir custom license plate, X MI5SPY, after the British intelligenceagency, MI5. But Mr. Banks al-ways laughed off questions abouthis ties to the Kremlin.

Now, a leaked record of some ofMr. Banks’s emails suggest thathe and his closest adviser had amore engaged relationship withRussian diplomats than he hasdisclosed.

While Mr. Banks was spendingmore than eight million Britishpounds to promote a break withthe European Union — an out-come the Russians eagerly hopedfor — his contacts at the RussianEmbassy in London were openingthe door to at least three poten-tially lucrative investment oppor-tunities in Russian-owned gold ordiamond mines.

One of Mr. Banks’s businesspartners, and a fellow backer ofBritain’s exit from the EuropeanUnion, or Brexit, took the Rus-sians up on at least one of thedeals.

The extent of these businessdiscussions, which have not beenpreviously reported, raises newquestions about whether theKremlin sought to reward criticalfigures in the Brexit campaign.Much as in Washington, where in-vestigations are underway intothe possibility that Donald J.Trump’s campaign may have co-operated with the Russians, Brit-ain is now grappling with whetherMoscow tried to use its close tieswith any British citizens to pro-mote Brexit.

In Washington, the investiga-tors for the special prosecutor,Robert S. Mueller III, and Demo-crats on the House IntelligenceCommittee have also obtainedrecords of Mr. Banks’s communi-cations, including some with Rus-sian diplomats and about Russianbusiness deals.

And they have taken a specialinterest in close ties Mr. Banksand other Brexit leaders built to

KREMLIN’S LINKSTO BREXIT PUSH

GET A NEW LOOK

COURTING BANKROLLERS

Parallels to U.S. Inquiryas Investigators Focus

on 2016 Meeting

By DAVID D. KIRKPATRICKand MATTHEW ROSENBERG


LAETITIA VANCON FOR THE NEW YORK TIMES

American soldiers in Eastern Europe holding training exercises to combat Russia’s military might and manipulation tactics. Page A7.Battling Tanks, Troops and Twisted Truths

GUADALAJARA, Mexico —Andrés Manuel López Obradornodded at the sea of red T-shirtsand flag-waving devoteesjammed into a plaza in Guadalaja-ra.

Never before had such a crowdwelcomed him here. In his previ-ous campaigns for the president’soffice, residents of Guadalajara,the wealthy capital of the state ofJalisco, shunned him, considering

his leftist platform too radical.But this time, only days before

one of Mexico’s most importantelections in decades, the cheersreflected a nationwide shift — andthe ability of Mr. López Obrador toride it.

“We have had three transfor-mations in the history of our coun-try: our independence, the reformand the revolution,” he told thecrowd. “We are going to pull offthe fourth.”

As corruption and violencegnaw at Mexico’s patience, voters

have turned to a familiar face inMr. López Obrador, a three-timecandidate for president who onceshut down Mexico City for monthsafter a narrow loss, refusing to ac-cept defeat.

Brandishing a deep connectionwith the poor, built over more thana decade of visits to every cornerof this country of 120 million, hehas managed a staggering leadahead of Sunday’s vote.

If the poll numbers bear out onElection Day, Mr. López Obrador— who has promised to sell the

presidential plane and convert theopulent presidential palace into apublic park — could win by a land-slide, putting a leftist leader incharge of Latin America’s second-largest country for the first time indecades.

He is currently 20 to 30 percent-age points ahead of his closest ri-val, a stunning reversal for a poli-tician whose future was far fromclear just a few years ago. But abroad disgust with Mexico’s poli-tical establishment has brought

Once Deemed Too Radical for Mexico, He Now May Be PresidentBy AZAM AHMED

The presidential candidate Andrés Manuel López Obrador during the closing rally of his campaign on Wednesday in Mexico City.ALFREDO ESTRELLA/AGENCE FRANCE-PRESSE — GETTY IMAGES


Months after accusing powerful men ofabuse, 20 people, including AshleyJudd, above, share how saying #MeToochanged their lives.

THIS WEEKEND

Special Section


Chief Ronald R. Spadafora, who keptrescue workers safe at ground zero,died of blood cancer at 63. PAGE A19

NEW YORK A18-20

9/11 Safety Chief Laid to Rest

Despite making no commitments, theagreement seemed to be enough to saveChancellor Angela Merkel of Germanywhile appeasing Italy. PAGE A7

INTERNATIONAL A4-9

E.U. Reaches Migration Deal

As delivery services ramp up, one giantcompany’s goal is to keep your friessucculent for up to 60 minutes. PAGE B1

BUSINESS DAY B1-8

Mission: Crispy for an Hour

LeBron James might join a new team,instantly boosting the fortunes of a cityand its N.B.A. franchise. Or he mightstay in Cleveland. PAGE D1

SPORTSSATURDAY D1-6

The N.B.A.’s Decider

The mayor’s proposal to drop the testfor the city’s elite high schools couldupend its elite middle schools. PAGE A18

Tough Math in School PlanA bold plan to gain greater global influ-ence by funding big projects is laggingas China grows cautious. PAGE B1

China Curtails Lending Spree

A ruling in a Kentucky case may affectother states’ efforts to require the poorto work to get health care. PAGE A16

NATIONAL A10-17

Medicaid Work Rule Blocked

Midterm votes brought a wave of pro-gressive female candidates powered bystrong personal narratives. PAGE A11

Riding an Outsider Wave

“Bao,” running with “Incredibles 2,” isabout a Chinese dumpling and a moth-er’s love. The director says, “Part of mewanted to shock audiences.” PAGE C1

ARTS C1-7

In a Pixar Short, a Dark Twist

Dave Eggers PAGE A23

EDITORIAL, OP-ED A22-23

Late EditionToday, sunny to partly cloudy, hot,humid, high 94. Tonight, clear, verywarm, humid, low 78. Tomorrow,hazy sunshine, very hot, humid,high 98. Weather map, Page A20.

$3.00

dinner at a nice restaurant withhis wife, celebrating their secondanniversary.

Merced Sun-Star in Merced, Calif.,had just published a series of arti-cles that led to the ouster of the lo-cal district attorney. As he waseating, a friend of the district at-torney showed up and asked Mr.Kieta to go outside.

fight right in the middle of thisfancy restaurant,” Mr. Kieta, nowthe editor of The Fresno Bee inCalifornia, said on Friday.

at The Capital Gazette in Annapo-lis, Md., reverberated throughoutnewsrooms across the country,not only for its tragedy but also for

In Gunman’s Rage, Something








By JOHN MARKOFF


Comey’s dismissal, and in subse-quent conversations with col-leagues and friends, Mr. Rosen-stein appeared conflicted, accord-

He alternately defended his in-volvement, expressed remorse atthe tumult it unleashed, said theWhite House had manipulatedhim, fumed how the news mediahad portrayed the events and saidthe full story would vindicate him,said the people, who in recentweeks described the previously

According to one person withwhom he spoke shortly after Mr.Comey’s firing, Mr. Rosensteinwas “shaken,” “unsteady” and


Feeling ‘Shaken’ and Exploited

Today, sunny to partly cloudy, hot,humid, high 94. Tonight, clear, verywarm, humid, low 78. Tomorrow,hazy sunshine, very hot, humid,high 98. Weather map, Page A20.

$3.00

dinner at a nice restaurant withhis wife, celebrating their secondanniversary.

Merced Sun-Star in Merced, Calif.,had just published a series of arti-cles that led to the ouster of the lo-cal district attorney. As he waseating, a friend of the district at-torney showed up and asked Mr.Kieta to go outside.

fight right in the middle of thisfancy restaurant,” Mr. Kieta, nowthe editor of The Fresno Bee inCalifornia, said on Friday.

at The Capital Gazette in Annapo-lis, Md., reverberated throughoutnewsrooms across the country,not only for its tragedy but also for

In Gunman’s Rage, Something








By JOHN MARKOFF


Comey’s dismissal, and in subse-quent conversations with col-leagues and friends, Mr. Rosen-stein appeared conflicted, accord-

He alternately defended his in-volvement, expressed remorse atthe tumult it unleashed, said theWhite House had manipulatedhim, fumed how the news mediahad portrayed the events and saidthe full story would vindicate him,said the people, who in recentweeks described the previously

According to one person withwhom he spoke shortly after Mr.Comey’s firing, Mr. Rosensteinwas “shaken,” “unsteady” and


Feeling ‘Shaken’ and Exploited

Today, sunny to partly cloudy, hot,humid, high 94. Tonight, clear, verywarm, humid, low 78. Tomorrow,hazy sunshine, very hot, humid,high 98. Weather map, Page A20.

$3.00

Focus&so&far:&Sense&and&Infer

Future&focus:&Learn&and&Control&using&Smart&NICs

Applications

DC-Interconnect-Fabric

NIC4centric-Architecture:-Sense,-Infer,-Learn-and-Control

App-1

App-2

App-3

Sense,Infer

Learn,Control

Deliberate)Control• Acts)on)a)collection(or(group(of)NICs)• To)achieve)a)common(global(objective• Involves)computation)or)decision4making(with(global(knowledge• Generally)applied)over)longer(timescales• Networking(analogy:((Management)plane• Financial(trading(analogy:((Market)data)! trading)strategy)

(performed)in)large)compute)clusters)Reflex)Control

• Applied)at)a)single)NIC• To)perform)local)tasks)derived)from/consistent)with)global)objective• Relies)on)local)information)at)the)given)NIC• Generally)applied)on)every)packet)or)roundFtrip)time)or)…)• Networking(analogy:((Data)plane• Financial(trading(analogy:((trading)strategy)! buy/sell)bids

(performed)in)FPGAs)in)coFlo)facilities)

Two$tier)Control)Architecture

Instantaneous Episodic

Local,Single3NIC

Global,Group3of3NICs

Space

Time

ReflexControl

DeliberateControl

First,'use'NICs'to'sense'and'infer'network'state• Synchronize'clocks'on'NICs'(Huygens)• Use'synced'clocks'and'edge?based'measurements'to'infer'network'state'(SIMON)• Note: both'Huygens'and'SIMON'are'amenable'to'the'two?tier'architecture'

! Implement'them'in'Smart'NICs'as'co?ordinated distributed'systems

Then,'devise'and'apply'control;'working'on• Controlling'RDMA'flows• Congestion'control'with'source'routing

Roadmap

Shiyu Liu:((Smart(NICs(I• Deliberate(control:(Implementation(of(the(Huygens(algorithm

using(Mellanox(and(Broadcom(NICs(

Sean(Choi:(Smart(NICs(II• Reflex(control:(Profiling(serverless(compute(workloads((

with(P4(on(Netronome NICs

Shiyu Liu:((SIMON(with(CPU(time(stamps(vs(NIC(time(stamps• A(comparative(study(of(accuracy(of(network(state(reconstruction(on(CloudLab

Remaining(Talks

selfaprogramming&networks · d? 2b5h9d @ec8 75d 1 >5g

Documents