predictive modeling in retail - sas group...the overall objectives of the retail predictive modeling...

18
Predictive Modeling in Retail Jim Godfrey – SAS Institute (Canada) Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Upload: others

Post on 06-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Predictive Modeling in RetailJim Godfrey – SAS Institute (Canada)

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 2: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

ObjectivesObjectives

The overall objectives of the Retail Predictive Modeling activities:Modeling activities:• Build three predictive models to support the development

and execution of three marketing campaigns.• Build the process required to extract the required data for

model development and for ongoing scoring.• Knowledge transfer with the Modeling resource to make

h bl hsure they are able to repeat the process

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 3: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Predictive ModelsPredictive Models

Campaign Response Model – this model predicts the likelihood that a customer responds to a specific campaign bylikelihood that a customer responds to a specific campaign by purchasing a products solicited in the campaign. The model also predicts the amount of the purchase given response.

Cross Shop Model – This model predicts the likelihood that aCross Shop Model This model predicts the likelihood that a customer who has not made any purchases from a specific department within the company in the previous 18 months makes a purchase from this department within the target

th I dditi th d l di t th t f thmonth. In addition, the model predicts the amount of the purchase.

Four-month Reactivation Model – This model predict the lik lih d th t t h h t d hlikelihood that a customer who has not made any purchases from the company at all in the previous four months spontaneously makes a purchase within the target month. Similar to the other two models, this model also predicts the

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

, pamount of purchase given reactivation.

Page 4: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Data Sources and Model InputsData Sources and Model Inputs

The model inputs include variables created from the following sources within the SAS data mart:sources within the SAS data mart:

• Customer Transactions• Transaction Tender• Distinct Counts• Customer Promotion History• Customer Characteristics

Counts and Amounts by Division/ClassCounts and Amounts by Division/Class

Counts and Amounts by transaction tender

Past promotions

Store visits

Etc.

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 5: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Sliding Windows ConceptSliding Windows ConceptFeb05

Mar05

Apr05

May05

Jun05

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jul07

Aug07

Sep07

Oct07

Nov07

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jul07

Aug07

Sep07

Oct07

Nov07

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jul07

Aug07

Sep07

Oct07

Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug SepOct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jul07

Aug07

Sep07

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jul07

Aug07

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jul07

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

Jun07

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

May07

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Apr07

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Mar07

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Feb07

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Dec06

Jan07

Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec06 06 06 06 06 06 06 06 06 06 06 06

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Nov06

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Oct06

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Sep06

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Aug06

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jul06

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

Jun06

Jun05

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

May06

May05

Jun05

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Apr06

Apr05

May05

Jun05

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Mar06

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

05 05 05 05 05 05 05 05 05 06 06 06

Mar05

Apr05

May05

Jun05

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Feb06

Feb05

Mar05

Apr05

May05

Jun05

Jul05

Aug05

Sep05

Oct05

Nov05

Dec05

Jan06

Page 6: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Additional Summary Model InputsAdditional Summary Model Inputs

Overall Average

Average for month 1-3 of the windowAverage for month 1-3 of the window

Average for month 4-6 of the window

Average for month 7-9 of the window

A f th 10 12 f th i dAverage for month 10-12 of the window

Standard Deviation for month 1-3 of the window

Standard Deviation for month 4-6 of the window

Standard Deviation for month 7-9 of the window

Standard Deviation for month 10-12 of the window

Trend variable over all 12 months in the window (SLOPE of a regression of the ariable against month)variable against month)

Proportion of visits by location (store)

Proportions of fees, markdowns, sales, returns and discounts

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 7: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Data Extraction ProcessData Extraction Process

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 8: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response ModelCampaign Response Model

The purpose of this model is to predict those customers that are likely to respond to a specific campaign; irrespective if it isare likely to respond to a specific campaign; irrespective if it is a Fall or Spring campaign. This model will be used to score and select a population to receive the Fall campaign from the company.

Response to the campaign is implied through observing customer’s shopping behavior during the response period using the following conditions:

• The customer has shopped and purchased items identified as solicited items within the allocated response period OR

• The customer has shopped and purchased any items within the allocated response periodp p

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 9: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response ModelModel

Timeframes

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 10: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response p g pModel

Timeframes

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 11: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response Model – Population and TargetsCampaign Response Model Population and TargetsCampaign Model Population

C fCampaign Model Target Definitions:• English Definition: A prospect, after receiving the solicitation, shops at

the store and makes a purchase within the observational period.• Data Definition: if TRANS BUSINESS DATE between (start date• Data Definition: if TRANS.BUSINESS_DATE between (start_date,

end_date) AND TRANS.SALES_TYPE = ‘Sale’ and TRANS.SALES_AMOUNT > 0 then t = 1, else t = 0.

• Target = MAX(t) by CUSTOMOER_ID• English Definition: A prospect, after receiving the campaign solicitation,

shops at the store and makes a purchase of an item featured in the campaign within the observational period.

• Data Definition: if TRANS.BUSINESS_DATE between (start_date, end_date) AND TRANS.SALES_TYPE = ‘Sale’ and TRANS.SALES_AMOUNT > 0 AND SKU_EXTENDED_DETAILS.BOOK_CODE = ‘specific campaign code’ then t = 1, else t = 0.

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

• Target = MAX(t) by CUSTOMOER_ID

Page 12: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response Model – Preliminary Variable SelectionCampaign Response Model Preliminary Variable Selection

The initial set of potential model inputs was refined though a semi-automatic process:semi automatic process:

Selection Step Variables Kept Variables Dropped

Start 3,890 -

Uniary 3,474 416

Sparse 2,179 1,295

Redundant 503 1,676

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 13: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response Model – ResultsCampaign Response Model Results

Binary Target - % Captured Response

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 14: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response Model – ResultsCampaign Response Model Results

Amount Target - % Captured Response

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 15: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response Model – ResultsCampaign Response Model Results

Campaign Sales vs. Any Sales

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 16: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Campaign Response Model – ResultsCampaign Response Model Results

Binary Model

Amount Model

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 17: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Questions

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only

Page 18: Predictive Modeling in Retail - SAS Group...The overall objectives of the Retail Predictive Modeling activities:Modeling activities: • Build three predictive models to support the

Copyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use onlyCopyright © 2006, SAS Institute Inc. All rights reserved. Company confidential - for internal use only