1

Week #9 File Services

• DFS Overview

• Configuring DFS Namespaces

• Configuring DFS Replication

• Windows Server 2008 Storage Management Overview

• Managing Storage Using File Server Resource Manager

• Configuring Quota Management

• Implementing File Screening

• Managing Storage Reports

2

What Is the Distributed File System?

DFS technologies include:

• DFS Namespaces - provide a virtual view of shared folders located on different servers

• DFS Replication - provides high-availability and fault-tolerance to files and folders

• Remote Differential Compression - provides a compression technology that is optimized for data transfers over limited-bandwidth networks

The Distributed File System incorporates technologies that provide fault-tolerant access to geographically dispersed filesThe Distributed File System incorporates technologies that provide fault-tolerant access to geographically dispersed files

3

How DFS Namespaces and DFS Replication Work

User types: \\contoso.com\marketing Client computers contact a namespace server and receive a referralUser types: \\contoso.com\marketing Client computers contact a namespace server and receive a referral11

Client computers cache the referral and then contact the first server in the referralClient computers cache the referral and then contact the first server in the referral22

Server in LondonServer in London

User in New YorkUser in New York

DFS Replication

11

11

22

22NamespaceNamespace

\\Contoso.com\Marketing

\\LON-SRV-01\ProjectDocs

\\NYC-SRV-01\ProjectDocs

User in LondonUser in London

Server in New YorkServer in New York

FolderTargets

4

DFS Scenarios

Data distribution

ExampleScenario

Data collection

Sharing files across branch offices

Data distribution

ExampleScenario

Data collection

Sharing files across branch offices

Hub siteHub site Branch officeBranch office

Hub siteHub site Site 1Site 1

Hub siteHub site Branch officeBranch office

Site 2Site 2

5

Types of DFS Namespaces

Characteristic Domain-based Stand-alone

Path \\Domainname\Namespace

\\Servername\Namespace

Location Active Directory and memory cache

Server registry and memory cache

Size

• Up to 5,000 folders with targets in Windows°2000 Server mode

• Up to 50,000 folders with targets in Windows°Server 2008 mode

Up to 50,000 folders with targets

Availability Namespace hosted on multiple servers Server cluster

DFS Replication Supported Supported

6

What Are Folders and Folder Targets?

Folders:

• Are the primary elements of a namespace

• Have at least one folder target

Folder targets include:

• Shared folders (\\server\share)

• Folders in a shared folder (\\server\share\folder)

• A path to another namespace (\\domainname\rootname)

NamespaceNamespaceNamespaceServer

Folder TargetsFolder Targets

NamespaceRoot

Folder

Folders withTargets

\\LDN-SRV-01\ToolsLondon

\\NYC-SRV-01\ToolsNew York

\\NYC-SRV-02\TrainingNew York

\\Contoso\Public

Software

Tools

Training Guides

7

Namespace Server Requirements

A namespace server is:

• A domain controller or member server

• Windows Server™2003 or Windows Server°2008

Namespace server considerations:

• Must contain an NTFS volume to host the namespace

• Must be in the same domain if the namespace is domain-based

• Cannot be a clustered resource if the namespace is domain-based

8

Deploying Namespaces for Publishing Content

To configure a namespace for publishing content:

Optional tasks:

Create a namespace 11

Add folder targets 33

Create a folder in the namespace 22

Set target priority to override referral ordering 55

Set the ordering method for targets in referrals 44

Enable client failback 66

Replicate folder targets using DFS-R 77

You may also need to delegate the ability to create and manage namespaces

9

Security Requirements for Creating and Managing a Namespace

Task Group

Create a domain-based namespace Domain Admins

Add a namespace server to a domain-based namespace

Domain Admins

Manage a domain-based namespace

Local Administrators on each namespace server

Create a stand-alone namespace

Local Administrators group on the namespace server

Manage a stand-alone namespace

Local Administrators group on the namespace server

Implement DFS replication Domain Admins

10

Increasing Availability of a Namespace

Domain-based namespace:

• Specify additional namespace servers

Stand-alone namespace:

• Create a stand-alone namespace as a cluster resource

Folders:

• Specify additional folder targets

• Replicate folders using DFS Replication

11

What Is DFS Replication?

• Uses remote differential compression to efficiently update files over a limited-bandwidth network

• Detects changes on the volume by monitoring the USN journal

• Uses a staging folder to stage a file before sending and receiving it

• Uses a version vector exchange protocol to determine what files need to be synchronized

• Uses a conflict resolution heuristic of “last writer wins” for files that are in conflict and “earliest creator wins” for name conflicts

• Is self-healing and can automatically recover from failure

DFS-R is a multimaster replication engine that supports replication scheduling and bandwidth throttlingDFS-R is a multimaster replication engine that supports replication scheduling and bandwidth throttling

12

What Are Replication Groups and Replicated Folders?

Member

Projects

Proposals

Projects

Proposals

ReplicatedFolders

Projects\Spec.doc

Proposals\Budget.xls

Connection

Replication GroupReplication Group

• Replication Group

• A set of servers, known as members, that participate in replicating one or more replicated folders

• Can be configured for multipurpose or data collection purposes

• Replicated Folder

• A folder that is kept synchronized on each member

13

DFS Replication Requirements

DFS-R Requirements include:

• The Active Directory schema must include the DFS replication objects

• Servers must be Windows Server°2003 R2 or Windows Server °2008, and must have the DFS replication service installed

• Servers in a replication group must be in the same forest

• Replicated folders must be stored on NTFS volumes

• On server clusters, replicated folders must be located in the node’s local storage

• Antivirus software must be compatible with DFS Replication

14

Scalability Considerations for DFS Replication

Scalability considerations include:

• Each server can be a member of up to 256 replication groups

• Each replication group can contain up to 256 replicated folders

• Each server can have up to 256 connections

• The number of replication groups multiplied by the number of replicated folders multiplied by the number of simultaneously active connections must be kept to 1024 or fewer

• A replication group can contain up to 256 members

• A volume can contain up to 8 million replicated files, and a server can contain up to 1 terabyte of replicated files

• The maximum tested file size is 64 gigabytes

15

Process for Deploying a Multipurpose Replication Group

Select the type of replication group to create11

Add the replication group members33

Specify the name and domain 22

Specify the replication group schedule and bandwidth55

Specify a topology44

Specify the primary member66

Specify the folders to replicate and the local path on member servers

77

16

Understanding the Initial Replication Process

Replication of DFS Replication settings11

Files are moved to DfsrPrivate\PreExisting33

The primary member starts replication 22

Primary member designation is removed55

Files are compared and replicated44

17

Generating Diagnostic Reports and Propagation Tests

Use the Diagnostic Report Wizard to:

• Create a health report

• Start a propagation test

• Create a propagation report

18

Capacity and Storage Management Challenges Capacity management challenges include:

• Determining existing storage capacity and usage trendsacross the organization

• Determining whether usage effectively supportsorganizational goals

• Defining and implementing storage policies

• Adjusting the policies as capacity needs grow, and asorganizational needs change

Storage management challenges include:• Rapid growth in storage requirements from 60 to 100% /yr

• Mission-critical data must be available continuously

• Organizations must comply with the latest regulatory requirements

• The number of storage-intensive applications on the market has increased

19

Addressing Capacity and Storage Management Challenges

Consider the following to help address capacity and storage management challenges:

• Analyze how storage is being used

• Define storage resource management policies

• Implement policies to attempt to slow storage growth

• Acquire tools to implement policies

20

What Is File Server Resource Manager?

Monitors usage patterns and utilization levelsMonitors usage patterns and utilization levelsCapacity Management

Restricts unauthorized files (file screening)Restricts unauthorized files (file screening)Policy Management

Controls the amount of space used for a volume, folder, or share

Quota Management

Provides extensive storage reportsProvides extensive storage reportsReports

File Server Resource Manager is a File Services role that integrates: File Server Resource Manager is a File Services role that integrates:

21

FSRM Functions

Using FSRM, you can perform the following tasks:

• Create quotas to limit the space allowed for a volumeor folder

• Have quotas automatically generated

• Create file screens

• Monitor attempts to save unauthorized files

• Define quota and file screening templates

• Generate scheduled or on-demand storage reports

22

FSRM Console Components

23

FSRM Configuration Options

FSRM configuration options include:

• Configuring e-mail notifications

• Configuring the default parameters for storage reports

• Changing report repository locations

• Configuring file screen audit

24

What Is Quota Management?

Notification thresholds can be configured to:

• Send e-mail notifications

• Log an event

• Run a command or script

• Generate storage reports

Limiting storage space via a hard or soft quota and generating notifications when the limits are approachedor exceeded

Limiting storage space via a hard or soft quota and generating notifications when the limits are approachedor exceeded

25

FSRM Quotas vs. NTFS Disk Quotas

Quota Features NTFS Disk Quotas FSRM Quotas

Quota Tracking Per user/per volume By folder or by volume

Disk Usage Calculation Logical file size Actual disk space

Notification Mechanisms Event logs only

E-mail, custom reports, command execution, event logs

26

What Are Quota Templates?

A quota template defines:

• A space limit

• The type of quota (hard or soft quota)

• A set of notifications to be generated when the quota limit is approached

A number of default Quota Templates are provided in the Quota Management node of FSRM

27

Creating and Modifying a Quota

When creating a quota, options include:

Modify a quota by:

• Updating quotas by editing a quota template

• Editing an auto quota

• Updating individual quotas listed in the details pane

• Create quota on path

• Auto apply template and create quotas on existing and new subfolders

Dirquota {Quota | Autoquota | Template | Admin}

28

Monitoring Quota Usage

You can monitor quota usage by:

• Viewing quota information

• Generating a Quota Usage report

• Creating soft quotas

Quotas typically have an I/O performance overhead of 10 percent or less

29

What Is File Screening?

The File Screening Management node allows you to:

• Create file screens

• Define file screen templates

• Create file screen exceptions

• Create file groups

Provides a flexible method to control the types of files that are saved on company serversProvides a flexible method to control the types of files that are saved on company servers

30

What Are File Groups?

A file group consists of a set of file name patterns, which are grouped into:

• Files to include

• Files to exclude

Used to define a namespace for a file screen, file screen exception, or storage reportUsed to define a namespace for a file screen, file screen exception, or storage report

31

What Is a File Screen Exception?

A file screen exception overrides any file screen that would otherwise apply to a folder and all its subfolders in a designated exception path

32

What Is a File Screen Template?

A file screen template defines:

• Which file groups to block

• The type of screening to perform

• A set of notifications to be generated

33

What Are Storage Reports?

Types of storage reports include:

• Large Files

• Files by Owner

• Files by File Group

• Duplicate Files

• Least Recently Used Files

• Most Recently Used Files

• Quota Usage

• File Screening Audit

Storage reports provide information about file usage on a file serverStorage reports provide information about file usage on a file server

34

What Is a Report Task?

A report task specifies:

You can schedule reports by creating a Report TaskYou can schedule reports by creating a Report Task

• The volumes and folders to report on

• Which reports to generate

• What parameters to use

• How often to generate the reports

• Which file formats to save the reports in

35

Generating On-Demand Reports

Use the Generate Reports Now action to open Storage Reports Task Properties and select desired reports

Use the Generate Reports Now action to open Storage Reports Task Properties and select desired reports