An Improved Algorithm to Accelerate Regular

Expression EvaluationAuthor ： Michela Becchi 、 Patrick CrowleyPublisher ： ANCS’07Presenter ： Wen-Tse LiangDate ： 2010/11/17

1

Introduction D2FA Improved Algorithm Experiment Evaluation

Outline

2

Kumar et al. [9] observe that many states in DFAs have similar sets of outgoing transitions. Substantial space savings in excess of 90% are achievable in current rule-sets when this redundancy is exploited.

The proposed automaton, called a Delayed Input DFA (D2FA), replaces redundant transitions common to a pair of states with a single default transition.

3

Introduction

In this paper, we propose an improved yet simplified algorithm for building default transitions that addresses these problems.

On practical data sets, the level of compression achieved is similar than the original D2FA scheme, while providing a superior worst-case memory bandwidth bound.

4

Introduction

Consider two states u and v, where both u and v have a transition labeled by the symbol a to a common third state w, and no default transition.

If we introduce a default transition from u to v, we can eliminate the a-transition from u without affecting the destination state function δ(x).

5

D2FA

6

D2FA

two automata on the input string aabdbc.

Note that by the same reasoning, if there are multiple symbols a, for which u has a labeled outgoing edge and for which δ(a,u)=δ(a,v), the introduction of a default edge from u to v allows us to eliminate all these edges.

7

D2FA

8

D2FA

The edge joining a pair of vertices (states) u and v is assigned a weight w(u,v) that is one less than the number of symbols a for which δ(a,u)=δ(a,v).

9

D2FA

The natural way to avoid long default paths is to construct a maximum weight spanning tree with a specified bounded diameter.

10

D2FA

Diameter bound of 4

11

D2FA

Diameter bound of 2

12

D2FA

in order to propose a more general compression algorithm which leads to a traversal time bound independent of the maximum default transition path length.

we define its depth as the minimum number of states visited when moving from s0 to s in the DFA. In other words, the initial state s0 will have depth 0, the set of states S1 directly reachable from s0 will have depth 1, the set of states S2 directly reachable from any of the S1 (but not from s0) will have depth 2, and so on.

13

Improved Algorithm

Lemma: If none of the default transitions in a

D2FA lead from a state with depth di to a state of depth dj with dj ≥ di, then any string of length N will require at most 2N state traversals to be processed.

In other words, a 2N time bound is guaranteed on all D2FA having only “backwards” transitions. In a sense, this can be thought of as a generalization of to regular expressions.

14

Improved Algorithm

15

Improved Algorithm

16

Experiment Evaluation