Class Tokenizer

Tokenizer class performs lexical analysis for the TestSelectionParser. It recognizes a very limited set of tokens: words, symbols and quoted strings. This is sufficient for the simple DSL we use to select which tests to run.

Inheritance

object

Tokenizer

Inherited Members

object.GetType()

object.MemberwiseClone()

object.ToString()

object.Equals(object)

object.Equals(object, object)

object.ReferenceEquals(object, object)

object.GetHashCode()

Namespace: NUnit.Common

Assembly: nunitlite.dll

Syntax

public class Tokenizer

Constructors

Tokenizer(string)

Declaration

public Tokenizer(string input)

Parameters

Type	Name	Description
string	input

Properties

LookAhead

Declaration

public Token LookAhead { get; }

Property Value

Type	Description
Token

Methods

NextToken()

Declaration

public Token NextToken()

Returns

Type	Description
Token