PatternTokenizer Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Tokenizer that uses regex pattern matching to construct distinct tokens. This tokenizer is implemented using Apache Lucene. http://lucene.apache.org/core/4_10_3/analyzers-common/org/apache/lucene/analysis/pattern/PatternTokenizer.html
[Newtonsoft.Json.JsonObject("#Microsoft.Azure.Search.PatternTokenizer")]
public class PatternTokenizer : Microsoft.Azure.Search.Models.Tokenizer
[<Newtonsoft.Json.JsonObject("#Microsoft.Azure.Search.PatternTokenizer")>]
type PatternTokenizer = class
inherit Tokenizer
Public Class PatternTokenizer
Inherits Tokenizer
- Inheritance
- Attributes
-
Newtonsoft.Json.JsonObjectAttribute
Constructors
PatternTokenizer() |
Initializes a new instance of the PatternTokenizer class. |
PatternTokenizer(String, String, Nullable<RegexFlags>, Nullable<Int32>) |
Initializes a new instance of the PatternTokenizer class. |
Properties
Flags |
Gets or sets regular expression flags. Possible values include: 'CANON_EQ', 'CASE_INSENSITIVE', 'COMMENTS', 'DOTALL', 'LITERAL', 'MULTILINE', 'UNICODE_CASE', 'UNIX_LINES' |
Group |
Gets or sets the zero-based ordinal of the matching group in the regular expression pattern to extract into tokens. Use -1 if you want to use the entire pattern to split the input into tokens, irrespective of matching groups. Default is -1. |
Name |
Gets or sets the name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters. (Inherited from Tokenizer) |
Pattern |
Gets or sets a regular expression pattern to match token separators. Default is an expression that matches one or more whitespace characters. |
Methods
Validate() |
Validate the object. |