Results of 1 - 2 of about 2 for stopwords (0.001 sec.)
- Full-Text Search Extension 11228
- Full-Text Search is an extension to DuckDB that allows for search through strings, similar to SQLite's FTS5 extension . Installing and Loading The fts extension will be transparently autoloaded on first use from the official extension repos
...nally by the extension. PRAGMA create_fts_index create_fts_index(input_table, input_id, *input_values, stemmer = 'porter', stopwords = 'english', ignore = '(\\.|[^a-z])+', strip_accents = 1, lower = 1, overwrite = 0, incremental = 0) PRAGMA that creates a...' , 'serbian' , 'spanish' , 'swedish' , 'tamil' , 'turkish' , or 'none' if no stemming is to be used. Defaults to 'porter' stopwords VARCHAR Qualified name of table containing a single VARCHAR column containing the desired stopwords, or 'none' if no stopw...ords are to be used. Defaults to 'english' for a pre-defined list of 571 English stopwords ignore VARCHAR Regular expression of patterns to be ignored. Defaults to '(\\.|[^a-z])+' , ignoring all escaped and non-al... - https://man.mtool.work/duckdb/2.0/core_extensions/full_text_search.html
- Analyzing a Git Repository 7485
- You can use DuckDB to analyze Git logs using the output of the git log command . Exporting the Git Log We start by picking a character that doesn't occur in any part of the commit log (author names, messages, etc). Since version v1.2.0, Duc
...( message .lower() .regexp_replace('\W', ' ') .trim(' ') .string_split_regex('\W') ) AS word FROM commits; Then, we remove stopwords using a pre-defined list: CREATE TABLE stopwords AS SELECT unnest(['a', 'about', 'above', 'after', 'again', 'against', 'al...'you', 'your', 'yours', 'yourself', 'yourselves']) AS word; CREATE OR REPLACE TABLE words AS FROM words NATURAL ANTI JOIN stopwords WHERE word != ''; We use the NATURAL ANTI JOIN clause here, which allows us to elegantly filter out values that occur in t...he stopwords table. Finally, we select the top-20 most common words. SELECT word, count(*) AS count FROM words GROUP BY ALL ORDER BY co... - https://man.mtool.work/duckdb/2.0/guides/snippets/analyze_git_repository.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work