Max Maischein
|
12d982ffec
|
Silence a compilation warning on Mac/clang
Gcc doesn't warn on this (at my settings) but Github automation found
this one
|
2025-02-21 21:10:28 +01:00 |
|
Max Maischein
|
a83a495af1
|
Note an optimization, for later
|
2025-02-21 21:10:28 +01:00 |
|
Max Maischein
|
e521f92bf6
|
The test suite now passes without segfaults or anything
|
2025-02-21 21:10:28 +01:00 |
|
Max Maischein
|
1ad93cacc0
|
Fix all type errors
|
2025-02-21 21:10:28 +01:00 |
|
Max Maischein
|
8c076159d2
|
WIP: Stuff needed for FTS5
|
2025-02-21 21:10:28 +01:00 |
|
Max Maischein
|
30e4ee67e9
|
Rename "perl_tokenizer" to "perl_fts3_tokenizer"
This is because we will soon have two styles of tokenizers, one for
the FTS3 / FTS4 API and one for the FTS5 API
# Conflicts:
# dbdimp_tokenizer.inc
|
2025-02-21 21:10:28 +01:00 |
|
Kenichi Ishigaki
|
31483a245f
|
Merge branch 'string_mode'
|
2021-05-30 21:18:42 +09:00 |
|
Felipe Gasper
|
9dc75eaead
|
Replace “string_unicode” boolean with “string_mode” enum.
Issue #78 and issue #68: This introduces additional, more robust
schemas for translating strings between SQLite and Perl.
|
2021-05-29 19:19:58 -04:00 |
|
dami
|
6669dbc332
|
cleanup tokenizer code and test
|
2021-05-13 12:27:57 +02:00 |
|
dami
|
80c7c91ae6
|
better variable names and comments
|
2021-05-11 09:40:24 +02:00 |
|
dami
|
b5c3f9d528
|
fixed #75 -- lastCharOffset must copy the OLD value of piEndOffset, BEFORE it is recomputed
also fixed 43_fts3.t so that it uses \p{Word} instead of \w, because en-us locale did not handle accented characters
|
2021-05-09 22:06:28 +02:00 |
|
Kenichi Ishigaki
|
e17149317a
|
re-enable perl tokenizer by calling sqlite3_db_config if SQLite >= 3.12
|
2016-11-26 10:07:24 +09:00 |
|
Kenichi Ishigaki
|
e9ae705fb6
|
split dbdimp.c and move tokenizer/virtual table-related code into .inc files
|
2016-02-16 12:23:09 +09:00 |
|