unicode: reduce the size of utf8data[]
Remove the Hangul decompositions from the utf8data trie, and do algorithmic decomposition to calculate them on the fly. To store the decomposition the caller of utf8lookup()/utf8nlookup() must provide a 12-byte buffer, which is used to synthesize a leaf with the decomposition. This significantly reduces the size of the utf8data[] array. Changes made by Gabriel: Rebase to mainline Fix checkpatch errors Extract robustness fixes and merge back to original mkutf8data.c patch Regenerate utf8data.h Signed-off-by:Olaf Weber <olaf@sgi.com> Signed-off-by:
Gabriel Krisman Bertazi <krisman@collabora.co.uk> Signed-off-by:
Theodore Ts'o <tytso@mit.edu>
Showing
- fs/unicode/README.utf8data 2 additions, 2 deletionsfs/unicode/README.utf8data
- fs/unicode/utf8-norm.c 171 additions, 20 deletionsfs/unicode/utf8-norm.c
- fs/unicode/utf8data.h 2851 additions, 12624 deletionsfs/unicode/utf8data.h
- fs/unicode/utf8n.h 4 additions, 0 deletionsfs/unicode/utf8n.h
- scripts/mkutf8data.c 268 additions, 39 deletionsscripts/mkutf8data.c
Loading
Please register or sign in to comment