Having most of lmdb pages loaded in memory speed up a lot the processing even though it requires a lot of RAM.
Maybe we could add an option (in the config files) or a REST end point to force the full (almost full?) loading of some lmdb databases ofr a given languages (the ones that are required to do a disambiguation):
- pages db ?
- concepts db?
- labels db ?
This should be as simple as opening a cursor on every lmdb db and iterate till the end.
What do you think ?
Best regards
Olivier Terrier
Having most of lmdb pages loaded in memory speed up a lot the processing even though it requires a lot of RAM.
Maybe we could add an option (in the config files) or a REST end point to force the full (almost full?) loading of some lmdb databases ofr a given languages (the ones that are required to do a disambiguation):
This should be as simple as opening a cursor on every lmdb db and iterate till the end.
What do you think ?
Best regards
Olivier Terrier