Important

Reorder freeAllTokenizers() call in onShutdown to occur after terminating tokenization worker threads in shutdown.ts.

• Behavior:
  • Move freeAllTokenizers() call in onShutdown in shutdown.ts to occur after terminating tokenization worker threads.
  • Ensures tokenizers are freed from memory only after worker threads are terminated.
• Logging:
  • Adjust log message order to reflect new shutdown sequence in shutdown.ts.

^{This description was created by for c08bbfc. You can customize this summary. It will automatically update as commits are pushed.}