-
Notifications
You must be signed in to change notification settings - Fork 3
Open
Labels
enhancementNew feature or requestNew feature or request
Description
How to use GitHub
- Please use the π reaction to show that you are interested into the same feature.
- Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
- Subscribe to receive notifications on status change and new comments.
Feature request
Which Nextcloud Version are you currently using: NA
Is your feature request related to a problem? Please describe.
In order to allow scaling this app to many users, it would make sense to allow concurrent processing of tasks to speed up the results for users.
Describe the solution you'd like
Currently context_agent processes one task after the other, but there is no inherent need to wait for the previous task, since the processing is mostly done in the llm implementation anyway, which is not in this app. So, we should be able to process tasks concurrently using python's asyncio to speed up result generation for users.
Describe alternatives you've considered
NA
Additional context
NA
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request