Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Allow processing multiple interactions concurrentlyΒ #43

@marcelklehr

Description

@marcelklehr

How to use GitHub

  • Please use the πŸ‘ reaction to show that you are interested into the same feature.
  • Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
  • Subscribe to receive notifications on status change and new comments.

Feature request

Which Nextcloud Version are you currently using: NA

Is your feature request related to a problem? Please describe.
In order to allow scaling this app to many users, it would make sense to allow concurrent processing of tasks to speed up the results for users.

Describe the solution you'd like
Currently context_agent processes one task after the other, but there is no inherent need to wait for the previous task, since the processing is mostly done in the llm implementation anyway, which is not in this app. So, we should be able to process tasks concurrently using python's asyncio to speed up result generation for users.

Describe alternatives you've considered
NA

Additional context
NA

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions