Skip to content

Conversation

@louis-jan
Copy link
Contributor

Problem

  • So many services to register, plugin dev does not work which services belong to which kind of plugin

Solution

  • Revamp inference to work with plugin sdk

@louis-jan louis-jan force-pushed the feat/inference-plugin-revamp branch from 45b702f to 7cc2648 Compare November 4, 2023 03:02
@louis-jan louis-jan requested review from namchuai and urmauur November 4, 2023 03:20
@louis-jan louis-jan force-pushed the feat/inference-plugin-revamp branch from 7cc2648 to 95b410a Compare November 4, 2023 03:21
@louis-jan louis-jan marked this pull request as ready for review November 4, 2023 03:26
export abstract class InferencePlugin extends JanPlugin {
abstract initModel(modelFileName: string): Promise<void>;
abstract stopModel(): Promise<void>;
abstract inferenceRequest(data: NewMessageRequest): Promise<any>
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: Give response type here

@louis-jan louis-jan merged commit bd67a28 into feat/revamp-plugin-arch Nov 4, 2023
@louis-jan louis-jan deleted the feat/inference-plugin-revamp branch November 4, 2023 03:30
louis-jan added a commit that referenced this pull request Nov 6, 2023
chore: add facades

refactor: core module export

refactor: inference plugin - deprecate function registering (#537)

* refactor: revamp inference plugin as class - deprecate function registering

* refactor: monitoring plugin - deprecate service registering (#538)

refactor: revamp inference plugin as class - deprecate function registering

chore: update import

refactor: plugin revamp - model management

chore: update build steps and remove experimental plugins

refactor: remove pluggable electron

chore: add sorting for conversations

chore: build plugins for testing

chore: consistent plugin directory name

chore: docs

chore: fix CI

chore: update conversation prefix
louis-jan added a commit that referenced this pull request Nov 6, 2023
chore: add facades

refactor: core module export

refactor: inference plugin - deprecate function registering (#537)

* refactor: revamp inference plugin as class - deprecate function registering

* refactor: monitoring plugin - deprecate service registering (#538)

refactor: revamp inference plugin as class - deprecate function registering

chore: update import

refactor: plugin revamp - model management

chore: update build steps and remove experimental plugins

refactor: remove pluggable electron

chore: add sorting for conversations

chore: build plugins for testing

chore: consistent plugin directory name

chore: docs

chore: fix CI

chore: update conversation prefix
louis-jan added a commit that referenced this pull request Nov 6, 2023
chore: add facades

refactor: core module export

refactor: inference plugin - deprecate function registering (#537)

* refactor: revamp inference plugin as class - deprecate function registering

* refactor: monitoring plugin - deprecate service registering (#538)

refactor: revamp inference plugin as class - deprecate function registering

chore: update import

refactor: plugin revamp - model management

chore: update build steps and remove experimental plugins

refactor: remove pluggable electron

chore: add sorting for conversations

chore: build plugins for testing

chore: consistent plugin directory name

chore: docs

chore: fix CI

chore: update conversation prefix
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

No open projects
Archived in project

Development

Successfully merging this pull request may close these issues.

3 participants